Jul 08 18:25:21 devstack cinder-volume[75769]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 08 18:25:21 devstack cinder-volume[75769]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 18:25:21 devstack cinder-volume[75769]: we strongly recommend against using it for new projects. Jul 08 18:25:21 devstack cinder-volume[75769]: If you are already using Eventlet, we recommend migrating to a different Jul 08 18:25:21 devstack cinder-volume[75769]: framework. For more detail see Jul 08 18:25:21 devstack cinder-volume[75769]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 18:25:21 devstack cinder-volume[75769]: import eventlet # noqa Jul 08 18:25:24 devstack cinder-volume[75769]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75769) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 18:25:24 devstack cinder-volume[75769]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75769) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 18:25:24 devstack cinder-volume[75769]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75769) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 18:25:25 devstack cinder-volume[75769]: INFO dbcounter [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] Registered counter for database cinder Jul 08 18:25:25 devstack cinder-volume[75769]: DEBUG oslo_db.sqlalchemy.engines [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75769) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 18:25:25 devstack cinder-volume[75769]: DEBUG dbcounter [-] [75769] Writer thread running {{(pid=75769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 18:25:25 devstack cinder-volume[75769]: INFO cinder.rpc [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 08 18:25:25 devstack cinder-volume[75769]: INFO cinder.rpc [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 08 18:25:25 devstack cinder-volume[75769]: DEBUG oslo_db.sqlalchemy.engines [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75769) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 18:25:25 devstack cinder-volume[75769]: INFO cinder.volume.manager [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] Determined volume DB was empty at startup. Jul 08 18:25:25 devstack cinder-volume[75769]: DEBUG cinder.volume.manager [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75769) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 08 18:25:25 devstack cinder-volume[75769]: INFO cinder.volume.manager [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 08 18:25:25 devstack cinder-volume[75769]: WARNING stevedore.named [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 18:25:25 devstack cinder-volume[75769]: WARNING castellan.key_manager [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 18:25:25 devstack cinder-volume[75769]: WARNING cinder.keymgr.conf_key_mgr [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 18:25:25 devstack cinder-volume[75769]: DEBUG cinder.volume.drivers.lvm [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75769) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 08 18:25:25 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_concurrency.processutils [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] CMD "cinder-rtstool verify" returned: 0 in 0.436s {{(pid=75769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_db.sqlalchemy.engines [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75769) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 18:25:26 devstack cinder-volume[75769]: INFO cinder.rpc [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 08 18:25:26 devstack cinder-volume[75769]: INFO cinder.rpc [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 08 18:25:26 devstack cinder-volume[75769]: WARNING stevedore.named [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 18:25:26 devstack cinder-volume[75769]: WARNING castellan.key_manager [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 18:25:26 devstack cinder-volume[75769]: INFO cinder.volume.manager [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_db.sqlalchemy.engines [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75769) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 18:25:26 devstack cinder-volume[75769]: INFO oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] Starting 1 workers Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] Started child 75930 {{(pid=75769) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 08 18:25:26 devstack cinder-volume[75930]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] Full set of CONF: {{(pid=75769) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] ******************************************************************************** {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] Configuration options gathered from: {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] ================================================================================ {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] allow_availability_zone_fallback = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] allow_compression_on_image_upload = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] allowed_direct_url_schemes = [] {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] api_rate_limit = True {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] auth_strategy = keystone {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] az_cache_duration = 3600 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_availability_zone = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_host = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_name = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_stats_polling_interval = 60 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backup_api_class = cinder.backup.api.API {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backup_name_template = backup-%s {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backup_use_same_host = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backup_use_temp_snapshot = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] chap_password = **** {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] chap_username = {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] cinder_internal_tenant_project_id = cd8ff3f79b5f49c4a68ef30b64f69737 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] cinder_internal_tenant_user_id = 317504bf27094587885bb5d9eb69337f {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] cloned_volume_same_az = True {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] cluster = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] compression_format = gzip {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] compute_api_class = cinder.compute.nova.API {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] config_dir = [] {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] config_source = [] {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] control_exchange = openstack {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] debug = True {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] default_availability_zone = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] default_group_type = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] default_volume_type = lvmdriver-1 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] disk_geometry = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] driver_client_cert = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] driver_client_cert_key = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] driver_data_namespace = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] driver_ssl_cert_path = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] driver_ssl_cert_verify = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] driver_use_ssl = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] enable_force_upload = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] enable_new_services = True {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] enable_unsupported_driver = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] enabled_backends = ['lvmdriver-1'] {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] enforce_multipath_for_image_xfer = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] filter_function = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] glance_api_insecure = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] glance_api_servers = ['http://192.168.122.187/image'] {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] glance_api_ssl_compression = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] glance_ca_certificates_file = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] glance_catalog_info = image:glance:publicURL {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] glance_certfile = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] glance_keyfile = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] glance_num_retries = 3 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] glance_request_timeout = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] goodness_function = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] graceful_shutdown_timeout = 5 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] group_api_class = cinder.group.api.API {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] host = devstack {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] image_compress_on_upload = True {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] image_conversion_address_space_limit = 1 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] image_conversion_cpu_limit = 60 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] image_conversion_disable = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] image_upload_use_cinder_backend = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] image_upload_use_internal_tenant = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] image_volume_cache_enabled = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] image_volume_cache_max_count = 0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] image_volume_cache_max_size_gb = 0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] init_host_max_objects_retrieval = 0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] instance_format = [instance: %(uuid)s] {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] iscsi_target_flags = {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] iscsi_write_cache = on {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] iser_helper = tgtadm {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] iser_ip_address = 192.168.122.187 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] iser_port = 3260 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] log_color = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] log_config_append = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] log_dir = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] log_file = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] log_options = True {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] log_rotate_interval = 1 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] log_rotate_interval_type = days {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] log_rotation_type = none {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] max_age = 0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] max_logfile_count = 30 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] max_logfile_size_mb = 200 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] max_over_subscription_ratio = 20.0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] message_reap_interval = 86400 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] message_ttl = 2592000 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] migration_create_volume_timeout_secs = 300 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] monkey_patch = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] monkey_patch_modules = [] {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] my_ip = 192.168.122.187 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] no_snapshot_gb_quota = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] num_iser_scan_tries = 3 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] num_shell_tries = 3 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] num_volume_device_scan_tries = 3 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] nvmeof_conn_info_version = 1 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] nvmet_ns_id = 10 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] nvmet_port_id = 1 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] osapi_max_limit = 1000 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] osapi_volume_ext_list = [] {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] osapi_volume_listen = 0.0.0.0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] osapi_volume_listen_port = 8776 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] osapi_volume_use_ssl = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] osapi_volume_workers = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] per_volume_size_limit = -1 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] periodic_fuzzy_delay = 60 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] periodic_interval = 60 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] project_id_regex = [0-9a-f\-]+ {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] public_endpoint = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] publish_errors = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] quota_backup_gigabytes = 1000 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] quota_backups = 10 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] quota_gigabytes = 1000 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] quota_groups = 10 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] quota_snapshots = 10 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] quota_volumes = 10 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] rate_limit_burst = 0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75930]: INFO cinder.volume.manager [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 08 18:25:26 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] rate_limit_except_level = CRITICAL {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] rate_limit_interval = 0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] reinit_driver_count = 3 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] replication_device = **** {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] report_discard_supported = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] report_interval = 120 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] reservation_clean_interval = 86400 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] reservation_expire = 86400 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] reserved_image_namespaces = [] {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] reserved_percentage = 0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] rpc_response_timeout = 120 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] run_external_periodic_tasks = True {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] scst_target_driver = iscsi {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] scst_target_iqn_name = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] service_down_time = 720 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] shell_completion = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] snapshot_name_template = snapshot-%s {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] snapshot_same_host = True {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] split_loggers = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] state_path = /opt/stack/data/cinder {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] storage_availability_zone = nova {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] storage_protocol = iSCSI {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] syslog_log_facility = LOG_USER {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] target_helper = lioadm {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] target_ip_address = 192.168.122.187 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] target_port = 3260 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] target_protocol = iscsi {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] target_secondary_ip_addresses = [] {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] trace_flags = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] transfer_api_class = cinder.transfer.api.API {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] transport_url = **** {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] until_refresh = 0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] use_chap_auth = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] use_default_quota_class = True {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] use_journal = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] use_json = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] use_multipath_for_image_xfer = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] use_stderr = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] use_syslog = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] verify_glance_signatures = enabled {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] volume_api_class = cinder.volume.api.API {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] volume_backend_name = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] volume_clear = zero {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] volume_clear_ionice = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] volume_clear_size = 0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] volume_copy_bps_limit = 0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] volume_dd_blocksize = 1M {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] volume_name_template = volume-%s {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] volume_service_inithost_offload = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] volume_usage_audit_period = month {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] zoning_mode = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_concurrency.disable_process_locking = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] keystone_authtoken.auth_section = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] keystone_authtoken.auth_type = password {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] keystone_authtoken.auth_version = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] keystone_authtoken.cache = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] keystone_authtoken.certfile = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] keystone_authtoken.delay_auth_decision = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] keystone_authtoken.http_connect_timeout = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] keystone_authtoken.include_service_catalog = True {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] keystone_authtoken.insecure = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] keystone_authtoken.interface = public {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] keystone_authtoken.keyfile = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] keystone_authtoken.memcache_password = {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] keystone_authtoken.memcache_username = {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] keystone_authtoken.region_name = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] keystone_authtoken.service_token_roles_required = True {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] keystone_authtoken.service_type = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] keystone_authtoken.token_cache_time = 300 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.187/identity {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] cache.backend = dogpile.cache.null {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] cache.backend_argument = **** {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] cache.backend_expiration_time = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] cache.config_prefix = cache.oslo {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] cache.debug_cache_backend = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] cache.enable_retry_client = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] cache.enable_socket_keepalive = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] cache.enabled = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] cache.expiration_time = 600 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] cache.hashclient_retry_attempts = 2 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] cache.memcache_dead_retry = 300 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] cache.memcache_pool_maxsize = 10 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] cache.memcache_sasl_enabled = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] cache.password = **** {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] cache.proxies = [] {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] cache.redis_db = 0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] cache.redis_sentinel_service_name = mymaster {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] cache.redis_server = localhost:6379 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] cache.retry_attempts = 2 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] cache.retry_delay = 0.0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] cache.socket_keepalive_count = 1 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] cache.socket_keepalive_idle = 1 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] cache.socket_keepalive_interval = 1 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] cache.socket_timeout = 1.0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] cache.tls_allowed_ciphers = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] cache.tls_cafile = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] cache.tls_certfile = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] cache.tls_enabled = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] cache.tls_keyfile = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] cache.username = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] coordination.backend_url = **** {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] database.asyncio_connection = **** {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] database.asyncio_slave_connection = **** {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] database.backend = sqlalchemy {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] database.connection = **** {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] database.connection_debug = 0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] database.connection_parameters = {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] database.connection_recycle_time = 3600 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] database.connection_trace = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] database.db_inc_retry_interval = True {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] database.db_max_retries = 20 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] database.db_max_retry_interval = 10 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] database.db_retry_interval = 1 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] database.max_overflow = 50 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] database.max_pool_size = 5 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] database.max_retries = 10 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] database.mysql_wsrep_sync_wait = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] database.pool_timeout = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] database.retry_interval = 10 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] database.slave_connection = **** {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] database.sqlite_synchronous = True {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] database.synchronous_reader = True {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] database.use_db_reconnect = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] profiler.connection_string = messaging:// {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] profiler.enabled = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] profiler.es_doc_type = notification {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] profiler.es_scroll_size = 10000 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] profiler.es_scroll_time = 2m {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] profiler.filter_error_trace = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] profiler.hmac_keys = **** {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] profiler.sentinel_service_name = mymaster {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] profiler.socket_timeout = 0.1 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] profiler.trace_requests = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] profiler.trace_sqlalchemy = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] profiler_jaeger.process_tags = {} {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] profiler_jaeger.service_name_prefix = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] profiler_otlp.service_name_prefix = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_policy.enforce_new_defaults = True {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_policy.enforce_scope = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_policy.policy_default_rule = default {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_policy.policy_file = policy.yaml {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_policy.remote_timeout = 60.0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] privsep_osbrick.group = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] privsep_osbrick.helper_command = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] privsep_osbrick.user = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] cinder_sys_admin.group = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] cinder_sys_admin.helper_command = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] cinder_sys_admin.user = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] service_user.auth_section = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] service_user.auth_type = password {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] service_user.cafile = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] service_user.certfile = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] service_user.collect_timing = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] service_user.insecure = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] service_user.keyfile = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] service_user.send_service_user_token = True {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] service_user.split_loggers = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] service_user.timeout = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] glance.auth_section = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] glance.auth_type = password {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] glance.certfile = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] glance.collect_timing = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] glance.insecure = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] glance.keyfile = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] glance.region_name = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] glance.split_loggers = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] glance.timeout = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.backend_availability_zone = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.chap_password = **** {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.chap_username = {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.disk_geometry = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.driver_client_cert = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.driver_client_cert_key = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.driver_data_namespace = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.driver_use_ssl = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.enable_unsupported_driver = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.extra_capabilities = {} {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.filter_function = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.goodness_function = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.iscsi_target_flags = {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack sudo[75935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 08 18:25:26 devstack sudo[75935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.iscsi_write_cache = on {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.iser_helper = tgtadm {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.iser_ip_address = 192.168.122.187 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.iser_port = 3260 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.lvm_mirrors = 0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.lvm_share_target = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.lvm_type = auto {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.num_shell_tries = 3 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.nvmet_port_id = 1 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.replication_device = **** {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.report_discard_supported = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.reserved_percentage = 0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.scst_target_driver = iscsi {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.scst_target_iqn_name = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.storage_protocol = iSCSI {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.target_helper = tgtadm {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.target_ip_address = 192.168.122.187 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.target_port = 3260 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.target_protocol = iscsi {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.trace_flags = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.unique_fqdn_network = True {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.use_chap_auth = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.volume_backend_name = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.volume_clear = zero {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.volume_clear_ionice = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.volume_clear_size = 0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.volume_group = cinder-volumes {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_reports.file_event_handler = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_reports.log_dir = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.backend_availability_zone = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.backend_host = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.chap_password = **** {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.chap_username = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.chiscsi_conf = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.disk_geometry = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.driver_client_cert = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.driver_data_namespace = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.driver_use_ssl = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.extra_capabilities = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.filter_function = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.goodness_function = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.iser_helper = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.iser_ip_address = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.iser_port = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.iser_target_prefix = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.lvm_conf_file = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.lvm_mirrors = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.lvm_share_target = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.lvm_type = auto {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.num_shell_tries = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.nvmet_port_id = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.replication_device = **** {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.report_discard_supported = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.reserved_percentage = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.scst_target_driver = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.storage_protocol = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.target_helper = lioadm {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.target_ip_address = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.target_port = 3260 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.target_protocol = iscsi {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.trace_flags = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.use_chap_auth = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.volume_clear = zero {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.volume_clear_size = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] lvmdriver-1.volumes_dir = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_messaging_rabbit.ssl = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_messaging_rabbit.ssl_version = {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_messaging_notifications.driver = [] {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_messaging_notifications.retry = -1 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] oslo_messaging_notifications.transport_url = **** {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] key_manager.fixed_key = **** {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] barbican.barbican_api_version = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] barbican.barbican_endpoint = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] barbican.barbican_endpoint_type = public {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] barbican.barbican_region_name = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] barbican.cafile = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] barbican.certfile = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] barbican.collect_timing = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] barbican.insecure = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] barbican.keyfile = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] barbican.number_of_retries = 60 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] barbican.retry_delay = 1 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] barbican.send_service_user_token = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] barbican.split_loggers = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] barbican.timeout = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] barbican.verify_ssl = True {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] barbican.verify_ssl_path = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] barbican_service_user.auth_section = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] barbican_service_user.auth_type = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] barbican_service_user.cafile = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] barbican_service_user.certfile = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] barbican_service_user.collect_timing = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] barbican_service_user.insecure = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] barbican_service_user.keyfile = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] barbican_service_user.split_loggers = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] barbican_service_user.timeout = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] vault.approle_role_id = **** {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] vault.approle_secret_id = **** {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] vault.kv_mountpoint = secret {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] vault.kv_path = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] vault.kv_version = 2 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] vault.namespace = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] vault.root_token_id = **** {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] vault.ssl_ca_crt_file = None {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] vault.timeout = 60.0 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] vault.use_ssl = False {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:25:26 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] ******************************************************************************** {{(pid=75769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 08 18:25:27 devstack sudo[75935]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:27 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.695s {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:27 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:27 devstack sudo[75941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 18:25:27 devstack sudo[75941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:28 devstack sudo[75941]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:28 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.662s {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:28 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:25:28 devstack cinder-volume[75930]: INFO cinder.brick.local_dev.lvm [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 08 18:25:28 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:28 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:28 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:28 devstack sudo[76256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 18:25:28 devstack sudo[76256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:28 devstack sudo[76256]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:28 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.805s {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:28 devstack cinder-volume[75930]: DEBUG cinder.brick.local_dev.lvm [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75930) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 08 18:25:28 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:28 devstack sudo[76499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 18:25:28 devstack sudo[76499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:30 devstack sudo[76499]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:30 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.248s {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:30 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:30 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:30 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:30 devstack sudo[76695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 18:25:30 devstack sudo[76695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:30 devstack sudo[76695]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:30 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.698s {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:30 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:30 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:30 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:30 devstack sudo[76713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 08 18:25:30 devstack sudo[76713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:31 devstack sudo[76713]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:31 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.797s {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:31 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:31 devstack sudo[76718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 18:25:31 devstack sudo[76718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:32 devstack sudo[76718]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:32 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.864s {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:32 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:32 devstack sudo[76723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 18:25:32 devstack sudo[76723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:33 devstack sudo[76723]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:33 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.850s {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:33 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:33 devstack sudo[76734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 18:25:33 devstack sudo[76734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:34 devstack sudo[76734]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:34 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.840s {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:34 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:34 devstack sudo[76744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 18:25:34 devstack sudo[76744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:34 devstack sudo[76744]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:34 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.667s {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:34 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:34 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:34 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:34 devstack sudo[76748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 18:25:34 devstack sudo[76748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:35 devstack sudo[76748]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:35 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.753s {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:35 devstack cinder-volume[75930]: INFO cinder.volume.drivers.lvm [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 08 18:25:35 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:35 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:35 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:35 devstack sudo[76759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 18:25:35 devstack sudo[76759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:36 devstack cinder-volume[75769]: DEBUG dbcounter [-] [75769] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:25:36 devstack sudo[76759]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:36 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.870s {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:36 devstack cinder-volume[75930]: DEBUG cinder.volume.drivers.lvm [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] Updating volume stats {{(pid=75930) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 18:25:36 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:36 devstack sudo[76876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 18:25:36 devstack sudo[76876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:37 devstack sudo[76876]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:37 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.692s {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:37 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:37 devstack sudo[77016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 18:25:37 devstack sudo[77016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:37 devstack sudo[77016]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:38 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.684s {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:38 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:38 devstack sudo[77019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 18:25:38 devstack sudo[77019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:38 devstack sudo[77019]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:38 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.630s {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:38 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:38 devstack sudo[77022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 18:25:38 devstack sudo[77022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:39 devstack sudo[77022]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:39 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.646s {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:39 devstack cinder-volume[75930]: INFO cinder.volume.driver [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] Driver hasn't implemented _init_vendor_properties() Jul 08 18:25:39 devstack cinder-volume[75930]: DEBUG cinder.volume.driver [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75930) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 08 18:25:39 devstack cinder-volume[75930]: DEBUG oslo_db.sqlalchemy.engines [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75930) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 18:25:39 devstack cinder-volume[75930]: DEBUG dbcounter [-] [75930] Writer thread running {{(pid=75930) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 18:25:39 devstack cinder-volume[75930]: DEBUG cinder.db.api [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] Building query based on filter {{(pid=75930) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 08 18:25:39 devstack cinder-volume[75930]: DEBUG cinder.image.image_utils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75930) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 08 18:25:39 devstack cinder-volume[75930]: INFO cinder.keymgr.migration [None req-127544bb-5cb0-49b8-8fb5-fe962f68421b None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 08 18:25:39 devstack cinder-volume[75930]: DEBUG cinder.volume.drivers.lvm [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] Updating volume stats {{(pid=75930) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 18:25:39 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:39 devstack sudo[77027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 18:25:39 devstack sudo[77027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:40 devstack sudo[77027]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:40 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.672s {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:40 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:40 devstack sudo[77033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 18:25:40 devstack sudo[77033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:40 devstack sudo[77033]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:40 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.688s {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:40 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:40 devstack sudo[77036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 18:25:40 devstack sudo[77036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:41 devstack sudo[77036]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:41 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.765s {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:41 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:41 devstack sudo[77041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 18:25:41 devstack sudo[77041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:42 devstack sudo[77041]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:42 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.674s {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:42 devstack cinder-volume[75930]: DEBUG cinder.manager [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] Notifying Schedulers of capabilities ... {{(pid=75930) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:25:42 devstack cinder-volume[75930]: INFO cinder.volume.manager [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] Driver initialization completed successfully. Jul 08 18:25:42 devstack cinder-volume[75930]: INFO cinder.manager [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] Initiating service 2 cleanup Jul 08 18:25:42 devstack cinder-volume[75930]: INFO cinder.manager [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] Service 2 cleanup completed. Jul 08 18:25:42 devstack cinder-volume[75930]: DEBUG cinder.service [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] Creating RPC server for service cinder-volume {{(pid=75930) start /opt/stack/cinder/cinder/service.py:231}} Jul 08 18:25:42 devstack cinder-volume[75930]: DEBUG cinder.service [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75930) start /opt/stack/cinder/cinder/service.py:237}} Jul 08 18:25:42 devstack cinder-volume[75930]: INFO cinder.volume.manager [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 08 18:25:42 devstack cinder-volume[75930]: DEBUG cinder.volume.drivers.lvm [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] Updating volume stats {{(pid=75930) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 18:25:42 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:42 devstack sudo[77044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 18:25:42 devstack sudo[77044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:43 devstack sudo[77044]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:43 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.714s {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:43 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:43 devstack sudo[77048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 18:25:43 devstack sudo[77048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:43 devstack sudo[77048]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:43 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.705s {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:43 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:43 devstack sudo[77054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 18:25:43 devstack sudo[77054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:44 devstack sudo[77054]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:44 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.662s {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:44 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:44 devstack sudo[77111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 18:25:44 devstack sudo[77111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:45 devstack sudo[77111]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:45 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.630s {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:45 devstack cinder-volume[75930]: INFO cinder.volume.manager [None req-e1b09dff-93ef-4776-a9c0-9452da8a159a None None] Driver post RPC initialization completed successfully. Jul 08 18:25:53 devstack cinder-volume[75930]: DEBUG oslo_service.periodic_task [None req-2df6ccf8-564b-4939-a113-e361995eb602 None None] Running periodic task VolumeManager._thread_info {{(pid=75930) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:25:53 devstack cinder-volume[75930]: DEBUG cinder.volume.manager [None req-2df6ccf8-564b-4939-a113-e361995eb602 None None] thread count: 6 {{(pid=75930) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:25:53 devstack cinder-volume[75930]: DEBUG cinder.volume.manager [None req-2df6ccf8-564b-4939-a113-e361995eb602 None None] thread info: [<_MainThread(MainThread, started 136516407701632)>, , , , , ] {{(pid=75930) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:25:55 devstack cinder-volume[75930]: DEBUG dbcounter [-] [75930] Writing DB stats cinder:SELECT=3 {{(pid=75930) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:25:55 devstack cinder-volume[75930]: DEBUG dbcounter [-] [75930] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75930) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:26:53 devstack cinder-volume[75930]: DEBUG oslo_service.periodic_task [None req-2df6ccf8-564b-4939-a113-e361995eb602 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75930) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:26:53 devstack cinder-volume[75930]: DEBUG cinder.volume.drivers.lvm [None req-2df6ccf8-564b-4939-a113-e361995eb602 None None] Updating volume stats {{(pid=75930) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 18:26:53 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-2df6ccf8-564b-4939-a113-e361995eb602 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:53 devstack sudo[78899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 18:26:53 devstack sudo[78899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:53 devstack sudo[78899]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:53 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-2df6ccf8-564b-4939-a113-e361995eb602 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.692s {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:53 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-2df6ccf8-564b-4939-a113-e361995eb602 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:53 devstack sudo[79000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 18:26:53 devstack sudo[79000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:54 devstack sudo[79000]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:54 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-2df6ccf8-564b-4939-a113-e361995eb602 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.643s {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:54 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-2df6ccf8-564b-4939-a113-e361995eb602 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:54 devstack sudo[79072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 18:26:54 devstack sudo[79072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:55 devstack sudo[79072]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:55 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-2df6ccf8-564b-4939-a113-e361995eb602 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.639s {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:55 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-2df6ccf8-564b-4939-a113-e361995eb602 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:55 devstack sudo[79185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 18:26:55 devstack sudo[79185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:55 devstack sudo[79185]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:55 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-2df6ccf8-564b-4939-a113-e361995eb602 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.633s {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:55 devstack cinder-volume[75930]: DEBUG cinder.manager [None req-2df6ccf8-564b-4939-a113-e361995eb602 None None] Notifying Schedulers of capabilities ... {{(pid=75930) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:26:55 devstack cinder-volume[75930]: DEBUG oslo_service.periodic_task [None req-2df6ccf8-564b-4939-a113-e361995eb602 None None] Running periodic task VolumeManager._thread_info {{(pid=75930) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:26:55 devstack cinder-volume[75930]: DEBUG cinder.volume.manager [None req-2df6ccf8-564b-4939-a113-e361995eb602 None None] thread count: 6 {{(pid=75930) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:26:55 devstack cinder-volume[75930]: DEBUG cinder.volume.manager [None req-2df6ccf8-564b-4939-a113-e361995eb602 None None] thread info: [<_MainThread(MainThread, started 136516407701632)>, , , , , ] {{(pid=75930) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:27:53 devstack cinder-volume[75930]: DEBUG oslo_service.periodic_task [None req-2df6ccf8-564b-4939-a113-e361995eb602 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75930) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:27:53 devstack cinder-volume[75930]: DEBUG cinder.volume.drivers.lvm [None req-2df6ccf8-564b-4939-a113-e361995eb602 None None] Updating volume stats {{(pid=75930) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 18:27:53 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-2df6ccf8-564b-4939-a113-e361995eb602 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:53 devstack sudo[82235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 18:27:53 devstack sudo[82235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:53 devstack sudo[82235]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:53 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-2df6ccf8-564b-4939-a113-e361995eb602 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.702s {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:53 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-2df6ccf8-564b-4939-a113-e361995eb602 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:53 devstack sudo[82243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 18:27:53 devstack sudo[82243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:54 devstack sudo[82243]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:54 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-2df6ccf8-564b-4939-a113-e361995eb602 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.720s {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:54 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-2df6ccf8-564b-4939-a113-e361995eb602 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:54 devstack sudo[82254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 18:27:54 devstack sudo[82254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:55 devstack cinder-volume[75930]: DEBUG dbcounter [-] [75930] Writing DB stats cinder:SELECT=1 {{(pid=75930) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:27:55 devstack cinder-volume[75930]: DEBUG dbcounter [-] [75930] Writing DB stats cinder:UPDATE=1 {{(pid=75930) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:27:55 devstack sudo[82254]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:55 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-2df6ccf8-564b-4939-a113-e361995eb602 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.716s {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:55 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-2df6ccf8-564b-4939-a113-e361995eb602 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:55 devstack sudo[82262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 18:27:55 devstack sudo[82262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:56 devstack sudo[82262]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:56 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-2df6ccf8-564b-4939-a113-e361995eb602 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.719s {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:56 devstack cinder-volume[75930]: DEBUG cinder.manager [None req-2df6ccf8-564b-4939-a113-e361995eb602 None None] Notifying Schedulers of capabilities ... {{(pid=75930) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:27:56 devstack cinder-volume[75930]: DEBUG oslo_service.periodic_task [None req-2df6ccf8-564b-4939-a113-e361995eb602 None None] Running periodic task VolumeManager._thread_info {{(pid=75930) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:27:56 devstack cinder-volume[75930]: DEBUG cinder.volume.manager [None req-2df6ccf8-564b-4939-a113-e361995eb602 None None] thread count: 6 {{(pid=75930) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:27:56 devstack cinder-volume[75930]: DEBUG cinder.volume.manager [None req-2df6ccf8-564b-4939-a113-e361995eb602 None None] thread info: [<_MainThread(MainThread, started 136516407701632)>, , , , , ] {{(pid=75930) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:28:53 devstack cinder-volume[75930]: DEBUG oslo_service.periodic_task [None req-2df6ccf8-564b-4939-a113-e361995eb602 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75930) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:28:53 devstack cinder-volume[75930]: DEBUG cinder.volume.drivers.lvm [None req-2df6ccf8-564b-4939-a113-e361995eb602 None None] Updating volume stats {{(pid=75930) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 18:28:53 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-2df6ccf8-564b-4939-a113-e361995eb602 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:53 devstack sudo[84221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 18:28:53 devstack sudo[84221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:53 devstack sudo[84221]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:53 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-2df6ccf8-564b-4939-a113-e361995eb602 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.689s {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:53 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-2df6ccf8-564b-4939-a113-e361995eb602 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:53 devstack sudo[84238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 18:28:53 devstack sudo[84238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:54 devstack sudo[84238]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:54 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-2df6ccf8-564b-4939-a113-e361995eb602 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.714s {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:54 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-2df6ccf8-564b-4939-a113-e361995eb602 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:54 devstack sudo[84250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 18:28:54 devstack sudo[84250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:55 devstack sudo[84250]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:55 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-2df6ccf8-564b-4939-a113-e361995eb602 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.707s {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:55 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-2df6ccf8-564b-4939-a113-e361995eb602 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:55 devstack sudo[84257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 18:28:55 devstack sudo[84257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:55 devstack sudo[84257]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:55 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-2df6ccf8-564b-4939-a113-e361995eb602 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.708s {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:55 devstack cinder-volume[75930]: DEBUG cinder.manager [None req-2df6ccf8-564b-4939-a113-e361995eb602 None None] Notifying Schedulers of capabilities ... {{(pid=75930) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:28:56 devstack cinder-volume[75930]: DEBUG oslo_service.periodic_task [None req-2df6ccf8-564b-4939-a113-e361995eb602 None None] Running periodic task VolumeManager._thread_info {{(pid=75930) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:28:56 devstack cinder-volume[75930]: DEBUG cinder.volume.manager [None req-2df6ccf8-564b-4939-a113-e361995eb602 None None] thread count: 6 {{(pid=75930) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:28:56 devstack cinder-volume[75930]: DEBUG cinder.volume.manager [None req-2df6ccf8-564b-4939-a113-e361995eb602 None None] thread info: [<_MainThread(MainThread, started 136516407701632)>, , , , , ] {{(pid=75930) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:29:53 devstack cinder-volume[75930]: DEBUG oslo_service.periodic_task [None req-2df6ccf8-564b-4939-a113-e361995eb602 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75930) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:29:53 devstack cinder-volume[75930]: DEBUG cinder.volume.drivers.lvm [None req-2df6ccf8-564b-4939-a113-e361995eb602 None None] Updating volume stats {{(pid=75930) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 18:29:53 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-2df6ccf8-564b-4939-a113-e361995eb602 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:29:53 devstack sudo[85455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 18:29:53 devstack sudo[85455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:29:53 devstack sudo[85455]: pam_unix(sudo:session): session closed for user root Jul 08 18:29:53 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-2df6ccf8-564b-4939-a113-e361995eb602 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.706s {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:29:53 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-2df6ccf8-564b-4939-a113-e361995eb602 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:29:53 devstack sudo[85459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 18:29:53 devstack sudo[85459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:29:54 devstack sudo[85459]: pam_unix(sudo:session): session closed for user root Jul 08 18:29:54 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-2df6ccf8-564b-4939-a113-e361995eb602 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.631s {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:29:54 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-2df6ccf8-564b-4939-a113-e361995eb602 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:29:54 devstack sudo[85464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 18:29:54 devstack sudo[85464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:29:55 devstack cinder-volume[75930]: DEBUG dbcounter [-] [75930] Writing DB stats cinder:SELECT=1 {{(pid=75930) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:29:55 devstack cinder-volume[75930]: DEBUG dbcounter [-] [75930] Writing DB stats cinder:UPDATE=1 {{(pid=75930) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:29:55 devstack sudo[85464]: pam_unix(sudo:session): session closed for user root Jul 08 18:29:55 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-2df6ccf8-564b-4939-a113-e361995eb602 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.678s {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:29:55 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-2df6ccf8-564b-4939-a113-e361995eb602 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:29:55 devstack sudo[85473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 18:29:55 devstack sudo[85473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:29:55 devstack sudo[85473]: pam_unix(sudo:session): session closed for user root Jul 08 18:29:55 devstack cinder-volume[75930]: DEBUG oslo_concurrency.processutils [None req-2df6ccf8-564b-4939-a113-e361995eb602 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.661s {{(pid=75930) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:29:55 devstack cinder-volume[75930]: DEBUG cinder.manager [None req-2df6ccf8-564b-4939-a113-e361995eb602 None None] Notifying Schedulers of capabilities ... {{(pid=75930) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:29:55 devstack cinder-volume[75930]: DEBUG oslo_service.periodic_task [None req-2df6ccf8-564b-4939-a113-e361995eb602 None None] Running periodic task VolumeManager._thread_info {{(pid=75930) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:29:55 devstack cinder-volume[75930]: DEBUG cinder.volume.manager [None req-2df6ccf8-564b-4939-a113-e361995eb602 None None] thread count: 6 {{(pid=75930) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:29:55 devstack cinder-volume[75930]: DEBUG cinder.volume.manager [None req-2df6ccf8-564b-4939-a113-e361995eb602 None None] thread info: [<_MainThread(MainThread, started 136516407701632)>, , , , , ] {{(pid=75930) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:30:20 devstack cinder-volume[75769]: INFO oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] Caught SIGTERM, stopping children Jul 08 18:30:20 devstack cinder-volume[75769]: DEBUG oslo_concurrency.lockutils [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] Acquiring lock "singleton_lock" {{(pid=75769) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 18:30:20 devstack cinder-volume[75769]: DEBUG oslo_concurrency.lockutils [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] Acquired lock "singleton_lock" {{(pid=75769) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 18:30:20 devstack cinder-volume[75769]: DEBUG oslo_concurrency.lockutils [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] Releasing lock "singleton_lock" {{(pid=75769) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 18:30:20 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] Stop services. {{(pid=75769) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 08 18:30:20 devstack cinder-volume[75769]: DEBUG oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] Killing children. {{(pid=75769) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 08 18:30:20 devstack cinder-volume[75769]: INFO oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] Waiting on 1 children to exit Jul 08 18:30:22 devstack cinder-volume[75930]: DEBUG oslo_concurrency.lockutils [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] Acquiring lock "singleton_lock" {{(pid=75930) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 18:30:22 devstack cinder-volume[75930]: DEBUG oslo_concurrency.lockutils [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] Acquired lock "singleton_lock" {{(pid=75930) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 18:30:22 devstack cinder-volume[75930]: DEBUG oslo_concurrency.lockutils [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] Releasing lock "singleton_lock" {{(pid=75930) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 18:30:22 devstack cinder-volume[75930]: WARNING amqp [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 18:30:22 devstack cinder-volume[75930]: WARNING amqp [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 18:30:22 devstack cinder-volume[75769]: INFO oslo_service.backend._eventlet.service [None req-c334243c-8a63-451e-b0f0-4689d133cb0f None None] Child 75930 exited with status 0 Jul 08 18:30:22 devstack cinder-volume[86081]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 08 18:30:22 devstack cinder-volume[86081]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 18:30:22 devstack cinder-volume[86081]: we strongly recommend against using it for new projects. Jul 08 18:30:22 devstack cinder-volume[86081]: If you are already using Eventlet, we recommend migrating to a different Jul 08 18:30:22 devstack cinder-volume[86081]: framework. For more detail see Jul 08 18:30:22 devstack cinder-volume[86081]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 18:30:22 devstack cinder-volume[86081]: import eventlet # noqa Jul 08 18:30:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86081) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 18:30:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86081) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 18:30:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86081) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 18:30:25 devstack cinder-volume[86081]: INFO dbcounter [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] Registered counter for database cinder Jul 08 18:30:25 devstack cinder-volume[86081]: DEBUG oslo_db.sqlalchemy.engines [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86081) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 18:30:25 devstack cinder-volume[86081]: DEBUG dbcounter [-] [86081] Writer thread running {{(pid=86081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 18:30:25 devstack cinder-volume[86081]: INFO cinder.rpc [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 08 18:30:25 devstack cinder-volume[86081]: INFO cinder.rpc [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_db.sqlalchemy.engines [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86081) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 18:30:26 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] Determined volume DB was empty at startup. Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86081) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 08 18:30:26 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 08 18:30:26 devstack cinder-volume[86081]: WARNING stevedore.named [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 18:30:26 devstack cinder-volume[86081]: WARNING castellan.key_manager [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 18:30:26 devstack cinder-volume[86081]: WARNING cinder.keymgr.conf_key_mgr [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 18:30:26 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_db.sqlalchemy.engines [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86081) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 18:30:26 devstack cinder-volume[86081]: INFO oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] Starting 1 workers Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] Started child 86294 {{(pid=86081) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] Full set of CONF: {{(pid=86081) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] ******************************************************************************** {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] Configuration options gathered from: {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] ================================================================================ {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] allow_availability_zone_fallback = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] allow_compression_on_image_upload = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] allowed_direct_url_schemes = [] {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] api_rate_limit = True {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] auth_strategy = keystone {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_availability_zone = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_host = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86294]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_name = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_stats_polling_interval = 60 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backup_api_class = cinder.backup.api.API {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backup_name_template = backup-%s {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backup_use_same_host = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backup_use_temp_snapshot = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] chap_password = **** {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] chap_username = {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] cinder_internal_tenant_project_id = cd8ff3f79b5f49c4a68ef30b64f69737 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] cinder_internal_tenant_user_id = 317504bf27094587885bb5d9eb69337f {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] cluster = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] compression_format = gzip {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] compute_api_class = cinder.compute.nova.API {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] config_dir = [] {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] config_source = [] {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] control_exchange = openstack {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] debug = True {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] default_availability_zone = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] default_group_type = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] default_volume_type = QuobyteHD {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] disk_geometry = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] driver_client_cert = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] driver_client_cert_key = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] driver_data_namespace = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] driver_ssl_cert_path = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] driver_ssl_cert_verify = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] driver_use_ssl = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] enable_new_services = True {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] enable_unsupported_driver = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] enabled_backends = ['QuobyteHD'] {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] enforce_multipath_for_image_xfer = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] filter_function = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] glance_api_insecure = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] glance_api_servers = ['http://192.168.122.187/image'] {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] glance_api_ssl_compression = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] glance_ca_certificates_file = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] glance_catalog_info = image:glance:publicURL {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] glance_certfile = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] glance_keyfile = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] glance_num_retries = 3 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] glance_request_timeout = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] goodness_function = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] graceful_shutdown_timeout = 5 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] group_api_class = cinder.group.api.API {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] host = devstack {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] image_compress_on_upload = True {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] image_conversion_address_space_limit = 1 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] image_conversion_cpu_limit = 60 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] image_conversion_disable = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] image_upload_use_cinder_backend = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] image_upload_use_internal_tenant = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] image_volume_cache_enabled = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] image_volume_cache_max_count = 0 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] image_volume_cache_max_size_gb = 0 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] init_host_max_objects_retrieval = 0 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] instance_format = [instance: %(uuid)s] {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] iscsi_target_flags = {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] iscsi_write_cache = on {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] iser_helper = tgtadm {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] iser_ip_address = 192.168.122.187 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] iser_port = 3260 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] log_color = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] log_config_append = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] log_dir = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] log_file = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] log_options = True {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] log_rotate_interval = 1 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] log_rotate_interval_type = days {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] log_rotation_type = none {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] max_age = 0 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] max_logfile_count = 30 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] max_logfile_size_mb = 200 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] max_over_subscription_ratio = 20.0 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] message_reap_interval = 86400 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] message_ttl = 2592000 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] migration_create_volume_timeout_secs = 300 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] monkey_patch = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] monkey_patch_modules = [] {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] my_ip = 192.168.122.187 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] no_snapshot_gb_quota = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] num_iser_scan_tries = 3 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] num_shell_tries = 3 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] num_volume_device_scan_tries = 3 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-aeee8b02-4766-4681-a04b-3c2b54bd346c None None] Starting volume driver QuobyteDriver (1.1.14) Jul 08 18:30:26 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-aeee8b02-4766-4681-a04b-3c2b54bd346c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86294) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] nvmeof_conn_info_version = 1 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] nvmet_ns_id = 10 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] nvmet_port_id = 1 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] osapi_max_limit = 1000 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] osapi_volume_ext_list = [] {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] osapi_volume_listen_port = 8776 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] osapi_volume_use_ssl = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] osapi_volume_workers = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] per_volume_size_limit = -1 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] periodic_fuzzy_delay = 60 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] periodic_interval = 60 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] public_endpoint = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] publish_errors = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] quota_backup_gigabytes = 1000 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] quota_backups = 10 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] quota_gigabytes = 1000 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] quota_groups = 10 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] quota_snapshots = 10 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] quota_volumes = 10 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] rate_limit_burst = 0 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] rate_limit_except_level = CRITICAL {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] rate_limit_interval = 0 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] reinit_driver_count = 3 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] replication_device = **** {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] report_discard_supported = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] report_interval = 120 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] reservation_clean_interval = 86400 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] reservation_expire = 86400 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] reserved_image_namespaces = [] {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] reserved_percentage = 0 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] rpc_response_timeout = 120 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] run_external_periodic_tasks = True {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] scst_target_driver = iscsi {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] scst_target_iqn_name = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] service_down_time = 720 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] shell_completion = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] snapshot_name_template = snapshot-%s {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] split_loggers = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] state_path = /opt/stack/data/cinder {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] storage_availability_zone = nova {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] storage_protocol = iSCSI {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] syslog_log_facility = LOG_USER {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] target_helper = lioadm {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] target_ip_address = 192.168.122.187 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] target_port = 3260 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] target_protocol = iscsi {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] target_secondary_ip_addresses = [] {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] trace_flags = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] transport_url = **** {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] until_refresh = 0 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] use_chap_auth = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-aeee8b02-4766-4681-a04b-3c2b54bd346c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86294) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] use_default_quota_class = True {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.quobyte [None req-aeee8b02-4766-4681-a04b-3c2b54bd346c None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] use_journal = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.quobyte [None req-aeee8b02-4766-4681-a04b-3c2b54bd346c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] use_json = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] use_multipath_for_image_xfer = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] use_stderr = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] use_syslog = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-aeee8b02-4766-4681-a04b-3c2b54bd346c None None] Running cmd (subprocess): mount.quobyte {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] verify_glance_signatures = enabled {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] volume_api_class = cinder.volume.api.API {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] volume_backend_name = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] volume_clear = zero {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] volume_clear_ionice = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] volume_clear_size = 0 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] volume_copy_bps_limit = 0 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] volume_dd_blocksize = 1M {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] volume_name_template = volume-%s {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] volume_service_inithost_offload = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] volume_usage_audit_period = month {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] zoning_mode = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_concurrency.disable_process_locking = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] keystone_authtoken.auth_section = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] keystone_authtoken.auth_type = password {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] keystone_authtoken.auth_version = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] keystone_authtoken.cache = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] keystone_authtoken.certfile = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] keystone_authtoken.include_service_catalog = True {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] keystone_authtoken.insecure = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] keystone_authtoken.interface = public {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] keystone_authtoken.keyfile = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] keystone_authtoken.memcache_password = {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack quobyte-client[86295]: Reading configuration file: /etc/quobyte/client.cfg Jul 08 18:30:26 devstack quobyte-client[86295]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] keystone_authtoken.memcache_username = {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-aeee8b02-4766-4681-a04b-3c2b54bd346c None None] CMD "mount.quobyte" returned: 1 in 0.065s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:30:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-aeee8b02-4766-4681-a04b-3c2b54bd346c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:30:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-aeee8b02-4766-4681-a04b-3c2b54bd346c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:30:26 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-aeee8b02-4766-4681-a04b-3c2b54bd346c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:30:26 devstack cinder-volume[86294]: INFO cinder.volume.drivers.quobyte [None req-aeee8b02-4766-4681-a04b-3c2b54bd346c None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 ... Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] keystone_authtoken.region_name = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-aeee8b02-4766-4681-a04b-3c2b54bd346c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 -c /etc/quobyte/client-cinder.cfg {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] keystone_authtoken.service_type = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.187/identity {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] cache.backend = dogpile.cache.null {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] cache.backend_argument = **** {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] cache.backend_expiration_time = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] cache.config_prefix = cache.oslo {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] cache.debug_cache_backend = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] cache.enable_retry_client = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] cache.enable_socket_keepalive = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] cache.enabled = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] cache.expiration_time = 600 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] cache.hashclient_retry_attempts = 2 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] cache.memcache_dead_retry = 300 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] cache.memcache_pool_maxsize = 10 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] cache.memcache_sasl_enabled = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack sudo[86296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 -c /etc/quobyte/client-cinder.cfg Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] cache.password = **** {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] cache.proxies = [] {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] cache.redis_db = 0 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack sudo[86296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] cache.redis_server = localhost:6379 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] cache.retry_attempts = 2 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] cache.retry_delay = 0.0 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] cache.socket_keepalive_count = 1 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] cache.socket_keepalive_idle = 1 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] cache.socket_keepalive_interval = 1 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] cache.socket_timeout = 1.0 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] cache.tls_allowed_ciphers = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] cache.tls_cafile = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] cache.tls_certfile = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] cache.tls_enabled = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] cache.tls_keyfile = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] cache.username = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] coordination.backend_url = **** {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] database.asyncio_connection = **** {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] database.asyncio_slave_connection = **** {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] database.backend = sqlalchemy {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] database.connection = **** {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] database.connection_debug = 0 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] database.connection_parameters = {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] database.connection_recycle_time = 3600 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] database.connection_trace = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] database.db_inc_retry_interval = True {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] database.db_max_retries = 20 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] database.db_max_retry_interval = 10 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] database.db_retry_interval = 1 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] database.max_overflow = 50 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] database.max_pool_size = 5 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] database.max_retries = 10 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] database.mysql_wsrep_sync_wait = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] database.pool_timeout = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] database.retry_interval = 10 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] database.slave_connection = **** {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] database.sqlite_synchronous = True {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] database.synchronous_reader = True {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] database.use_db_reconnect = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] profiler.connection_string = messaging:// {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] profiler.enabled = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] profiler.es_doc_type = notification {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] profiler.es_scroll_size = 10000 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] profiler.es_scroll_time = 2m {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] profiler.filter_error_trace = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] profiler.hmac_keys = **** {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] profiler.sentinel_service_name = mymaster {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] profiler.socket_timeout = 0.1 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] profiler.trace_requests = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] profiler.trace_sqlalchemy = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] profiler_jaeger.process_tags = {} {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] profiler_jaeger.service_name_prefix = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] profiler_otlp.service_name_prefix = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_policy.enforce_new_defaults = True {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_policy.enforce_scope = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_policy.policy_default_rule = default {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_policy.policy_file = policy.yaml {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] privsep_osbrick.group = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] privsep_osbrick.helper_command = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] privsep_osbrick.user = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] cinder_sys_admin.group = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] cinder_sys_admin.helper_command = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] cinder_sys_admin.user = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] service_user.auth_section = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] service_user.auth_type = password {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] service_user.cafile = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] service_user.certfile = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] service_user.collect_timing = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] service_user.insecure = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] service_user.keyfile = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] service_user.send_service_user_token = True {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] service_user.split_loggers = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] service_user.timeout = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] glance.auth_section = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] glance.auth_type = password {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] glance.certfile = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] glance.collect_timing = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] glance.insecure = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] glance.keyfile = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] glance.region_name = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] glance.split_loggers = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] glance.timeout = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.backend_availability_zone = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.chap_password = **** {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.chap_username = {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.disk_geometry = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.driver_client_cert = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.driver_client_cert_key = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.driver_data_namespace = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.driver_use_ssl = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.extra_capabilities = {} {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.filter_function = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.goodness_function = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.iscsi_target_flags = {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.iscsi_write_cache = on {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.iser_helper = tgtadm {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.iser_ip_address = 192.168.122.187 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.iser_port = 3260 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.nas_host = {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.nas_login = admin {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.nas_mount_options = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.nas_password = **** {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.nas_private_key = {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.nas_share_path = {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.num_shell_tries = 3 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.quobyte_volume_url = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.replication_device = **** {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.report_discard_supported = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.reserved_percentage = 0 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.target_helper = tgtadm {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.target_ip_address = 192.168.122.187 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.target_port = 3260 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.target_protocol = iscsi {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.trace_flags = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.unique_fqdn_network = True {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.use_chap_auth = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.volume_backend_name = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.volume_clear = zero {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.volume_clear_ionice = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.volume_clear_size = 0 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_reports.file_event_handler = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_reports.log_dir = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.backend_availability_zone = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.backend_host = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.chap_password = **** {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.chap_username = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.chiscsi_conf = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.disk_geometry = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.driver_client_cert = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.driver_data_namespace = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.driver_use_ssl = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.extra_capabilities = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.filter_function = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.goodness_function = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.iser_helper = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.iser_ip_address = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.iser_port = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.iser_target_prefix = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.nas_host = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.nas_login = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.nas_mount_options = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.nas_password = **** {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.nas_private_key = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.nas_share_path = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.nas_ssh_port = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.num_shell_tries = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.nvmet_port_id = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.replication_device = **** {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.report_discard_supported = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.reserved_percentage = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.scst_target_driver = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.storage_protocol = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.target_helper = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.target_ip_address = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.target_port = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.target_prefix = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.target_protocol = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.trace_flags = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.use_chap_auth = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.volume_clear = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.volume_clear_size = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] QuobyteHD.volumes_dir = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_messaging_rabbit.ssl = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_messaging_notifications.driver = [] {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_messaging_notifications.retry = -1 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] key_manager.fixed_key = **** {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] barbican.barbican_api_version = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] barbican.barbican_endpoint = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] barbican.barbican_endpoint_type = public {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] barbican.barbican_region_name = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] barbican.cafile = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] barbican.certfile = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] barbican.collect_timing = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] barbican.insecure = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] barbican.keyfile = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] barbican.number_of_retries = 60 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] barbican.retry_delay = 1 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] barbican.send_service_user_token = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] barbican.split_loggers = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] barbican.timeout = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] barbican.verify_ssl = True {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] barbican.verify_ssl_path = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] barbican_service_user.auth_section = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] barbican_service_user.auth_type = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] barbican_service_user.cafile = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] barbican_service_user.certfile = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] barbican_service_user.collect_timing = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] barbican_service_user.insecure = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] barbican_service_user.keyfile = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] barbican_service_user.split_loggers = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] barbican_service_user.timeout = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] vault.approle_role_id = **** {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] vault.approle_secret_id = **** {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] vault.kv_mountpoint = secret {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] vault.kv_path = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] vault.kv_version = 2 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] vault.namespace = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] vault.root_token_id = **** {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] vault.ssl_ca_crt_file = None {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] vault.timeout = 60.0 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] vault.use_ssl = False {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:26 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] ******************************************************************************** {{(pid=86081) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 08 18:30:27 devstack sudo[86296]: pam_unix(sudo:session): session closed for user root Jul 08 18:30:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-aeee8b02-4766-4681-a04b-3c2b54bd346c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.909s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:30:27 devstack cinder-volume[86294]: INFO cinder.volume.drivers.quobyte [None req-aeee8b02-4766-4681-a04b-3c2b54bd346c None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 succeeded Jul 08 18:30:27 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-aeee8b02-4766-4681-a04b-3c2b54bd346c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:30:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-aeee8b02-4766-4681-a04b-3c2b54bd346c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.922s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:30:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-aeee8b02-4766-4681-a04b-3c2b54bd346c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:30:27 devstack sudo[86369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:30:27 devstack sudo[86369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:30:28 devstack sudo[86369]: pam_unix(sudo:session): session closed for user root Jul 08 18:30:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-aeee8b02-4766-4681-a04b-3c2b54bd346c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.660s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:30:28 devstack cinder-volume[86294]: INFO cinder.volume.driver [None req-aeee8b02-4766-4681-a04b-3c2b54bd346c None None] Driver hasn't implemented _init_vendor_properties() Jul 08 18:30:28 devstack cinder-volume[86294]: DEBUG cinder.volume.driver [None req-aeee8b02-4766-4681-a04b-3c2b54bd346c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7011032104492, 'free_capacity_gb': 1775.7011032104492, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86294) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 08 18:30:28 devstack cinder-volume[86294]: DEBUG oslo_db.sqlalchemy.engines [None req-aeee8b02-4766-4681-a04b-3c2b54bd346c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86294) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 18:30:28 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writer thread running {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 18:30:28 devstack cinder-volume[86294]: DEBUG cinder.db.api [None req-aeee8b02-4766-4681-a04b-3c2b54bd346c None None] Building query based on filter {{(pid=86294) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 08 18:30:28 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-aeee8b02-4766-4681-a04b-3c2b54bd346c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86294) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 08 18:30:28 devstack cinder-volume[86294]: INFO cinder.keymgr.migration [None req-da242540-6a25-4819-ac6a-392e85a92e3f None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 08 18:30:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-aeee8b02-4766-4681-a04b-3c2b54bd346c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:30:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-aeee8b02-4766-4681-a04b-3c2b54bd346c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:30:28 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-aeee8b02-4766-4681-a04b-3c2b54bd346c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:30:28 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-aeee8b02-4766-4681-a04b-3c2b54bd346c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:30:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-aeee8b02-4766-4681-a04b-3c2b54bd346c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:30:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-aeee8b02-4766-4681-a04b-3c2b54bd346c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:30:28 devstack sudo[86372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:30:28 devstack sudo[86372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:30:28 devstack sudo[86372]: pam_unix(sudo:session): session closed for user root Jul 08 18:30:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-aeee8b02-4766-4681-a04b-3c2b54bd346c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.658s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:30:28 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-aeee8b02-4766-4681-a04b-3c2b54bd346c None None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:30:28 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-aeee8b02-4766-4681-a04b-3c2b54bd346c None None] Driver initialization completed successfully. Jul 08 18:30:28 devstack cinder-volume[86294]: INFO cinder.manager [None req-aeee8b02-4766-4681-a04b-3c2b54bd346c None None] Initiating service 3 cleanup Jul 08 18:30:28 devstack cinder-volume[86294]: INFO cinder.manager [None req-aeee8b02-4766-4681-a04b-3c2b54bd346c None None] Service 3 cleanup completed. Jul 08 18:30:28 devstack cinder-volume[86294]: DEBUG cinder.service [None req-aeee8b02-4766-4681-a04b-3c2b54bd346c None None] Creating RPC server for service cinder-volume {{(pid=86294) start /opt/stack/cinder/cinder/service.py:231}} Jul 08 18:30:28 devstack cinder-volume[86294]: DEBUG cinder.service [None req-aeee8b02-4766-4681-a04b-3c2b54bd346c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86294) start /opt/stack/cinder/cinder/service.py:237}} Jul 08 18:30:29 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-aeee8b02-4766-4681-a04b-3c2b54bd346c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 08 18:30:29 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-aeee8b02-4766-4681-a04b-3c2b54bd346c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:30:29 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-aeee8b02-4766-4681-a04b-3c2b54bd346c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:30:29 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-aeee8b02-4766-4681-a04b-3c2b54bd346c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:30:29 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-aeee8b02-4766-4681-a04b-3c2b54bd346c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:30:29 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-aeee8b02-4766-4681-a04b-3c2b54bd346c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:30:29 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-aeee8b02-4766-4681-a04b-3c2b54bd346c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:30:29 devstack sudo[86379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:30:29 devstack sudo[86379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:30:29 devstack sudo[86379]: pam_unix(sudo:session): session closed for user root Jul 08 18:30:29 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-aeee8b02-4766-4681-a04b-3c2b54bd346c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.750s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:30:29 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-aeee8b02-4766-4681-a04b-3c2b54bd346c None None] Driver post RPC initialization completed successfully. Jul 08 18:30:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-b5960166-7f61-4f2a-ab7f-66b02c99d583 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:30:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-b5960166-7f61-4f2a-ab7f-66b02c99d583 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:30:33 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-b5960166-7f61-4f2a-ab7f-66b02c99d583 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:30:33 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-b5960166-7f61-4f2a-ab7f-66b02c99d583 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:30:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-b5960166-7f61-4f2a-ab7f-66b02c99d583 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:30:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b5960166-7f61-4f2a-ab7f-66b02c99d583 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:30:33 devstack sudo[86495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:30:33 devstack sudo[86495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:30:34 devstack sudo[86495]: pam_unix(sudo:session): session closed for user root Jul 08 18:30:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b5960166-7f61-4f2a-ab7f-66b02c99d583 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.625s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:30:34 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-b5960166-7f61-4f2a-ab7f-66b02c99d583 None None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:30:36 devstack cinder-volume[86081]: DEBUG dbcounter [-] [86081] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:30:37 devstack cinder-volume[86081]: INFO oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] Caught SIGTERM, stopping children Jul 08 18:30:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] Acquiring lock "singleton_lock" {{(pid=86081) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 18:30:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] Acquired lock "singleton_lock" {{(pid=86081) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 18:30:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] Releasing lock "singleton_lock" {{(pid=86081) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 18:30:37 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] Stop services. {{(pid=86081) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 08 18:30:37 devstack cinder-volume[86081]: DEBUG oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] Killing children. {{(pid=86081) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 08 18:30:37 devstack cinder-volume[86081]: INFO oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] Waiting on 1 children to exit Jul 08 18:30:39 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:SELECT=3 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:30:39 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:30:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] Acquiring lock "singleton_lock" {{(pid=86294) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 18:30:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] Acquired lock "singleton_lock" {{(pid=86294) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 18:30:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] Releasing lock "singleton_lock" {{(pid=86294) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 18:30:42 devstack cinder-volume[86294]: WARNING amqp [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 18:30:42 devstack cinder-volume[86294]: WARNING amqp [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 18:30:42 devstack cinder-volume[86081]: INFO oslo_service.backend._eventlet.service [None req-8058774d-0957-411f-bb06-3f6130a4a874 None None] Child 86294 exited with status 0 Jul 08 18:30:42 devstack cinder-volume[86586]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 08 18:30:42 devstack cinder-volume[86586]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 18:30:42 devstack cinder-volume[86586]: we strongly recommend against using it for new projects. Jul 08 18:30:42 devstack cinder-volume[86586]: If you are already using Eventlet, we recommend migrating to a different Jul 08 18:30:42 devstack cinder-volume[86586]: framework. For more detail see Jul 08 18:30:42 devstack cinder-volume[86586]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 18:30:42 devstack cinder-volume[86586]: import eventlet # noqa Jul 08 18:30:45 devstack cinder-volume[86586]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86586) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 18:30:45 devstack cinder-volume[86586]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86586) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 18:30:45 devstack cinder-volume[86586]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86586) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 18:30:46 devstack cinder-volume[86586]: INFO dbcounter [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] Registered counter for database cinder Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_db.sqlalchemy.engines [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86586) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG dbcounter [-] [86586] Writer thread running {{(pid=86586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 18:30:46 devstack cinder-volume[86586]: INFO cinder.rpc [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 08 18:30:46 devstack cinder-volume[86586]: INFO cinder.rpc [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_db.sqlalchemy.engines [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86586) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 18:30:46 devstack cinder-volume[86586]: INFO cinder.volume.manager [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] Determined volume DB was empty at startup. Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG cinder.volume.manager [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86586) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 08 18:30:46 devstack cinder-volume[86586]: WARNING stevedore.named [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 18:30:46 devstack cinder-volume[86586]: WARNING castellan.key_manager [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 18:30:46 devstack cinder-volume[86586]: WARNING cinder.keymgr.conf_key_mgr [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 18:30:46 devstack cinder-volume[86586]: INFO cinder.volume.manager [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_db.sqlalchemy.engines [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86586) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 18:30:46 devstack cinder-volume[86586]: INFO oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] Starting 1 workers Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] Started child 86873 {{(pid=86586) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] Full set of CONF: {{(pid=86586) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] ******************************************************************************** {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] Configuration options gathered from: {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] ================================================================================ {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] allow_availability_zone_fallback = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] allow_compression_on_image_upload = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86873]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] allowed_direct_url_schemes = [] {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] api_rate_limit = True {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] auth_strategy = keystone {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_availability_zone = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_host = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_name = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_stats_polling_interval = 60 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backup_api_class = cinder.backup.api.API {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backup_name_template = backup-%s {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backup_use_same_host = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backup_use_temp_snapshot = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] chap_password = **** {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] chap_username = {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] cinder_internal_tenant_project_id = cd8ff3f79b5f49c4a68ef30b64f69737 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] cinder_internal_tenant_user_id = 317504bf27094587885bb5d9eb69337f {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] cluster = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] compression_format = gzip {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] compute_api_class = cinder.compute.nova.API {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] config_dir = [] {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] config_source = [] {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] control_exchange = openstack {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] debug = True {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] default_availability_zone = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] default_group_type = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] default_volume_type = QuobyteHD {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] disk_geometry = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] driver_client_cert = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] driver_client_cert_key = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] driver_data_namespace = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] driver_ssl_cert_path = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] driver_ssl_cert_verify = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] driver_use_ssl = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] enable_new_services = True {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] enable_unsupported_driver = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] enabled_backends = ['QuobyteHD'] {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] enforce_multipath_for_image_xfer = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] filter_function = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] glance_api_insecure = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] glance_api_servers = ['http://192.168.122.187/image'] {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] glance_api_ssl_compression = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] glance_ca_certificates_file = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] glance_catalog_info = image:glance:publicURL {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] glance_certfile = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] glance_keyfile = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] glance_num_retries = 3 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] glance_request_timeout = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] goodness_function = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] graceful_shutdown_timeout = 5 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] group_api_class = cinder.group.api.API {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] host = devstack {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] image_compress_on_upload = True {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] image_conversion_address_space_limit = 1 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] image_conversion_cpu_limit = 60 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] image_conversion_disable = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] image_upload_use_cinder_backend = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] image_upload_use_internal_tenant = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] image_volume_cache_enabled = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] image_volume_cache_max_count = 0 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] image_volume_cache_max_size_gb = 0 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] init_host_max_objects_retrieval = 0 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] instance_format = [instance: %(uuid)s] {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] iscsi_target_flags = {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] iscsi_write_cache = on {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] iser_helper = tgtadm {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] iser_ip_address = 192.168.122.187 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] iser_port = 3260 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] log_color = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] log_config_append = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] log_dir = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] log_file = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] log_options = True {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] log_rotate_interval = 1 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] log_rotate_interval_type = days {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] log_rotation_type = none {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] max_age = 0 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] max_logfile_count = 30 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] max_logfile_size_mb = 200 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] max_over_subscription_ratio = 20.0 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-b8be9604-0f93-4970-a32d-459cc299e465 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] message_reap_interval = 86400 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-b8be9604-0f93-4970-a32d-459cc299e465 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86873) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] message_ttl = 2592000 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] migration_create_volume_timeout_secs = 300 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] monkey_patch = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] monkey_patch_modules = [] {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] my_ip = 192.168.122.187 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] no_snapshot_gb_quota = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] num_iser_scan_tries = 3 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] num_shell_tries = 3 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] num_volume_device_scan_tries = 3 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] nvmeof_conn_info_version = 1 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] nvmet_ns_id = 10 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] nvmet_port_id = 1 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] osapi_max_limit = 1000 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] osapi_volume_ext_list = [] {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] osapi_volume_listen_port = 8776 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] osapi_volume_use_ssl = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] osapi_volume_workers = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] per_volume_size_limit = -1 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] periodic_fuzzy_delay = 60 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] periodic_interval = 60 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] public_endpoint = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] publish_errors = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] quota_backup_gigabytes = 1000 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] quota_backups = 10 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] quota_gigabytes = 1000 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] quota_groups = 10 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] quota_snapshots = 10 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] quota_volumes = 10 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] rate_limit_burst = 0 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] rate_limit_except_level = CRITICAL {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] rate_limit_interval = 0 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] reinit_driver_count = 3 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] replication_device = **** {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] report_discard_supported = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] report_interval = 120 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] reservation_clean_interval = 86400 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] reservation_expire = 86400 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] reserved_image_namespaces = [] {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] reserved_percentage = 0 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] rpc_response_timeout = 120 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] run_external_periodic_tasks = True {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] scst_target_driver = iscsi {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] scst_target_iqn_name = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] service_down_time = 720 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] shell_completion = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] snapshot_name_template = snapshot-%s {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] split_loggers = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] state_path = /opt/stack/data/cinder {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] storage_availability_zone = nova {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] storage_protocol = iSCSI {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] syslog_log_facility = LOG_USER {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] target_helper = lioadm {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] target_ip_address = 192.168.122.187 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] target_port = 3260 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] target_protocol = iscsi {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] target_secondary_ip_addresses = [] {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] trace_flags = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] transport_url = **** {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] until_refresh = 0 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] use_chap_auth = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] use_default_quota_class = True {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] use_journal = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] use_json = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] use_multipath_for_image_xfer = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] use_stderr = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] use_syslog = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] verify_glance_signatures = enabled {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] volume_api_class = cinder.volume.api.API {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] volume_backend_name = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] volume_clear = zero {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] volume_clear_ionice = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] volume_clear_size = 0 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] volume_copy_bps_limit = 0 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] volume_dd_blocksize = 1M {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] volume_name_template = volume-%s {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] volume_service_inithost_offload = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] volume_usage_audit_period = month {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] zoning_mode = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_concurrency.disable_process_locking = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] keystone_authtoken.auth_section = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] keystone_authtoken.auth_type = password {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] keystone_authtoken.auth_version = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] keystone_authtoken.cache = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] keystone_authtoken.certfile = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] keystone_authtoken.include_service_catalog = True {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] keystone_authtoken.insecure = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] keystone_authtoken.interface = public {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] keystone_authtoken.keyfile = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] keystone_authtoken.memcache_password = {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] keystone_authtoken.memcache_username = {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] keystone_authtoken.region_name = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] keystone_authtoken.service_type = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.187/identity {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] cache.backend = dogpile.cache.null {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] cache.backend_argument = **** {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] cache.backend_expiration_time = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] cache.config_prefix = cache.oslo {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] cache.debug_cache_backend = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] cache.enable_retry_client = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] cache.enable_socket_keepalive = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] cache.enabled = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] cache.expiration_time = 600 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] cache.hashclient_retry_attempts = 2 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] cache.memcache_dead_retry = 300 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] cache.memcache_pool_maxsize = 10 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] cache.memcache_sasl_enabled = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] cache.password = **** {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] cache.proxies = [] {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] cache.redis_db = 0 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] cache.redis_server = localhost:6379 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] cache.retry_attempts = 2 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] cache.retry_delay = 0.0 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] cache.socket_keepalive_count = 1 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] cache.socket_keepalive_idle = 1 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] cache.socket_keepalive_interval = 1 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] cache.socket_timeout = 1.0 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] cache.tls_allowed_ciphers = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b8be9604-0f93-4970-a32d-459cc299e465 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86873) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 08 18:30:46 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.quobyte [None req-b8be9604-0f93-4970-a32d-459cc299e465 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 08 18:30:46 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.quobyte [None req-b8be9604-0f93-4970-a32d-459cc299e465 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] cache.tls_cafile = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] cache.tls_certfile = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] cache.tls_enabled = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] cache.tls_keyfile = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] cache.username = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] coordination.backend_url = **** {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] database.asyncio_connection = **** {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b8be9604-0f93-4970-a32d-459cc299e465 None None] Running cmd (subprocess): mount.quobyte {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] database.asyncio_slave_connection = **** {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] database.backend = sqlalchemy {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] database.connection = **** {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] database.connection_debug = 0 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] database.connection_parameters = {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] database.connection_recycle_time = 3600 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] database.connection_trace = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] database.db_inc_retry_interval = True {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] database.db_max_retries = 20 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] database.db_max_retry_interval = 10 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] database.db_retry_interval = 1 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] database.max_overflow = 50 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] database.max_pool_size = 5 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] database.max_retries = 10 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] database.mysql_wsrep_sync_wait = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] database.pool_timeout = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] database.retry_interval = 10 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] database.slave_connection = **** {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] database.sqlite_synchronous = True {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] database.synchronous_reader = True {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] database.use_db_reconnect = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] profiler.connection_string = messaging:// {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] profiler.enabled = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] profiler.es_doc_type = notification {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] profiler.es_scroll_size = 10000 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] profiler.es_scroll_time = 2m {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] profiler.filter_error_trace = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] profiler.hmac_keys = **** {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] profiler.sentinel_service_name = mymaster {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] profiler.socket_timeout = 0.1 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] profiler.trace_requests = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] profiler.trace_sqlalchemy = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] profiler_jaeger.process_tags = {} {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] profiler_jaeger.service_name_prefix = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] profiler_otlp.service_name_prefix = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_policy.enforce_new_defaults = True {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_policy.enforce_scope = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_policy.policy_default_rule = default {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_policy.policy_file = policy.yaml {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] privsep_osbrick.group = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] privsep_osbrick.helper_command = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] privsep_osbrick.user = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] cinder_sys_admin.group = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] cinder_sys_admin.helper_command = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] cinder_sys_admin.user = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] service_user.auth_section = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] service_user.auth_type = password {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] service_user.cafile = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] service_user.certfile = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] service_user.collect_timing = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] service_user.insecure = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] service_user.keyfile = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] service_user.send_service_user_token = True {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] service_user.split_loggers = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] service_user.timeout = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] glance.auth_section = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] glance.auth_type = password {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] glance.certfile = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] glance.collect_timing = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] glance.insecure = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] glance.keyfile = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] glance.region_name = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] glance.split_loggers = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] glance.timeout = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.backend_availability_zone = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.chap_password = **** {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.chap_username = {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.disk_geometry = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.driver_client_cert = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.driver_client_cert_key = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.driver_data_namespace = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.driver_use_ssl = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.extra_capabilities = {} {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.filter_function = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.goodness_function = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.iscsi_target_flags = {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.iscsi_write_cache = on {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.iser_helper = tgtadm {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.iser_ip_address = 192.168.122.187 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.iser_port = 3260 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.nas_host = {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.nas_login = admin {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.nas_mount_options = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.nas_password = **** {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.nas_private_key = {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.nas_share_path = {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.num_shell_tries = 3 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.quobyte_volume_url = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.replication_device = **** {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.report_discard_supported = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.reserved_percentage = 0 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.target_helper = tgtadm {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.target_ip_address = 192.168.122.187 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.target_port = 3260 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.target_protocol = iscsi {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.trace_flags = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.unique_fqdn_network = True {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.use_chap_auth = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.volume_backend_name = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.volume_clear = zero {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.volume_clear_ionice = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.volume_clear_size = 0 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_reports.file_event_handler = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_reports.log_dir = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.backend_availability_zone = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.backend_host = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.chap_password = **** {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.chap_username = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.chiscsi_conf = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.disk_geometry = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.driver_client_cert = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack quobyte-client[86874]: Reading configuration file: /etc/quobyte/client.cfg Jul 08 18:30:46 devstack quobyte-client[86874]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.driver_data_namespace = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.driver_use_ssl = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.extra_capabilities = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.filter_function = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.goodness_function = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.iser_helper = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.iser_ip_address = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.iser_port = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.iser_target_prefix = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.nas_host = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.nas_login = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.nas_mount_options = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.nas_password = **** {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.nas_private_key = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.nas_share_path = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.nas_ssh_port = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.num_shell_tries = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.nvmet_port_id = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b8be9604-0f93-4970-a32d-459cc299e465 None None] CMD "mount.quobyte" returned: 1 in 0.083s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:30:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b8be9604-0f93-4970-a32d-459cc299e465 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:30:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b8be9604-0f93-4970-a32d-459cc299e465 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:30:46 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b8be9604-0f93-4970-a32d-459cc299e465 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.replication_device = **** {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.report_discard_supported = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.reserved_percentage = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.scst_target_driver = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.storage_protocol = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.target_helper = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.target_ip_address = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.target_port = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.target_prefix = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.target_protocol = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.trace_flags = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b8be9604-0f93-4970-a32d-459cc299e465 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:30:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b8be9604-0f93-4970-a32d-459cc299e465 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:30:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b8be9604-0f93-4970-a32d-459cc299e465 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.use_chap_auth = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.volume_clear = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.volume_clear_size = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] QuobyteHD.volumes_dir = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_messaging_rabbit.ssl = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_messaging_notifications.driver = [] {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_messaging_notifications.retry = -1 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] key_manager.fixed_key = **** {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] barbican.barbican_api_version = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] barbican.barbican_endpoint = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] barbican.barbican_endpoint_type = public {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] barbican.barbican_region_name = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] barbican.cafile = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] barbican.certfile = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] barbican.collect_timing = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] barbican.insecure = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] barbican.keyfile = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] barbican.number_of_retries = 60 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] barbican.retry_delay = 1 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] barbican.send_service_user_token = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] barbican.split_loggers = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] barbican.timeout = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] barbican.verify_ssl = True {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] barbican.verify_ssl_path = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] barbican_service_user.auth_section = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] barbican_service_user.auth_type = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] barbican_service_user.cafile = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] barbican_service_user.certfile = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] barbican_service_user.collect_timing = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack sudo[86886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] barbican_service_user.insecure = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] barbican_service_user.keyfile = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] barbican_service_user.split_loggers = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] barbican_service_user.timeout = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack sudo[86886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] vault.approle_role_id = **** {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] vault.approle_secret_id = **** {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] vault.kv_mountpoint = secret {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] vault.kv_path = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] vault.kv_version = 2 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] vault.namespace = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] vault.root_token_id = **** {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] vault.ssl_ca_crt_file = None {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] vault.timeout = 60.0 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] vault.use_ssl = False {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:30:46 devstack cinder-volume[86586]: DEBUG oslo_service.backend._eventlet.service [None req-8b6e3e49-c5e8-4f0d-8b57-053bea2b8ec7 None None] ******************************************************************************** {{(pid=86586) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 08 18:30:47 devstack sudo[86886]: pam_unix(sudo:session): session closed for user root Jul 08 18:30:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b8be9604-0f93-4970-a32d-459cc299e465 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.651s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:30:47 devstack cinder-volume[86873]: INFO cinder.volume.driver [None req-b8be9604-0f93-4970-a32d-459cc299e465 None None] Driver hasn't implemented _init_vendor_properties() Jul 08 18:30:47 devstack cinder-volume[86873]: DEBUG cinder.volume.driver [None req-b8be9604-0f93-4970-a32d-459cc299e465 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.667579650879, 'free_capacity_gb': 1775.667579650879, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86873) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 08 18:30:47 devstack cinder-volume[86873]: DEBUG oslo_db.sqlalchemy.engines [None req-b8be9604-0f93-4970-a32d-459cc299e465 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86873) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 18:30:47 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writer thread running {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 18:30:47 devstack cinder-volume[86873]: DEBUG cinder.db.api [None req-b8be9604-0f93-4970-a32d-459cc299e465 None None] Building query based on filter {{(pid=86873) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 08 18:30:47 devstack cinder-volume[86873]: DEBUG cinder.image.image_utils [None req-b8be9604-0f93-4970-a32d-459cc299e465 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86873) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 08 18:30:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b8be9604-0f93-4970-a32d-459cc299e465 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:30:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b8be9604-0f93-4970-a32d-459cc299e465 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:30:47 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b8be9604-0f93-4970-a32d-459cc299e465 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:30:47 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b8be9604-0f93-4970-a32d-459cc299e465 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:30:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b8be9604-0f93-4970-a32d-459cc299e465 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:30:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b8be9604-0f93-4970-a32d-459cc299e465 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:30:47 devstack cinder-volume[86873]: INFO cinder.keymgr.migration [None req-b7e546d4-4549-403c-b373-b856bc7a1c91 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 08 18:30:47 devstack sudo[86931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:30:47 devstack sudo[86931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:30:48 devstack sudo[86931]: pam_unix(sudo:session): session closed for user root Jul 08 18:30:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b8be9604-0f93-4970-a32d-459cc299e465 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.638s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:30:48 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-b8be9604-0f93-4970-a32d-459cc299e465 None None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:30:48 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-b8be9604-0f93-4970-a32d-459cc299e465 None None] Driver initialization completed successfully. Jul 08 18:30:48 devstack cinder-volume[86873]: INFO cinder.manager [None req-b8be9604-0f93-4970-a32d-459cc299e465 None None] Initiating service 3 cleanup Jul 08 18:30:48 devstack cinder-volume[86873]: INFO cinder.manager [None req-b8be9604-0f93-4970-a32d-459cc299e465 None None] Service 3 cleanup completed. Jul 08 18:30:48 devstack cinder-volume[86873]: DEBUG cinder.service [None req-b8be9604-0f93-4970-a32d-459cc299e465 None None] Creating RPC server for service cinder-volume {{(pid=86873) start /opt/stack/cinder/cinder/service.py:231}} Jul 08 18:30:48 devstack cinder-volume[86873]: DEBUG cinder.service [None req-b8be9604-0f93-4970-a32d-459cc299e465 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86873) start /opt/stack/cinder/cinder/service.py:237}} Jul 08 18:30:48 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-b8be9604-0f93-4970-a32d-459cc299e465 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 08 18:30:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b8be9604-0f93-4970-a32d-459cc299e465 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:30:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b8be9604-0f93-4970-a32d-459cc299e465 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:30:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b8be9604-0f93-4970-a32d-459cc299e465 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:30:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b8be9604-0f93-4970-a32d-459cc299e465 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:30:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b8be9604-0f93-4970-a32d-459cc299e465 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:30:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b8be9604-0f93-4970-a32d-459cc299e465 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:30:48 devstack sudo[86952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:30:48 devstack sudo[86952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:30:49 devstack sudo[86952]: pam_unix(sudo:session): session closed for user root Jul 08 18:30:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b8be9604-0f93-4970-a32d-459cc299e465 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.663s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:30:49 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-b8be9604-0f93-4970-a32d-459cc299e465 None None] Driver post RPC initialization completed successfully. Jul 08 18:30:56 devstack cinder-volume[86586]: DEBUG dbcounter [-] [86586] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:30:58 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:SELECT=2 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:30:59 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:31:45 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [req-b365d1fd-23f6-43ce-9034-aeedbdc0cb22 req-8ceb5218-268a-4aeb-a8c3-c05d65bb9455 tempest-VolumesSnapshotsTestJSON-1763526223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:31:45 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-b365d1fd-23f6-43ce-9034-aeedbdc0cb22 req-8ceb5218-268a-4aeb-a8c3-c05d65bb9455 tempest-VolumesSnapshotsTestJSON-1763526223 None] Flow 'volume_create_manager' (968b7e85-979b-4bb6-bfa2-392bae346c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:31:45 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-b365d1fd-23f6-43ce-9034-aeedbdc0cb22 req-8ceb5218-268a-4aeb-a8c3-c05d65bb9455 tempest-VolumesSnapshotsTestJSON-1763526223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32cf7251-b3ac-4470-a645-5dd0d54882dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:31:45 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-b365d1fd-23f6-43ce-9034-aeedbdc0cb22 req-8ceb5218-268a-4aeb-a8c3-c05d65bb9455 tempest-VolumesSnapshotsTestJSON-1763526223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32cf7251-b3ac-4470-a645-5dd0d54882dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:30:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-487853198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ee1707d-6e9c-4cf7-8122-78eb60da4e5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c174a9f6889458b9dffd512b8149dab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:31:45Z,use_quota=True,user_id='5e01d3d226174213894edfd925d7396e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:31:45 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-b365d1fd-23f6-43ce-9034-aeedbdc0cb22 req-8ceb5218-268a-4aeb-a8c3-c05d65bb9455 tempest-VolumesSnapshotsTestJSON-1763526223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bcb518f-f0e1-4ac7-99f6-00020db6e5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:31:45 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-b365d1fd-23f6-43ce-9034-aeedbdc0cb22 req-8ceb5218-268a-4aeb-a8c3-c05d65bb9455 tempest-VolumesSnapshotsTestJSON-1763526223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bcb518f-f0e1-4ac7-99f6-00020db6e5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:31:45 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-b365d1fd-23f6-43ce-9034-aeedbdc0cb22 req-8ceb5218-268a-4aeb-a8c3-c05d65bb9455 tempest-VolumesSnapshotsTestJSON-1763526223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f61e97c5-e3c2-4184-8fa1-6a0d25830e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:31:45 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-b365d1fd-23f6-43ce-9034-aeedbdc0cb22 req-8ceb5218-268a-4aeb-a8c3-c05d65bb9455 tempest-VolumesSnapshotsTestJSON-1763526223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f61e97c5-e3c2-4184-8fa1-6a0d25830e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ee1707d-6e9c-4cf7-8122-78eb60da4e5b', 'volume_name': 'volume-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:31:45 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-b365d1fd-23f6-43ce-9034-aeedbdc0cb22 req-8ceb5218-268a-4aeb-a8c3-c05d65bb9455 tempest-VolumesSnapshotsTestJSON-1763526223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9ff4873-d20f-4b62-84ab-a68210943cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:31:45 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-b365d1fd-23f6-43ce-9034-aeedbdc0cb22 req-8ceb5218-268a-4aeb-a8c3-c05d65bb9455 tempest-VolumesSnapshotsTestJSON-1763526223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9ff4873-d20f-4b62-84ab-a68210943cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:31:45 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-b365d1fd-23f6-43ce-9034-aeedbdc0cb22 req-8ceb5218-268a-4aeb-a8c3-c05d65bb9455 tempest-VolumesSnapshotsTestJSON-1763526223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9efcef78-dcd6-4326-8cb6-fecd400a4b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:31:45 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [req-b365d1fd-23f6-43ce-9034-aeedbdc0cb22 req-8ceb5218-268a-4aeb-a8c3-c05d65bb9455 tempest-VolumesSnapshotsTestJSON-1763526223 None] Volume 6ee1707d-6e9c-4cf7-8122-78eb60da4e5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b', 'volume_size': 1} Jul 08 18:31:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-b365d1fd-23f6-43ce-9034-aeedbdc0cb22 req-8ceb5218-268a-4aeb-a8c3-c05d65bb9455 tempest-VolumesSnapshotsTestJSON-1763526223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:31:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-b365d1fd-23f6-43ce-9034-aeedbdc0cb22 req-8ceb5218-268a-4aeb-a8c3-c05d65bb9455 tempest-VolumesSnapshotsTestJSON-1763526223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:31:45 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [req-b365d1fd-23f6-43ce-9034-aeedbdc0cb22 req-8ceb5218-268a-4aeb-a8c3-c05d65bb9455 tempest-VolumesSnapshotsTestJSON-1763526223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:30:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-487853198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ee1707d-6e9c-4cf7-8122-78eb60da4e5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c174a9f6889458b9dffd512b8149dab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:31:45Z,use_quota=True,user_id='5e01d3d226174213894edfd925d7396e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:31:45 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [req-b365d1fd-23f6-43ce-9034-aeedbdc0cb22 req-8ceb5218-268a-4aeb-a8c3-c05d65bb9455 tempest-VolumesSnapshotsTestJSON-1763526223 None] Creating volume 6ee1707d-6e9c-4cf7-8122-78eb60da4e5b {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:31:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-b365d1fd-23f6-43ce-9034-aeedbdc0cb22 req-8ceb5218-268a-4aeb-a8c3-c05d65bb9455 tempest-VolumesSnapshotsTestJSON-1763526223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:31:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-b365d1fd-23f6-43ce-9034-aeedbdc0cb22 req-8ceb5218-268a-4aeb-a8c3-c05d65bb9455 tempest-VolumesSnapshotsTestJSON-1763526223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:31:45 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [req-b365d1fd-23f6-43ce-9034-aeedbdc0cb22 req-8ceb5218-268a-4aeb-a8c3-c05d65bb9455 tempest-VolumesSnapshotsTestJSON-1763526223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:31:45 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [req-b365d1fd-23f6-43ce-9034-aeedbdc0cb22 req-8ceb5218-268a-4aeb-a8c3-c05d65bb9455 tempest-VolumesSnapshotsTestJSON-1763526223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:31:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-b365d1fd-23f6-43ce-9034-aeedbdc0cb22 req-8ceb5218-268a-4aeb-a8c3-c05d65bb9455 tempest-VolumesSnapshotsTestJSON-1763526223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:31:45 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [req-b365d1fd-23f6-43ce-9034-aeedbdc0cb22 req-8ceb5218-268a-4aeb-a8c3-c05d65bb9455 tempest-VolumesSnapshotsTestJSON-1763526223 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:31:45 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [req-b365d1fd-23f6-43ce-9034-aeedbdc0cb22 req-8ceb5218-268a-4aeb-a8c3-c05d65bb9455 tempest-VolumesSnapshotsTestJSON-1763526223 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:31:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-b365d1fd-23f6-43ce-9034-aeedbdc0cb22 req-8ceb5218-268a-4aeb-a8c3-c05d65bb9455 tempest-VolumesSnapshotsTestJSON-1763526223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:45 devstack sudo[87248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b 1073741824 Jul 08 18:31:45 devstack sudo[87248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:46 devstack sudo[87248]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-b365d1fd-23f6-43ce-9034-aeedbdc0cb22 req-8ceb5218-268a-4aeb-a8c3-c05d65bb9455 tempest-VolumesSnapshotsTestJSON-1763526223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b 1073741824" returned: 0 in 1.213s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-b365d1fd-23f6-43ce-9034-aeedbdc0cb22 req-8ceb5218-268a-4aeb-a8c3-c05d65bb9455 tempest-VolumesSnapshotsTestJSON-1763526223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:47 devstack sudo[87578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b Jul 08 18:31:47 devstack sudo[87578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:47 devstack sudo[87578]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-b365d1fd-23f6-43ce-9034-aeedbdc0cb22 req-8ceb5218-268a-4aeb-a8c3-c05d65bb9455 tempest-VolumesSnapshotsTestJSON-1763526223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b" returned: 0 in 0.867s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:47 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [req-b365d1fd-23f6-43ce-9034-aeedbdc0cb22 req-8ceb5218-268a-4aeb-a8c3-c05d65bb9455 tempest-VolumesSnapshotsTestJSON-1763526223 None] <== create_volume: return (2161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:31:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-b365d1fd-23f6-43ce-9034-aeedbdc0cb22 req-8ceb5218-268a-4aeb-a8c3-c05d65bb9455 tempest-VolumesSnapshotsTestJSON-1763526223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.165s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:31:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-b365d1fd-23f6-43ce-9034-aeedbdc0cb22 req-8ceb5218-268a-4aeb-a8c3-c05d65bb9455 tempest-VolumesSnapshotsTestJSON-1763526223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9efcef78-dcd6-4326-8cb6-fecd400a4b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:31:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-b365d1fd-23f6-43ce-9034-aeedbdc0cb22 req-8ceb5218-268a-4aeb-a8c3-c05d65bb9455 tempest-VolumesSnapshotsTestJSON-1763526223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5caf12b6-8bb3-4071-8dbd-bb7ab9ea23cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:31:47 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [req-b365d1fd-23f6-43ce-9034-aeedbdc0cb22 req-8ceb5218-268a-4aeb-a8c3-c05d65bb9455 tempest-VolumesSnapshotsTestJSON-1763526223 None] Volume volume-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b (6ee1707d-6e9c-4cf7-8122-78eb60da4e5b): created successfully Jul 08 18:31:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-b365d1fd-23f6-43ce-9034-aeedbdc0cb22 req-8ceb5218-268a-4aeb-a8c3-c05d65bb9455 tempest-VolumesSnapshotsTestJSON-1763526223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5caf12b6-8bb3-4071-8dbd-bb7ab9ea23cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:31:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-b365d1fd-23f6-43ce-9034-aeedbdc0cb22 req-8ceb5218-268a-4aeb-a8c3-c05d65bb9455 tempest-VolumesSnapshotsTestJSON-1763526223 None] Flow 'volume_create_manager' (968b7e85-979b-4bb6-bfa2-392bae346c4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:31:47 devstack cinder-volume[86873]: INFO cinder.volume.manager [req-b365d1fd-23f6-43ce-9034-aeedbdc0cb22 req-8ceb5218-268a-4aeb-a8c3-c05d65bb9455 tempest-VolumesSnapshotsTestJSON-1763526223 None] Created volume successfully. Jul 08 18:31:48 devstack cinder-volume[86873]: DEBUG oslo_service.periodic_task [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86873) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:31:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:31:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:31:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:31:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:31:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:31:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:48 devstack sudo[87595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:31:48 devstack sudo[87595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.959s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:49 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:31:49 devstack sudo[87595]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:49 devstack cinder-volume[86873]: DEBUG oslo_service.periodic_task [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running periodic task VolumeManager._thread_info {{(pid=86873) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:31:49 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] thread count: 6 {{(pid=86873) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:31:49 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] thread info: [<_MainThread(MainThread, started 138577734545536)>, , , , , ] {{(pid=86873) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:31:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-49089382-a362-4798-b1ab-f5f2ad87fcf9 req-cb671bd3-9f7e-418e-8103-b40ac24e94fd tempest-VolumesSnapshotsTestJSON-1763526223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:31:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-49089382-a362-4798-b1ab-f5f2ad87fcf9 req-cb671bd3-9f7e-418e-8103-b40ac24e94fd tempest-VolumesSnapshotsTestJSON-1763526223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:31:49 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [req-49089382-a362-4798-b1ab-f5f2ad87fcf9 req-cb671bd3-9f7e-418e-8103-b40ac24e94fd tempest-VolumesSnapshotsTestJSON-1763526223 None] Creating offline snapshot cd898d61-d51d-45bd-8392-61bdde9d734a of volume 6ee1707d-6e9c-4cf7-8122-78eb60da4e5b {{(pid=86873) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:31:49 devstack cinder-volume[86873]: INFO oslo.privsep.daemon [req-49089382-a362-4798-b1ab-f5f2ad87fcf9 req-cb671bd3-9f7e-418e-8103-b40ac24e94fd tempest-VolumesSnapshotsTestJSON-1763526223 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpb3z8s4bs/privsep.sock'] Jul 08 18:31:49 devstack sudo[87605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpb3z8s4bs/privsep.sock Jul 08 18:31:49 devstack sudo[87605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:49 devstack cinder-volume[86873]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 08 18:31:49 devstack cinder-volume[86873]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 18:31:49 devstack cinder-volume[86873]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 08 18:31:49 devstack cinder-volume[86873]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 18:31:49 devstack cinder-volume[86873]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 08 18:31:49 devstack cinder-volume[86873]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 08 18:31:50 devstack cinder-volume[86873]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 18:31:50 devstack cinder-volume[86873]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 18:31:50 devstack cinder-volume[86873]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 08 18:31:51 devstack cinder-volume[86873]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 08 18:31:51 devstack cinder-volume[86873]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 18:31:51 devstack cinder-volume[86873]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 08 18:31:51 devstack cinder-volume[86873]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 18:31:51 devstack cinder-volume[86873]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 08 18:31:51 devstack cinder-volume[86873]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 08 18:31:51 devstack cinder-volume[86873]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 18:31:51 devstack cinder-volume[86873]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 18:31:51 devstack cinder-volume[86873]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 08 18:31:51 devstack sudo[87605]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:51 devstack cinder-volume[86873]: INFO oslo.privsep.daemon [req-49089382-a362-4798-b1ab-f5f2ad87fcf9 req-cb671bd3-9f7e-418e-8103-b40ac24e94fd tempest-VolumesSnapshotsTestJSON-1763526223 None] Spawned new privsep daemon via rootwrap Jul 08 18:31:51 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [req-49089382-a362-4798-b1ab-f5f2ad87fcf9 req-cb671bd3-9f7e-418e-8103-b40ac24e94fd tempest-VolumesSnapshotsTestJSON-1763526223 None] Accepted privsep connection to /tmp/tmpb3z8s4bs/privsep.sock {{(pid=86873) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 08 18:31:51 devstack cinder-volume[86873]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 08 18:31:51 devstack cinder-volume[86873]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 08 18:31:51 devstack cinder-volume[86873]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 08 18:31:51 devstack cinder-volume[86873]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87654 Jul 08 18:31:51 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[a480421d-c57c-4504-a849-646d610ddad9]: (2,) {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:31:51 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aefd9c4-5682-434e-ad62-28ae27e02659]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:31:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-49089382-a362-4798-b1ab-f5f2ad87fcf9 req-cb671bd3-9f7e-418e-8103-b40ac24e94fd tempest-VolumesSnapshotsTestJSON-1763526223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:51 devstack sudo[87662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b Jul 08 18:31:51 devstack sudo[87662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:53 devstack sudo[87662]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:53 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-49089382-a362-4798-b1ab-f5f2ad87fcf9 req-cb671bd3-9f7e-418e-8103-b40ac24e94fd tempest-VolumesSnapshotsTestJSON-1763526223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b" returned: 0 in 1.255s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:53 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-49089382-a362-4798-b1ab-f5f2ad87fcf9 req-cb671bd3-9f7e-418e-8103-b40ac24e94fd tempest-VolumesSnapshotsTestJSON-1763526223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b.cd898d61-d51d-45bd-8392-61bdde9d734a 1G {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:53 devstack sudo[87691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b.cd898d61-d51d-45bd-8392-61bdde9d734a 1G Jul 08 18:31:53 devstack sudo[87691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:54 devstack sudo[87691]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-49089382-a362-4798-b1ab-f5f2ad87fcf9 req-cb671bd3-9f7e-418e-8103-b40ac24e94fd tempest-VolumesSnapshotsTestJSON-1763526223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b.cd898d61-d51d-45bd-8392-61bdde9d734a 1G" returned: 0 in 1.375s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-49089382-a362-4798-b1ab-f5f2ad87fcf9 req-cb671bd3-9f7e-418e-8103-b40ac24e94fd tempest-VolumesSnapshotsTestJSON-1763526223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b.cd898d61-d51d-45bd-8392-61bdde9d734a {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:54 devstack sudo[87737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b.cd898d61-d51d-45bd-8392-61bdde9d734a Jul 08 18:31:54 devstack sudo[87737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:55 devstack sudo[87737]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-49089382-a362-4798-b1ab-f5f2ad87fcf9 req-cb671bd3-9f7e-418e-8103-b40ac24e94fd tempest-VolumesSnapshotsTestJSON-1763526223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b.cd898d61-d51d-45bd-8392-61bdde9d734a" returned: 0 in 1.072s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:55 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [req-49089382-a362-4798-b1ab-f5f2ad87fcf9 req-cb671bd3-9f7e-418e-8103-b40ac24e94fd tempest-VolumesSnapshotsTestJSON-1763526223 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b.cd898d61-d51d-45bd-8392-61bdde9d734a is being set with open permissions: ugo+rw Jul 08 18:31:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-49089382-a362-4798-b1ab-f5f2ad87fcf9 req-cb671bd3-9f7e-418e-8103-b40ac24e94fd tempest-VolumesSnapshotsTestJSON-1763526223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b.cd898d61-d51d-45bd-8392-61bdde9d734a {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:55 devstack sudo[87748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b.cd898d61-d51d-45bd-8392-61bdde9d734a Jul 08 18:31:55 devstack sudo[87748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:56 devstack sudo[87748]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-49089382-a362-4798-b1ab-f5f2ad87fcf9 req-cb671bd3-9f7e-418e-8103-b40ac24e94fd tempest-VolumesSnapshotsTestJSON-1763526223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b.cd898d61-d51d-45bd-8392-61bdde9d734a" returned: 0 in 0.953s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-49089382-a362-4798-b1ab-f5f2ad87fcf9 req-cb671bd3-9f7e-418e-8103-b40ac24e94fd tempest-VolumesSnapshotsTestJSON-1763526223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:56 devstack sudo[87763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b.info Jul 08 18:31:56 devstack sudo[87763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:58 devstack sudo[87763]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-49089382-a362-4798-b1ab-f5f2ad87fcf9 req-cb671bd3-9f7e-418e-8103-b40ac24e94fd tempest-VolumesSnapshotsTestJSON-1763526223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b.info" returned: 0 in 1.590s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:58 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [req-49089382-a362-4798-b1ab-f5f2ad87fcf9 req-cb671bd3-9f7e-418e-8103-b40ac24e94fd tempest-VolumesSnapshotsTestJSON-1763526223 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b.info is being set with open permissions: ugo+rw Jul 08 18:31:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-49089382-a362-4798-b1ab-f5f2ad87fcf9 req-cb671bd3-9f7e-418e-8103-b40ac24e94fd tempest-VolumesSnapshotsTestJSON-1763526223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:58 devstack sudo[87774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b.info Jul 08 18:31:58 devstack sudo[87774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:59 devstack sudo[87774]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-49089382-a362-4798-b1ab-f5f2ad87fcf9 req-cb671bd3-9f7e-418e-8103-b40ac24e94fd tempest-VolumesSnapshotsTestJSON-1763526223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b.info" returned: 0 in 1.092s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-49089382-a362-4798-b1ab-f5f2ad87fcf9 req-cb671bd3-9f7e-418e-8103-b40ac24e94fd tempest-VolumesSnapshotsTestJSON-1763526223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 9.997s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:31:59 devstack cinder-volume[86873]: INFO cinder.volume.manager [req-49089382-a362-4798-b1ab-f5f2ad87fcf9 req-cb671bd3-9f7e-418e-8103-b40ac24e94fd tempest-VolumesSnapshotsTestJSON-1763526223 None] Create snapshot completed successfully Jul 08 18:32:00 devstack cinder-volume[86873]: DEBUG cinder.coordination [req-19d81d02-cb23-43b6-a190-bc9d3f35ade9 req-e6730078-c5c4-4cc0-b26f-c5de89bf913e tempest-VolumesSnapshotsTestJSON-1763526223 None] Acquiring lock "cinder-cd898d61-d51d-45bd-8392-61bdde9d734a-delete_snapshot" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:32:00 devstack cinder-volume[86873]: DEBUG cinder.coordination [req-19d81d02-cb23-43b6-a190-bc9d3f35ade9 req-e6730078-c5c4-4cc0-b26f-c5de89bf913e tempest-VolumesSnapshotsTestJSON-1763526223 None] Lock "cinder-cd898d61-d51d-45bd-8392-61bdde9d734a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.080s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:32:00 devstack cinder-volume[86873]: DEBUG cinder.coordination [req-19d81d02-cb23-43b6-a190-bc9d3f35ade9 req-e6730078-c5c4-4cc0-b26f-c5de89bf913e tempest-VolumesSnapshotsTestJSON-1763526223 None] Acquiring lock "cinder-quobyte-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:32:00 devstack cinder-volume[86873]: DEBUG cinder.coordination [req-19d81d02-cb23-43b6-a190-bc9d3f35ade9 req-e6730078-c5c4-4cc0-b26f-c5de89bf913e tempest-VolumesSnapshotsTestJSON-1763526223 None] Lock "cinder-quobyte-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:32:00 devstack cinder-volume[86873]: DEBUG cinder.coordination [req-19d81d02-cb23-43b6-a190-bc9d3f35ade9 req-e6730078-c5c4-4cc0-b26f-c5de89bf913e tempest-VolumesSnapshotsTestJSON-1763526223 None] Acquiring lock "cinder-quobyte-cd898d61-d51d-45bd-8392-61bdde9d734a" by "_delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:32:00 devstack cinder-volume[86873]: DEBUG cinder.coordination [req-19d81d02-cb23-43b6-a190-bc9d3f35ade9 req-e6730078-c5c4-4cc0-b26f-c5de89bf913e tempest-VolumesSnapshotsTestJSON-1763526223 None] Lock "cinder-quobyte-cd898d61-d51d-45bd-8392-61bdde9d734a" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:32:00 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [req-19d81d02-cb23-43b6-a190-bc9d3f35ade9 req-e6730078-c5c4-4cc0-b26f-c5de89bf913e tempest-VolumesSnapshotsTestJSON-1763526223 None] Deleting offline snapshot cd898d61-d51d-45bd-8392-61bdde9d734a of volume 6ee1707d-6e9c-4cf7-8122-78eb60da4e5b {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:32:00 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [req-19d81d02-cb23-43b6-a190-bc9d3f35ade9 req-e6730078-c5c4-4cc0-b26f-c5de89bf913e tempest-VolumesSnapshotsTestJSON-1763526223 None] snapshot_file for this snap is: volume-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b.cd898d61-d51d-45bd-8392-61bdde9d734a {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:32:00 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cbb53a5-aaa0-47be-a446-7984a47f1200]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:32:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-19d81d02-cb23-43b6-a190-bc9d3f35ade9 req-e6730078-c5c4-4cc0-b26f-c5de89bf913e tempest-VolumesSnapshotsTestJSON-1763526223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b.cd898d61-d51d-45bd-8392-61bdde9d734a {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:00 devstack sudo[87819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b.cd898d61-d51d-45bd-8392-61bdde9d734a Jul 08 18:32:00 devstack sudo[87819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:02 devstack sudo[87819]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-19d81d02-cb23-43b6-a190-bc9d3f35ade9 req-e6730078-c5c4-4cc0-b26f-c5de89bf913e tempest-VolumesSnapshotsTestJSON-1763526223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b.cd898d61-d51d-45bd-8392-61bdde9d734a" returned: 0 in 1.742s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:02 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [req-19d81d02-cb23-43b6-a190-bc9d3f35ade9 req-e6730078-c5c4-4cc0-b26f-c5de89bf913e tempest-VolumesSnapshotsTestJSON-1763526223 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:32:02 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[72369b58-19f3-497e-b8d1-7f9b6001d975]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:32:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-19d81d02-cb23-43b6-a190-bc9d3f35ade9 req-e6730078-c5c4-4cc0-b26f-c5de89bf913e tempest-VolumesSnapshotsTestJSON-1763526223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:02 devstack sudo[87871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b Jul 08 18:32:02 devstack sudo[87871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:04 devstack sudo[87871]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-19d81d02-cb23-43b6-a190-bc9d3f35ade9 req-e6730078-c5c4-4cc0-b26f-c5de89bf913e tempest-VolumesSnapshotsTestJSON-1763526223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b" returned: 0 in 2.141s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-19d81d02-cb23-43b6-a190-bc9d3f35ade9 req-e6730078-c5c4-4cc0-b26f-c5de89bf913e tempest-VolumesSnapshotsTestJSON-1763526223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b.cd898d61-d51d-45bd-8392-61bdde9d734a {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:04 devstack sudo[87926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b.cd898d61-d51d-45bd-8392-61bdde9d734a Jul 08 18:32:04 devstack sudo[87926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:06 devstack sudo[87926]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-19d81d02-cb23-43b6-a190-bc9d3f35ade9 req-e6730078-c5c4-4cc0-b26f-c5de89bf913e tempest-VolumesSnapshotsTestJSON-1763526223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b.cd898d61-d51d-45bd-8392-61bdde9d734a" returned: 0 in 1.421s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-19d81d02-cb23-43b6-a190-bc9d3f35ade9 req-e6730078-c5c4-4cc0-b26f-c5de89bf913e tempest-VolumesSnapshotsTestJSON-1763526223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b.cd898d61-d51d-45bd-8392-61bdde9d734a {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:06 devstack sudo[87946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b.cd898d61-d51d-45bd-8392-61bdde9d734a Jul 08 18:32:06 devstack sudo[87946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:07 devstack sudo[87946]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-19d81d02-cb23-43b6-a190-bc9d3f35ade9 req-e6730078-c5c4-4cc0-b26f-c5de89bf913e tempest-VolumesSnapshotsTestJSON-1763526223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b.cd898d61-d51d-45bd-8392-61bdde9d734a" returned: 0 in 1.714s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:07 devstack cinder-volume[86873]: DEBUG cinder.coordination [req-19d81d02-cb23-43b6-a190-bc9d3f35ade9 req-e6730078-c5c4-4cc0-b26f-c5de89bf913e tempest-VolumesSnapshotsTestJSON-1763526223 None] Lock "cinder-quobyte-cd898d61-d51d-45bd-8392-61bdde9d734a" released by "_delete_snapshot" :: held 7.231s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:32:07 devstack cinder-volume[86873]: DEBUG cinder.coordination [req-19d81d02-cb23-43b6-a190-bc9d3f35ade9 req-e6730078-c5c4-4cc0-b26f-c5de89bf913e tempest-VolumesSnapshotsTestJSON-1763526223 None] Lock "cinder-quobyte-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b" released by "delete_snapshot" :: held 7.305s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:32:07 devstack cinder-volume[86873]: WARNING cinder.quota [req-19d81d02-cb23-43b6-a190-bc9d3f35ade9 req-e6730078-c5c4-4cc0-b26f-c5de89bf913e tempest-VolumesSnapshotsTestJSON-1763526223 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:32:07 devstack cinder-volume[86873]: WARNING cinder.quota [req-19d81d02-cb23-43b6-a190-bc9d3f35ade9 req-e6730078-c5c4-4cc0-b26f-c5de89bf913e tempest-VolumesSnapshotsTestJSON-1763526223 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:32:07 devstack cinder-volume[86873]: DEBUG cinder.quota [req-19d81d02-cb23-43b6-a190-bc9d3f35ade9 req-e6730078-c5c4-4cc0-b26f-c5de89bf913e tempest-VolumesSnapshotsTestJSON-1763526223 None] Created reservations ['a6ccd46a-2322-4c1f-9523-f74f9c9fd372', '1bc69867-8dd7-4bef-9962-5eb71c304234', '11acf15f-c339-4b9e-a6b3-eef5e86d7480', '0495d9f0-39b5-4bfc-8d4c-63ecc16c5115'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:32:08 devstack cinder-volume[86873]: INFO cinder.volume.manager [req-19d81d02-cb23-43b6-a190-bc9d3f35ade9 req-e6730078-c5c4-4cc0-b26f-c5de89bf913e tempest-VolumesSnapshotsTestJSON-1763526223 None] Delete snapshot completed successfully. Jul 08 18:32:08 devstack cinder-volume[86873]: DEBUG cinder.coordination [req-19d81d02-cb23-43b6-a190-bc9d3f35ade9 req-e6730078-c5c4-4cc0-b26f-c5de89bf913e tempest-VolumesSnapshotsTestJSON-1763526223 None] Lock "cinder-cd898d61-d51d-45bd-8392-61bdde9d734a-delete_snapshot" released by "delete_snapshot" :: held 7.620s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:32:08 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-842f7ef5-1997-45af-9ebc-1c368ed52e77 tempest-VolumesAdminNegativeTest-48000335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:32:08 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-842f7ef5-1997-45af-9ebc-1c368ed52e77 tempest-VolumesAdminNegativeTest-48000335 None] Flow 'volume_create_manager' (304f789a-3be1-48fd-9d82-58fc98998910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:32:08 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-842f7ef5-1997-45af-9ebc-1c368ed52e77 tempest-VolumesAdminNegativeTest-48000335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cfb2ca6-1343-43d2-83ac-3808d53e20c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:08 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-842f7ef5-1997-45af-9ebc-1c368ed52e77 tempest-VolumesAdminNegativeTest-48000335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cfb2ca6-1343-43d2-83ac-3808d53e20c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:32:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1695002410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c7a5512-d1fc-4228-893f-e929cbb84beb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='907d84ca8ad1450d973d9e40f748c9a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:32:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:32:08Z,use_quota=True,user_id='6c79af5b5eeb40a5b39d92d076b6d5bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:08 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-842f7ef5-1997-45af-9ebc-1c368ed52e77 tempest-VolumesAdminNegativeTest-48000335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14441b2d-8754-4ae1-99c9-58fd6cddeceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:08 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-842f7ef5-1997-45af-9ebc-1c368ed52e77 tempest-VolumesAdminNegativeTest-48000335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14441b2d-8754-4ae1-99c9-58fd6cddeceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:08 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-842f7ef5-1997-45af-9ebc-1c368ed52e77 tempest-VolumesAdminNegativeTest-48000335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20e973ad-e531-4b06-8ae8-f622cdf64956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:08 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-842f7ef5-1997-45af-9ebc-1c368ed52e77 tempest-VolumesAdminNegativeTest-48000335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20e973ad-e531-4b06-8ae8-f622cdf64956) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c7a5512-d1fc-4228-893f-e929cbb84beb', 'volume_name': 'volume-0c7a5512-d1fc-4228-893f-e929cbb84beb', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:08 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-842f7ef5-1997-45af-9ebc-1c368ed52e77 tempest-VolumesAdminNegativeTest-48000335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb5d3fac-f5f9-4d73-b465-2e9518fbbab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:08 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-842f7ef5-1997-45af-9ebc-1c368ed52e77 tempest-VolumesAdminNegativeTest-48000335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb5d3fac-f5f9-4d73-b465-2e9518fbbab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:08 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-842f7ef5-1997-45af-9ebc-1c368ed52e77 tempest-VolumesAdminNegativeTest-48000335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff45e59c-536c-4122-9bc9-33362379f01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:08 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-842f7ef5-1997-45af-9ebc-1c368ed52e77 tempest-VolumesAdminNegativeTest-48000335 None] Volume 0c7a5512-d1fc-4228-893f-e929cbb84beb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c7a5512-d1fc-4228-893f-e929cbb84beb', 'volume_size': 1} Jul 08 18:32:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-842f7ef5-1997-45af-9ebc-1c368ed52e77 tempest-VolumesAdminNegativeTest-48000335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:32:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-842f7ef5-1997-45af-9ebc-1c368ed52e77 tempest-VolumesAdminNegativeTest-48000335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:32:08 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-842f7ef5-1997-45af-9ebc-1c368ed52e77 tempest-VolumesAdminNegativeTest-48000335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:32:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1695002410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c7a5512-d1fc-4228-893f-e929cbb84beb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='907d84ca8ad1450d973d9e40f748c9a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:32:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:32:08Z,use_quota=True,user_id='6c79af5b5eeb40a5b39d92d076b6d5bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:32:08 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-842f7ef5-1997-45af-9ebc-1c368ed52e77 tempest-VolumesAdminNegativeTest-48000335 None] Creating volume 0c7a5512-d1fc-4228-893f-e929cbb84beb {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:32:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-842f7ef5-1997-45af-9ebc-1c368ed52e77 tempest-VolumesAdminNegativeTest-48000335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:32:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-842f7ef5-1997-45af-9ebc-1c368ed52e77 tempest-VolumesAdminNegativeTest-48000335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:32:08 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-842f7ef5-1997-45af-9ebc-1c368ed52e77 tempest-VolumesAdminNegativeTest-48000335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:32:08 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-842f7ef5-1997-45af-9ebc-1c368ed52e77 tempest-VolumesAdminNegativeTest-48000335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:32:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-842f7ef5-1997-45af-9ebc-1c368ed52e77 tempest-VolumesAdminNegativeTest-48000335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:32:08 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-842f7ef5-1997-45af-9ebc-1c368ed52e77 tempest-VolumesAdminNegativeTest-48000335 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:32:08 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-842f7ef5-1997-45af-9ebc-1c368ed52e77 tempest-VolumesAdminNegativeTest-48000335 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:32:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-842f7ef5-1997-45af-9ebc-1c368ed52e77 tempest-VolumesAdminNegativeTest-48000335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0c7a5512-d1fc-4228-893f-e929cbb84beb 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:08 devstack sudo[87951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0c7a5512-d1fc-4228-893f-e929cbb84beb 1073741824 Jul 08 18:32:08 devstack sudo[87951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:09 devstack cinder-volume[86873]: DEBUG cinder.coordination [req-c38aab6c-dd64-4930-bf87-3b7b1cb8c40a req-c74d5f22-2788-4a18-8ce4-3c3f0a04738b tempest-VolumesSnapshotsTestJSON-1763526223 None] Acquiring lock "cinder-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:32:09 devstack cinder-volume[86873]: DEBUG cinder.coordination [req-c38aab6c-dd64-4930-bf87-3b7b1cb8c40a req-c74d5f22-2788-4a18-8ce4-3c3f0a04738b tempest-VolumesSnapshotsTestJSON-1763526223 None] Lock "cinder-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:32:09 devstack cinder-volume[86873]: DEBUG cinder.coordination [req-c38aab6c-dd64-4930-bf87-3b7b1cb8c40a req-c74d5f22-2788-4a18-8ce4-3c3f0a04738b tempest-VolumesSnapshotsTestJSON-1763526223 None] Acquiring lock "cinder-quobyte-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:32:09 devstack cinder-volume[86873]: DEBUG cinder.coordination [req-c38aab6c-dd64-4930-bf87-3b7b1cb8c40a req-c74d5f22-2788-4a18-8ce4-3c3f0a04738b tempest-VolumesSnapshotsTestJSON-1763526223 None] Lock "cinder-quobyte-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b" acquired by "delete_volume" :: waited 0.042s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:32:09 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77846a3-d101-4601-940a-bcef61c2f2bc]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:32:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-c38aab6c-dd64-4930-bf87-3b7b1cb8c40a req-c74d5f22-2788-4a18-8ce4-3c3f0a04738b tempest-VolumesSnapshotsTestJSON-1763526223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:09 devstack sudo[87958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b Jul 08 18:32:09 devstack sudo[87958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:09 devstack sudo[87951]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-842f7ef5-1997-45af-9ebc-1c368ed52e77 tempest-VolumesAdminNegativeTest-48000335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0c7a5512-d1fc-4228-893f-e929cbb84beb 1073741824" returned: 0 in 1.369s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-842f7ef5-1997-45af-9ebc-1c368ed52e77 tempest-VolumesAdminNegativeTest-48000335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0c7a5512-d1fc-4228-893f-e929cbb84beb {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:10 devstack sudo[87962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0c7a5512-d1fc-4228-893f-e929cbb84beb Jul 08 18:32:10 devstack sudo[87962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:10 devstack sudo[87962]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-842f7ef5-1997-45af-9ebc-1c368ed52e77 tempest-VolumesAdminNegativeTest-48000335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0c7a5512-d1fc-4228-893f-e929cbb84beb" returned: 0 in 0.947s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:10 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-842f7ef5-1997-45af-9ebc-1c368ed52e77 tempest-VolumesAdminNegativeTest-48000335 None] <== create_volume: return (2401ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:32:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-842f7ef5-1997-45af-9ebc-1c368ed52e77 tempest-VolumesAdminNegativeTest-48000335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.403s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:32:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-842f7ef5-1997-45af-9ebc-1c368ed52e77 tempest-VolumesAdminNegativeTest-48000335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff45e59c-536c-4122-9bc9-33362379f01f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c7a5512-d1fc-4228-893f-e929cbb84beb', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-842f7ef5-1997-45af-9ebc-1c368ed52e77 tempest-VolumesAdminNegativeTest-48000335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd3b314d-5ab7-4e78-a8df-27cf9ff287bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:10 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-842f7ef5-1997-45af-9ebc-1c368ed52e77 tempest-VolumesAdminNegativeTest-48000335 None] Volume volume-0c7a5512-d1fc-4228-893f-e929cbb84beb (0c7a5512-d1fc-4228-893f-e929cbb84beb): created successfully Jul 08 18:32:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-842f7ef5-1997-45af-9ebc-1c368ed52e77 tempest-VolumesAdminNegativeTest-48000335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd3b314d-5ab7-4e78-a8df-27cf9ff287bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-842f7ef5-1997-45af-9ebc-1c368ed52e77 tempest-VolumesAdminNegativeTest-48000335 None] Flow 'volume_create_manager' (304f789a-3be1-48fd-9d82-58fc98998910) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:32:11 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-842f7ef5-1997-45af-9ebc-1c368ed52e77 tempest-VolumesAdminNegativeTest-48000335 None] Created volume successfully. Jul 08 18:32:11 devstack sudo[87958]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-c38aab6c-dd64-4930-bf87-3b7b1cb8c40a req-c74d5f22-2788-4a18-8ce4-3c3f0a04738b tempest-VolumesSnapshotsTestJSON-1763526223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b" returned: 0 in 1.695s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-c38aab6c-dd64-4930-bf87-3b7b1cb8c40a req-c74d5f22-2788-4a18-8ce4-3c3f0a04738b tempest-VolumesSnapshotsTestJSON-1763526223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:11 devstack sudo[87999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b Jul 08 18:32:11 devstack sudo[87999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:11 devstack sudo[87999]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-c38aab6c-dd64-4930-bf87-3b7b1cb8c40a req-c74d5f22-2788-4a18-8ce4-3c3f0a04738b tempest-VolumesSnapshotsTestJSON-1763526223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b" returned: 0 in 0.838s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:11 devstack cinder-volume[86873]: DEBUG cinder.coordination [req-c38aab6c-dd64-4930-bf87-3b7b1cb8c40a req-c74d5f22-2788-4a18-8ce4-3c3f0a04738b tempest-VolumesSnapshotsTestJSON-1763526223 None] Lock "cinder-quobyte-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b" released by "delete_volume" :: held 2.679s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:32:11 devstack cinder-volume[86873]: WARNING cinder.quota [req-c38aab6c-dd64-4930-bf87-3b7b1cb8c40a req-c74d5f22-2788-4a18-8ce4-3c3f0a04738b tempest-VolumesSnapshotsTestJSON-1763526223 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:32:12 devstack cinder-volume[86873]: DEBUG cinder.quota [req-c38aab6c-dd64-4930-bf87-3b7b1cb8c40a req-c74d5f22-2788-4a18-8ce4-3c3f0a04738b tempest-VolumesSnapshotsTestJSON-1763526223 None] Created reservations ['78311b1e-571f-400c-836c-4a20b0434f86', 'e9b016a1-e7ef-45f6-a206-a0bfe80a2511', '40581ab3-d4e5-4ebd-8c3c-3f46cced3f97', 'cf35515e-a1ba-49de-a3d7-f57874856f3c'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:32:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-c38aab6c-dd64-4930-bf87-3b7b1cb8c40a req-c74d5f22-2788-4a18-8ce4-3c3f0a04738b tempest-VolumesSnapshotsTestJSON-1763526223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:32:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-c38aab6c-dd64-4930-bf87-3b7b1cb8c40a req-c74d5f22-2788-4a18-8ce4-3c3f0a04738b tempest-VolumesSnapshotsTestJSON-1763526223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:32:12 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [req-c38aab6c-dd64-4930-bf87-3b7b1cb8c40a req-c74d5f22-2788-4a18-8ce4-3c3f0a04738b tempest-VolumesSnapshotsTestJSON-1763526223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:32:12 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [req-c38aab6c-dd64-4930-bf87-3b7b1cb8c40a req-c74d5f22-2788-4a18-8ce4-3c3f0a04738b tempest-VolumesSnapshotsTestJSON-1763526223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:32:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-c38aab6c-dd64-4930-bf87-3b7b1cb8c40a req-c74d5f22-2788-4a18-8ce4-3c3f0a04738b tempest-VolumesSnapshotsTestJSON-1763526223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:32:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-c38aab6c-dd64-4930-bf87-3b7b1cb8c40a req-c74d5f22-2788-4a18-8ce4-3c3f0a04738b tempest-VolumesSnapshotsTestJSON-1763526223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:12 devstack sudo[88003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:32:12 devstack sudo[88003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:12 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-0e4e2c9d-f69e-4230-a1ba-bff1928a85fb tempest-VolumesAdminNegativeTest-48000335 None] Acquiring lock "cinder-0c7a5512-d1fc-4228-893f-e929cbb84beb-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:32:12 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-0e4e2c9d-f69e-4230-a1ba-bff1928a85fb tempest-VolumesAdminNegativeTest-48000335 None] Lock "cinder-0c7a5512-d1fc-4228-893f-e929cbb84beb-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:32:12 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-0e4e2c9d-f69e-4230-a1ba-bff1928a85fb tempest-VolumesAdminNegativeTest-48000335 None] Acquiring lock "cinder-quobyte-0c7a5512-d1fc-4228-893f-e929cbb84beb" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:32:12 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-0e4e2c9d-f69e-4230-a1ba-bff1928a85fb tempest-VolumesAdminNegativeTest-48000335 None] Lock "cinder-quobyte-0c7a5512-d1fc-4228-893f-e929cbb84beb" acquired by "delete_volume" :: waited 0.033s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:32:12 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c868393-6514-4180-98ef-bb8c0e0e9ba2]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:32:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-0e4e2c9d-f69e-4230-a1ba-bff1928a85fb tempest-VolumesAdminNegativeTest-48000335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0c7a5512-d1fc-4228-893f-e929cbb84beb {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:12 devstack sudo[88005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0c7a5512-d1fc-4228-893f-e929cbb84beb Jul 08 18:32:12 devstack sudo[88005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:13 devstack sudo[88003]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-c38aab6c-dd64-4930-bf87-3b7b1cb8c40a req-c74d5f22-2788-4a18-8ce4-3c3f0a04738b tempest-VolumesSnapshotsTestJSON-1763526223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 1.150s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:13 devstack cinder-volume[86873]: DEBUG cinder.manager [req-c38aab6c-dd64-4930-bf87-3b7b1cb8c40a req-c74d5f22-2788-4a18-8ce4-3c3f0a04738b tempest-VolumesSnapshotsTestJSON-1763526223 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:32:13 devstack cinder-volume[86873]: INFO cinder.volume.manager [req-c38aab6c-dd64-4930-bf87-3b7b1cb8c40a req-c74d5f22-2788-4a18-8ce4-3c3f0a04738b tempest-VolumesSnapshotsTestJSON-1763526223 None] Deleted volume successfully. Jul 08 18:32:13 devstack cinder-volume[86873]: DEBUG cinder.coordination [req-c38aab6c-dd64-4930-bf87-3b7b1cb8c40a req-c74d5f22-2788-4a18-8ce4-3c3f0a04738b tempest-VolumesSnapshotsTestJSON-1763526223 None] Lock "cinder-6ee1707d-6e9c-4cf7-8122-78eb60da4e5b-delete_volume" released by "delete_volume" :: held 4.306s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:32:13 devstack sudo[88005]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-0e4e2c9d-f69e-4230-a1ba-bff1928a85fb tempest-VolumesAdminNegativeTest-48000335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0c7a5512-d1fc-4228-893f-e929cbb84beb" returned: 0 in 0.995s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-0e4e2c9d-f69e-4230-a1ba-bff1928a85fb tempest-VolumesAdminNegativeTest-48000335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0c7a5512-d1fc-4228-893f-e929cbb84beb {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:13 devstack sudo[88011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0c7a5512-d1fc-4228-893f-e929cbb84beb Jul 08 18:32:13 devstack sudo[88011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:14 devstack sudo[88011]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-0e4e2c9d-f69e-4230-a1ba-bff1928a85fb tempest-VolumesAdminNegativeTest-48000335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0c7a5512-d1fc-4228-893f-e929cbb84beb" returned: 0 in 0.974s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:14 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-0e4e2c9d-f69e-4230-a1ba-bff1928a85fb tempest-VolumesAdminNegativeTest-48000335 None] Lock "cinder-quobyte-0c7a5512-d1fc-4228-893f-e929cbb84beb" released by "delete_volume" :: held 2.036s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:32:14 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-0e4e2c9d-f69e-4230-a1ba-bff1928a85fb tempest-VolumesAdminNegativeTest-48000335 None] Created reservations ['7cd88449-ccaa-4d40-933a-0a971d4c85b4', '21569b13-644d-4451-941b-07e3b8001b18', 'dde8b6dd-62be-49da-8db6-f5d79ff5d8c0', 'ccf654cf-34f1-4205-b556-4bbf81300459'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:32:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-0e4e2c9d-f69e-4230-a1ba-bff1928a85fb tempest-VolumesAdminNegativeTest-48000335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:32:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-0e4e2c9d-f69e-4230-a1ba-bff1928a85fb tempest-VolumesAdminNegativeTest-48000335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:32:14 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-0e4e2c9d-f69e-4230-a1ba-bff1928a85fb tempest-VolumesAdminNegativeTest-48000335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:32:14 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-0e4e2c9d-f69e-4230-a1ba-bff1928a85fb tempest-VolumesAdminNegativeTest-48000335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:32:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-0e4e2c9d-f69e-4230-a1ba-bff1928a85fb tempest-VolumesAdminNegativeTest-48000335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:32:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-0e4e2c9d-f69e-4230-a1ba-bff1928a85fb tempest-VolumesAdminNegativeTest-48000335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:15 devstack sudo[88020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:32:15 devstack sudo[88020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:16 devstack sudo[88020]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-0e4e2c9d-f69e-4230-a1ba-bff1928a85fb tempest-VolumesAdminNegativeTest-48000335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 1.220s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:16 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-0e4e2c9d-f69e-4230-a1ba-bff1928a85fb tempest-VolumesAdminNegativeTest-48000335 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:32:16 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-0e4e2c9d-f69e-4230-a1ba-bff1928a85fb tempest-VolumesAdminNegativeTest-48000335 None] Deleted volume successfully. Jul 08 18:32:16 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-0e4e2c9d-f69e-4230-a1ba-bff1928a85fb tempest-VolumesAdminNegativeTest-48000335 None] Lock "cinder-0c7a5512-d1fc-4228-893f-e929cbb84beb-delete_volume" released by "delete_volume" :: held 3.682s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:32:19 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-91e3e319-6884-4531-81dd-90a9e0731657 tempest-BackendsCapabilitiesAdminTestsJSON-823252819 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.667579650879, 'free_capacity_gb': 1775.667579650879, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86873) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 08 18:32:19 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-05b8ec64-463a-4464-b4d9-aec4fc58d600 tempest-BackendsCapabilitiesAdminTestsJSON-823252819 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.667579650879, 'free_capacity_gb': 1775.667579650879, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86873) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 08 18:32:24 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:SELECT=23,cinder:INSERT=9,cinder:UPDATE=32,cinder:DELETE=1 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:32:25 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4c863de-1911-4bae-8e4e-2ff04e97386d tempest-AttachVolumeShelveTestJSON-2087706243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:32:25 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c4c863de-1911-4bae-8e4e-2ff04e97386d tempest-AttachVolumeShelveTestJSON-2087706243 None] Flow 'volume_create_manager' (d989e31b-5102-433e-91f1-aff2f164eae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:32:25 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c4c863de-1911-4bae-8e4e-2ff04e97386d tempest-AttachVolumeShelveTestJSON-2087706243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca34641d-bd7d-4a06-ac46-35baa78c69a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:25 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c4c863de-1911-4bae-8e4e-2ff04e97386d tempest-AttachVolumeShelveTestJSON-2087706243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca34641d-bd7d-4a06-ac46-35baa78c69a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:32:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1291312267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=731236ea-3910-401d-93ba-6e8bb449abe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fa0c9f976a443efa18a818054a1d942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:32:26Z,use_quota=True,user_id='a3299d6a47db417b8a32a0adf71ed113',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:25 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c4c863de-1911-4bae-8e4e-2ff04e97386d tempest-AttachVolumeShelveTestJSON-2087706243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (474ca737-934d-4c9e-856c-992f2b03c399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:25 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c4c863de-1911-4bae-8e4e-2ff04e97386d tempest-AttachVolumeShelveTestJSON-2087706243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (474ca737-934d-4c9e-856c-992f2b03c399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:25 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c4c863de-1911-4bae-8e4e-2ff04e97386d tempest-AttachVolumeShelveTestJSON-2087706243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9307b65d-c539-4915-9c5a-0e4770328875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:25 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c4c863de-1911-4bae-8e4e-2ff04e97386d tempest-AttachVolumeShelveTestJSON-2087706243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9307b65d-c539-4915-9c5a-0e4770328875) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '731236ea-3910-401d-93ba-6e8bb449abe6', 'volume_name': 'volume-731236ea-3910-401d-93ba-6e8bb449abe6', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:25 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c4c863de-1911-4bae-8e4e-2ff04e97386d tempest-AttachVolumeShelveTestJSON-2087706243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9abd1cd8-e437-46cf-990c-00cc8f0ee958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:25 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c4c863de-1911-4bae-8e4e-2ff04e97386d tempest-AttachVolumeShelveTestJSON-2087706243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9abd1cd8-e437-46cf-990c-00cc8f0ee958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:25 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c4c863de-1911-4bae-8e4e-2ff04e97386d tempest-AttachVolumeShelveTestJSON-2087706243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0342ae41-a949-480c-83d7-7c7d66a1793e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:25 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-c4c863de-1911-4bae-8e4e-2ff04e97386d tempest-AttachVolumeShelveTestJSON-2087706243 None] Volume 731236ea-3910-401d-93ba-6e8bb449abe6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-731236ea-3910-401d-93ba-6e8bb449abe6', 'volume_size': 1} Jul 08 18:32:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c4c863de-1911-4bae-8e4e-2ff04e97386d tempest-AttachVolumeShelveTestJSON-2087706243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:32:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c4c863de-1911-4bae-8e4e-2ff04e97386d tempest-AttachVolumeShelveTestJSON-2087706243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:32:25 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c4c863de-1911-4bae-8e4e-2ff04e97386d tempest-AttachVolumeShelveTestJSON-2087706243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:32:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1291312267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=731236ea-3910-401d-93ba-6e8bb449abe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fa0c9f976a443efa18a818054a1d942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:32:26Z,use_quota=True,user_id='a3299d6a47db417b8a32a0adf71ed113',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:32:25 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-c4c863de-1911-4bae-8e4e-2ff04e97386d tempest-AttachVolumeShelveTestJSON-2087706243 None] Creating volume 731236ea-3910-401d-93ba-6e8bb449abe6 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:32:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c4c863de-1911-4bae-8e4e-2ff04e97386d tempest-AttachVolumeShelveTestJSON-2087706243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:32:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c4c863de-1911-4bae-8e4e-2ff04e97386d tempest-AttachVolumeShelveTestJSON-2087706243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:32:25 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c4c863de-1911-4bae-8e4e-2ff04e97386d tempest-AttachVolumeShelveTestJSON-2087706243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:32:25 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c4c863de-1911-4bae-8e4e-2ff04e97386d tempest-AttachVolumeShelveTestJSON-2087706243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:32:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c4c863de-1911-4bae-8e4e-2ff04e97386d tempest-AttachVolumeShelveTestJSON-2087706243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:32:25 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c4c863de-1911-4bae-8e4e-2ff04e97386d tempest-AttachVolumeShelveTestJSON-2087706243 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:32:25 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-c4c863de-1911-4bae-8e4e-2ff04e97386d tempest-AttachVolumeShelveTestJSON-2087706243 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:32:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c4c863de-1911-4bae-8e4e-2ff04e97386d tempest-AttachVolumeShelveTestJSON-2087706243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-731236ea-3910-401d-93ba-6e8bb449abe6 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:25 devstack sudo[88058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-731236ea-3910-401d-93ba-6e8bb449abe6 1073741824 Jul 08 18:32:25 devstack sudo[88058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:26 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-758bbcbc-b59a-4bd2-b720-f4f4fffeeb50 tempest-GroupSnapshotsV319Test-1835041529 None] Group tempest-GroupSnapshotsV319Test-Group-1422662449: creating Jul 08 18:32:26 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-758bbcbc-b59a-4bd2-b720-f4f4fffeeb50 tempest-GroupSnapshotsV319Test-1835041529 None] Group tempest-GroupSnapshotsV319Test-Group-1422662449: created successfully Jul 08 18:32:26 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-758bbcbc-b59a-4bd2-b720-f4f4fffeeb50 tempest-GroupSnapshotsV319Test-1835041529 None] Create group completed successfully. Jul 08 18:32:26 devstack sudo[88058]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c4c863de-1911-4bae-8e4e-2ff04e97386d tempest-AttachVolumeShelveTestJSON-2087706243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-731236ea-3910-401d-93ba-6e8bb449abe6 1073741824" returned: 0 in 1.136s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c4c863de-1911-4bae-8e4e-2ff04e97386d tempest-AttachVolumeShelveTestJSON-2087706243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-731236ea-3910-401d-93ba-6e8bb449abe6 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:27 devstack sudo[88065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-731236ea-3910-401d-93ba-6e8bb449abe6 Jul 08 18:32:27 devstack sudo[88065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:27 devstack sudo[88065]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c4c863de-1911-4bae-8e4e-2ff04e97386d tempest-AttachVolumeShelveTestJSON-2087706243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-731236ea-3910-401d-93ba-6e8bb449abe6" returned: 0 in 0.745s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:27 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c4c863de-1911-4bae-8e4e-2ff04e97386d tempest-AttachVolumeShelveTestJSON-2087706243 None] <== create_volume: return (1930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:32:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c4c863de-1911-4bae-8e4e-2ff04e97386d tempest-AttachVolumeShelveTestJSON-2087706243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.934s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:32:27 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c4c863de-1911-4bae-8e4e-2ff04e97386d tempest-AttachVolumeShelveTestJSON-2087706243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0342ae41-a949-480c-83d7-7c7d66a1793e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-731236ea-3910-401d-93ba-6e8bb449abe6', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:27 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c4c863de-1911-4bae-8e4e-2ff04e97386d tempest-AttachVolumeShelveTestJSON-2087706243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6720f46b-2398-4720-bfe9-ad639334a430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:27 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-c4c863de-1911-4bae-8e4e-2ff04e97386d tempest-AttachVolumeShelveTestJSON-2087706243 None] Volume volume-731236ea-3910-401d-93ba-6e8bb449abe6 (731236ea-3910-401d-93ba-6e8bb449abe6): created successfully Jul 08 18:32:27 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c4c863de-1911-4bae-8e4e-2ff04e97386d tempest-AttachVolumeShelveTestJSON-2087706243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6720f46b-2398-4720-bfe9-ad639334a430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:27 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c4c863de-1911-4bae-8e4e-2ff04e97386d tempest-AttachVolumeShelveTestJSON-2087706243 None] Flow 'volume_create_manager' (d989e31b-5102-433e-91f1-aff2f164eae7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:32:27 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-c4c863de-1911-4bae-8e4e-2ff04e97386d tempest-AttachVolumeShelveTestJSON-2087706243 None] Created volume successfully. Jul 08 18:32:28 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba5e6a48-bd45-4c83-8334-c28cf6662669 tempest-GroupSnapshotsV319Test-1835041529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:32:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ba5e6a48-bd45-4c83-8334-c28cf6662669 tempest-GroupSnapshotsV319Test-1835041529 None] Flow 'volume_create_manager' (44e53560-ba2a-4f9d-90de-3015eb037c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:32:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ba5e6a48-bd45-4c83-8334-c28cf6662669 tempest-GroupSnapshotsV319Test-1835041529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7332f12e-f325-42e6-aa98-074676f3553f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:29 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ba5e6a48-bd45-4c83-8334-c28cf6662669 tempest-GroupSnapshotsV319Test-1835041529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7332f12e-f325-42e6-aa98-074676f3553f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:32:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-128038957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ddaf9de9-c0b8-40ca-9001-e33d982e978c,host='devstack@QuobyteHD#QuobyteHD',id=65dc9520-6d31-4160-9f38-a37dcab0760d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eaedd1ade394599918eb6a98d359f23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:32:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:32:29Z,use_quota=True,user_id='8aaa0af0f7a440cba64eec8cfd27a111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(36948c8d-7969-4a1f-89a8-6c65205c06e4),volume_type_id=36948c8d-7969-4a1f-89a8-6c65205c06e4)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:29 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ba5e6a48-bd45-4c83-8334-c28cf6662669 tempest-GroupSnapshotsV319Test-1835041529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (040c06e5-eca9-4c79-b7c4-215aa9cafcf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:29 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ba5e6a48-bd45-4c83-8334-c28cf6662669 tempest-GroupSnapshotsV319Test-1835041529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (040c06e5-eca9-4c79-b7c4-215aa9cafcf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:29 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ba5e6a48-bd45-4c83-8334-c28cf6662669 tempest-GroupSnapshotsV319Test-1835041529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab8142db-ecce-4e8f-bc04-c84bb411f382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:29 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ba5e6a48-bd45-4c83-8334-c28cf6662669 tempest-GroupSnapshotsV319Test-1835041529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab8142db-ecce-4e8f-bc04-c84bb411f382) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65dc9520-6d31-4160-9f38-a37dcab0760d', 'volume_name': 'volume-65dc9520-6d31-4160-9f38-a37dcab0760d', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:29 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ba5e6a48-bd45-4c83-8334-c28cf6662669 tempest-GroupSnapshotsV319Test-1835041529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4ca586c-2171-4aab-a139-8d3c4e03d529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:29 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ba5e6a48-bd45-4c83-8334-c28cf6662669 tempest-GroupSnapshotsV319Test-1835041529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4ca586c-2171-4aab-a139-8d3c4e03d529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:29 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ba5e6a48-bd45-4c83-8334-c28cf6662669 tempest-GroupSnapshotsV319Test-1835041529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d70ae34c-2c34-4126-a501-a896fe3672a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:29 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-ba5e6a48-bd45-4c83-8334-c28cf6662669 tempest-GroupSnapshotsV319Test-1835041529 None] Volume 65dc9520-6d31-4160-9f38-a37dcab0760d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65dc9520-6d31-4160-9f38-a37dcab0760d', 'volume_size': 1} Jul 08 18:32:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-ba5e6a48-bd45-4c83-8334-c28cf6662669 tempest-GroupSnapshotsV319Test-1835041529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:32:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-ba5e6a48-bd45-4c83-8334-c28cf6662669 tempest-GroupSnapshotsV319Test-1835041529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:32:29 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-ba5e6a48-bd45-4c83-8334-c28cf6662669 tempest-GroupSnapshotsV319Test-1835041529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ddaf9de9-c0b8-40ca-9001-e33d982e978c,created_at=2026-07-08T16:32:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-128038957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ddaf9de9-c0b8-40ca-9001-e33d982e978c,host='devstack@QuobyteHD#QuobyteHD',id=65dc9520-6d31-4160-9f38-a37dcab0760d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eaedd1ade394599918eb6a98d359f23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:32:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:32:29Z,use_quota=True,user_id='8aaa0af0f7a440cba64eec8cfd27a111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(36948c8d-7969-4a1f-89a8-6c65205c06e4),volume_type_id=36948c8d-7969-4a1f-89a8-6c65205c06e4)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:32:29 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-ba5e6a48-bd45-4c83-8334-c28cf6662669 tempest-GroupSnapshotsV319Test-1835041529 None] Creating volume 65dc9520-6d31-4160-9f38-a37dcab0760d {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:32:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-ba5e6a48-bd45-4c83-8334-c28cf6662669 tempest-GroupSnapshotsV319Test-1835041529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:32:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-ba5e6a48-bd45-4c83-8334-c28cf6662669 tempest-GroupSnapshotsV319Test-1835041529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:32:29 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-ba5e6a48-bd45-4c83-8334-c28cf6662669 tempest-GroupSnapshotsV319Test-1835041529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:32:29 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-ba5e6a48-bd45-4c83-8334-c28cf6662669 tempest-GroupSnapshotsV319Test-1835041529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:32:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-ba5e6a48-bd45-4c83-8334-c28cf6662669 tempest-GroupSnapshotsV319Test-1835041529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:32:29 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-ba5e6a48-bd45-4c83-8334-c28cf6662669 tempest-GroupSnapshotsV319Test-1835041529 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:32:29 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-ba5e6a48-bd45-4c83-8334-c28cf6662669 tempest-GroupSnapshotsV319Test-1835041529 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:32:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ba5e6a48-bd45-4c83-8334-c28cf6662669 tempest-GroupSnapshotsV319Test-1835041529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-65dc9520-6d31-4160-9f38-a37dcab0760d 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:29 devstack sudo[88072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-65dc9520-6d31-4160-9f38-a37dcab0760d 1073741824 Jul 08 18:32:29 devstack sudo[88072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:30 devstack sudo[88072]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ba5e6a48-bd45-4c83-8334-c28cf6662669 tempest-GroupSnapshotsV319Test-1835041529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-65dc9520-6d31-4160-9f38-a37dcab0760d 1073741824" returned: 0 in 1.208s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ba5e6a48-bd45-4c83-8334-c28cf6662669 tempest-GroupSnapshotsV319Test-1835041529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-65dc9520-6d31-4160-9f38-a37dcab0760d {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:30 devstack sudo[88079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-65dc9520-6d31-4160-9f38-a37dcab0760d Jul 08 18:32:30 devstack sudo[88079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:31 devstack sudo[88079]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ba5e6a48-bd45-4c83-8334-c28cf6662669 tempest-GroupSnapshotsV319Test-1835041529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-65dc9520-6d31-4160-9f38-a37dcab0760d" returned: 0 in 0.724s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:31 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-ba5e6a48-bd45-4c83-8334-c28cf6662669 tempest-GroupSnapshotsV319Test-1835041529 None] <== create_volume: return (1989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:32:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-ba5e6a48-bd45-4c83-8334-c28cf6662669 tempest-GroupSnapshotsV319Test-1835041529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.991s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:32:31 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ba5e6a48-bd45-4c83-8334-c28cf6662669 tempest-GroupSnapshotsV319Test-1835041529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d70ae34c-2c34-4126-a501-a896fe3672a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65dc9520-6d31-4160-9f38-a37dcab0760d', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:31 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ba5e6a48-bd45-4c83-8334-c28cf6662669 tempest-GroupSnapshotsV319Test-1835041529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9ede07e-6bec-4ef0-a5bf-3e89d8ba391a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:31 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-ba5e6a48-bd45-4c83-8334-c28cf6662669 tempest-GroupSnapshotsV319Test-1835041529 None] Volume volume-65dc9520-6d31-4160-9f38-a37dcab0760d (65dc9520-6d31-4160-9f38-a37dcab0760d): created successfully Jul 08 18:32:31 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ba5e6a48-bd45-4c83-8334-c28cf6662669 tempest-GroupSnapshotsV319Test-1835041529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9ede07e-6bec-4ef0-a5bf-3e89d8ba391a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:31 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ba5e6a48-bd45-4c83-8334-c28cf6662669 tempest-GroupSnapshotsV319Test-1835041529 None] Flow 'volume_create_manager' (44e53560-ba2a-4f9d-90de-3015eb037c16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:32:31 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-ba5e6a48-bd45-4c83-8334-c28cf6662669 tempest-GroupSnapshotsV319Test-1835041529 None] Created volume successfully. Jul 08 18:32:31 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-6beb71dc-7d5a-407c-9810-2ceaab00352e tempest-GroupSnapshotsV319Test-1835041529 None] GroupSnapshot 133b49b4-71ad-4f2f-a236-862fae663658: creating. Jul 08 18:32:31 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6beb71dc-7d5a-407c-9810-2ceaab00352e tempest-GroupSnapshotsV319Test-1835041529 None] Group snapshot 133b49b4-71ad-4f2f-a236-862fae663658: creating. {{(pid=86873) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 08 18:32:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6beb71dc-7d5a-407c-9810-2ceaab00352e tempest-GroupSnapshotsV319Test-1835041529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:32:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6beb71dc-7d5a-407c-9810-2ceaab00352e tempest-GroupSnapshotsV319Test-1835041529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:32:31 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-6beb71dc-7d5a-407c-9810-2ceaab00352e tempest-GroupSnapshotsV319Test-1835041529 None] Creating offline snapshot 35b4063b-cbd6-4c0c-a983-ba985d706088 of volume 65dc9520-6d31-4160-9f38-a37dcab0760d {{(pid=86873) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:32:31 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[720a2ada-aa12-4693-94ff-139caf64e16c]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:32:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6beb71dc-7d5a-407c-9810-2ceaab00352e tempest-GroupSnapshotsV319Test-1835041529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-65dc9520-6d31-4160-9f38-a37dcab0760d {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:31 devstack sudo[88090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-65dc9520-6d31-4160-9f38-a37dcab0760d Jul 08 18:32:31 devstack sudo[88090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:32 devstack sudo[88090]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:32 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6beb71dc-7d5a-407c-9810-2ceaab00352e tempest-GroupSnapshotsV319Test-1835041529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-65dc9520-6d31-4160-9f38-a37dcab0760d" returned: 0 in 0.953s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:32 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6beb71dc-7d5a-407c-9810-2ceaab00352e tempest-GroupSnapshotsV319Test-1835041529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-65dc9520-6d31-4160-9f38-a37dcab0760d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-65dc9520-6d31-4160-9f38-a37dcab0760d.35b4063b-cbd6-4c0c-a983-ba985d706088 1G {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:32 devstack sudo[88104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-65dc9520-6d31-4160-9f38-a37dcab0760d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-65dc9520-6d31-4160-9f38-a37dcab0760d.35b4063b-cbd6-4c0c-a983-ba985d706088 1G Jul 08 18:32:32 devstack sudo[88104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:33 devstack sudo[88104]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6beb71dc-7d5a-407c-9810-2ceaab00352e tempest-GroupSnapshotsV319Test-1835041529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-65dc9520-6d31-4160-9f38-a37dcab0760d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-65dc9520-6d31-4160-9f38-a37dcab0760d.35b4063b-cbd6-4c0c-a983-ba985d706088 1G" returned: 0 in 1.005s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6beb71dc-7d5a-407c-9810-2ceaab00352e tempest-GroupSnapshotsV319Test-1835041529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65dc9520-6d31-4160-9f38-a37dcab0760d -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-65dc9520-6d31-4160-9f38-a37dcab0760d.35b4063b-cbd6-4c0c-a983-ba985d706088 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:33 devstack sudo[88110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65dc9520-6d31-4160-9f38-a37dcab0760d -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-65dc9520-6d31-4160-9f38-a37dcab0760d.35b4063b-cbd6-4c0c-a983-ba985d706088 Jul 08 18:32:33 devstack sudo[88110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:34 devstack sudo[88110]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6beb71dc-7d5a-407c-9810-2ceaab00352e tempest-GroupSnapshotsV319Test-1835041529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65dc9520-6d31-4160-9f38-a37dcab0760d -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-65dc9520-6d31-4160-9f38-a37dcab0760d.35b4063b-cbd6-4c0c-a983-ba985d706088" returned: 0 in 0.854s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:34 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-6beb71dc-7d5a-407c-9810-2ceaab00352e tempest-GroupSnapshotsV319Test-1835041529 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-65dc9520-6d31-4160-9f38-a37dcab0760d.35b4063b-cbd6-4c0c-a983-ba985d706088 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 18:32:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6beb71dc-7d5a-407c-9810-2ceaab00352e tempest-GroupSnapshotsV319Test-1835041529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-65dc9520-6d31-4160-9f38-a37dcab0760d.35b4063b-cbd6-4c0c-a983-ba985d706088 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:34 devstack sudo[88125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-65dc9520-6d31-4160-9f38-a37dcab0760d.35b4063b-cbd6-4c0c-a983-ba985d706088 Jul 08 18:32:34 devstack sudo[88125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:35 devstack sudo[88125]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6beb71dc-7d5a-407c-9810-2ceaab00352e tempest-GroupSnapshotsV319Test-1835041529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-65dc9520-6d31-4160-9f38-a37dcab0760d.35b4063b-cbd6-4c0c-a983-ba985d706088" returned: 0 in 0.772s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6beb71dc-7d5a-407c-9810-2ceaab00352e tempest-GroupSnapshotsV319Test-1835041529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-65dc9520-6d31-4160-9f38-a37dcab0760d.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:35 devstack sudo[88128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-65dc9520-6d31-4160-9f38-a37dcab0760d.info Jul 08 18:32:35 devstack sudo[88128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:36 devstack sudo[88128]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6beb71dc-7d5a-407c-9810-2ceaab00352e tempest-GroupSnapshotsV319Test-1835041529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-65dc9520-6d31-4160-9f38-a37dcab0760d.info" returned: 0 in 0.953s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:36 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-6beb71dc-7d5a-407c-9810-2ceaab00352e tempest-GroupSnapshotsV319Test-1835041529 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-65dc9520-6d31-4160-9f38-a37dcab0760d.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 18:32:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6beb71dc-7d5a-407c-9810-2ceaab00352e tempest-GroupSnapshotsV319Test-1835041529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-65dc9520-6d31-4160-9f38-a37dcab0760d.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:36 devstack sudo[88133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-65dc9520-6d31-4160-9f38-a37dcab0760d.info Jul 08 18:32:36 devstack sudo[88133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:37 devstack sudo[88133]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6beb71dc-7d5a-407c-9810-2ceaab00352e tempest-GroupSnapshotsV319Test-1835041529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-65dc9520-6d31-4160-9f38-a37dcab0760d.info" returned: 0 in 1.032s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6beb71dc-7d5a-407c-9810-2ceaab00352e tempest-GroupSnapshotsV319Test-1835041529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.690s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:32:37 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-6beb71dc-7d5a-407c-9810-2ceaab00352e tempest-GroupSnapshotsV319Test-1835041529 None] group_snapshot 133b49b4-71ad-4f2f-a236-862fae663658: created successfully Jul 08 18:32:38 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-c2795681-52de-4f19-827d-5982bb5a24f3 tempest-GroupSnapshotsV319Test-1835041529 None] group_snapshot 133b49b4-71ad-4f2f-a236-862fae663658: deleting Jul 08 18:32:38 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c2795681-52de-4f19-827d-5982bb5a24f3 tempest-GroupSnapshotsV319Test-1835041529 None] group_snapshot 133b49b4-71ad-4f2f-a236-862fae663658: deleting {{(pid=86873) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 08 18:32:38 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-c2795681-52de-4f19-827d-5982bb5a24f3 tempest-GroupSnapshotsV319Test-1835041529 None] Acquiring lock "cinder-quobyte-65dc9520-6d31-4160-9f38-a37dcab0760d" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:32:39 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-c2795681-52de-4f19-827d-5982bb5a24f3 tempest-GroupSnapshotsV319Test-1835041529 None] Lock "cinder-quobyte-65dc9520-6d31-4160-9f38-a37dcab0760d" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:32:39 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-c2795681-52de-4f19-827d-5982bb5a24f3 tempest-GroupSnapshotsV319Test-1835041529 None] Acquiring lock "cinder-quobyte-35b4063b-cbd6-4c0c-a983-ba985d706088" by "_delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:32:39 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-c2795681-52de-4f19-827d-5982bb5a24f3 tempest-GroupSnapshotsV319Test-1835041529 None] Lock "cinder-quobyte-35b4063b-cbd6-4c0c-a983-ba985d706088" acquired by "_delete_snapshot" :: waited 0.075s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:32:39 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-c2795681-52de-4f19-827d-5982bb5a24f3 tempest-GroupSnapshotsV319Test-1835041529 None] Deleting offline snapshot 35b4063b-cbd6-4c0c-a983-ba985d706088 of volume 65dc9520-6d31-4160-9f38-a37dcab0760d {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:32:39 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-c2795681-52de-4f19-827d-5982bb5a24f3 tempest-GroupSnapshotsV319Test-1835041529 None] snapshot_file for this snap is: volume-65dc9520-6d31-4160-9f38-a37dcab0760d.35b4063b-cbd6-4c0c-a983-ba985d706088 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:32:39 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4af90b0-0057-4cd7-8c09-59d100d515bb]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:32:39 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c2795681-52de-4f19-827d-5982bb5a24f3 tempest-GroupSnapshotsV319Test-1835041529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-65dc9520-6d31-4160-9f38-a37dcab0760d.35b4063b-cbd6-4c0c-a983-ba985d706088 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:39 devstack sudo[88147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-65dc9520-6d31-4160-9f38-a37dcab0760d.35b4063b-cbd6-4c0c-a983-ba985d706088 Jul 08 18:32:39 devstack sudo[88147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:40 devstack sudo[88147]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c2795681-52de-4f19-827d-5982bb5a24f3 tempest-GroupSnapshotsV319Test-1835041529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-65dc9520-6d31-4160-9f38-a37dcab0760d.35b4063b-cbd6-4c0c-a983-ba985d706088" returned: 0 in 1.024s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:40 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-c2795681-52de-4f19-827d-5982bb5a24f3 tempest-GroupSnapshotsV319Test-1835041529 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65dc9520-6d31-4160-9f38-a37dcab0760d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:32:40 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8d37f8-7315-4955-9d79-214790349995]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:32:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c2795681-52de-4f19-827d-5982bb5a24f3 tempest-GroupSnapshotsV319Test-1835041529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-65dc9520-6d31-4160-9f38-a37dcab0760d {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:40 devstack sudo[88160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-65dc9520-6d31-4160-9f38-a37dcab0760d Jul 08 18:32:40 devstack sudo[88160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:41 devstack sudo[88160]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c2795681-52de-4f19-827d-5982bb5a24f3 tempest-GroupSnapshotsV319Test-1835041529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-65dc9520-6d31-4160-9f38-a37dcab0760d" returned: 0 in 0.853s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c2795681-52de-4f19-827d-5982bb5a24f3 tempest-GroupSnapshotsV319Test-1835041529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-65dc9520-6d31-4160-9f38-a37dcab0760d.35b4063b-cbd6-4c0c-a983-ba985d706088 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:41 devstack sudo[88167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-65dc9520-6d31-4160-9f38-a37dcab0760d.35b4063b-cbd6-4c0c-a983-ba985d706088 Jul 08 18:32:41 devstack sudo[88167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:41 devstack sudo[88167]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c2795681-52de-4f19-827d-5982bb5a24f3 tempest-GroupSnapshotsV319Test-1835041529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-65dc9520-6d31-4160-9f38-a37dcab0760d.35b4063b-cbd6-4c0c-a983-ba985d706088" returned: 0 in 0.841s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c2795681-52de-4f19-827d-5982bb5a24f3 tempest-GroupSnapshotsV319Test-1835041529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-65dc9520-6d31-4160-9f38-a37dcab0760d.35b4063b-cbd6-4c0c-a983-ba985d706088 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:41 devstack sudo[88173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-65dc9520-6d31-4160-9f38-a37dcab0760d.35b4063b-cbd6-4c0c-a983-ba985d706088 Jul 08 18:32:41 devstack sudo[88173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:42 devstack sudo[88173]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c2795681-52de-4f19-827d-5982bb5a24f3 tempest-GroupSnapshotsV319Test-1835041529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-65dc9520-6d31-4160-9f38-a37dcab0760d.35b4063b-cbd6-4c0c-a983-ba985d706088" returned: 0 in 0.685s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:42 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-c2795681-52de-4f19-827d-5982bb5a24f3 tempest-GroupSnapshotsV319Test-1835041529 None] Lock "cinder-quobyte-35b4063b-cbd6-4c0c-a983-ba985d706088" released by "_delete_snapshot" :: held 3.559s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:32:42 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-c2795681-52de-4f19-827d-5982bb5a24f3 tempest-GroupSnapshotsV319Test-1835041529 None] Lock "cinder-quobyte-65dc9520-6d31-4160-9f38-a37dcab0760d" released by "delete_snapshot" :: held 3.647s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:32:42 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:SELECT=34,cinder:UPDATE=38,cinder:DELETE=5,cinder:INSERT=9 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:32:42 devstack cinder-volume[86873]: WARNING cinder.quota [None req-c2795681-52de-4f19-827d-5982bb5a24f3 tempest-GroupSnapshotsV319Test-1835041529 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1444765743 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1444765743, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:32:42 devstack cinder-volume[86873]: WARNING cinder.quota [None req-c2795681-52de-4f19-827d-5982bb5a24f3 tempest-GroupSnapshotsV319Test-1835041529 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1444765743 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1444765743, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:32:42 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-c2795681-52de-4f19-827d-5982bb5a24f3 tempest-GroupSnapshotsV319Test-1835041529 None] Created reservations ['2cbc1f84-e3f8-4c3b-bb08-4159c8fc4bbe', '7dd17b52-f23c-4e26-afdc-bf5f939f8751', '395828e0-d682-4b85-8502-8239291d4d28', '2f231062-55e3-4aaa-b3d0-db456384b2f0'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:32:42 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-c2795681-52de-4f19-827d-5982bb5a24f3 tempest-GroupSnapshotsV319Test-1835041529 None] group_snapshot 133b49b4-71ad-4f2f-a236-862fae663658: deleted successfully Jul 08 18:32:44 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-df6c1762-775b-4675-8219-0deb2fd7d705 tempest-GroupSnapshotsV319Test-1835041529 None] Acquiring lock "cinder-quobyte-65dc9520-6d31-4160-9f38-a37dcab0760d" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:32:44 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-df6c1762-775b-4675-8219-0deb2fd7d705 tempest-GroupSnapshotsV319Test-1835041529 None] Lock "cinder-quobyte-65dc9520-6d31-4160-9f38-a37dcab0760d" acquired by "delete_volume" :: waited 0.042s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:32:44 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[1210878b-0359-4582-90ce-4dc7d0327e7c]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:32:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-df6c1762-775b-4675-8219-0deb2fd7d705 tempest-GroupSnapshotsV319Test-1835041529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-65dc9520-6d31-4160-9f38-a37dcab0760d {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:44 devstack sudo[88233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-65dc9520-6d31-4160-9f38-a37dcab0760d Jul 08 18:32:44 devstack sudo[88233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:45 devstack sudo[88233]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-df6c1762-775b-4675-8219-0deb2fd7d705 tempest-GroupSnapshotsV319Test-1835041529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-65dc9520-6d31-4160-9f38-a37dcab0760d" returned: 0 in 1.142s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-df6c1762-775b-4675-8219-0deb2fd7d705 tempest-GroupSnapshotsV319Test-1835041529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-65dc9520-6d31-4160-9f38-a37dcab0760d {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:45 devstack sudo[88266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-65dc9520-6d31-4160-9f38-a37dcab0760d Jul 08 18:32:45 devstack sudo[88266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:46 devstack sudo[88266]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-df6c1762-775b-4675-8219-0deb2fd7d705 tempest-GroupSnapshotsV319Test-1835041529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-65dc9520-6d31-4160-9f38-a37dcab0760d" returned: 0 in 1.124s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:46 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-df6c1762-775b-4675-8219-0deb2fd7d705 tempest-GroupSnapshotsV319Test-1835041529 None] Lock "cinder-quobyte-65dc9520-6d31-4160-9f38-a37dcab0760d" released by "delete_volume" :: held 2.389s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:32:47 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-df6c1762-775b-4675-8219-0deb2fd7d705 tempest-GroupSnapshotsV319Test-1835041529 None] Created reservations ['adef8e63-620d-4f43-9807-a9ec820530ad'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:32:47 devstack cinder-volume[86873]: WARNING cinder.quota [None req-df6c1762-775b-4675-8219-0deb2fd7d705 tempest-GroupSnapshotsV319Test-1835041529 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1444765743 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1444765743, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:32:47 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-df6c1762-775b-4675-8219-0deb2fd7d705 tempest-GroupSnapshotsV319Test-1835041529 None] Created reservations ['bfdc60e1-a32b-4e43-9db7-a9fa978257cb', 'ce35e903-ff37-44f3-878f-7474a07521f3', 'e39797d3-2276-4ade-a0c5-58134d10c454', 'ffcc09ee-dc60-4285-a7a8-3afc538c657c'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:32:47 devstack cinder-volume[86873]: WARNING py.warnings [req-f91bfe63-03d3-44bb-9494-f9695c174bea req-2a7cd272-5050-4180-980d-94eff93f2d82 tempest-AttachVolumeShelveTestJSON-2087706243 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Jul 08 18:32:47 devstack cinder-volume[86873]: .first() Jul 08 18:32:47 devstack cinder-volume[86873]: Jul 08 18:32:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-f91bfe63-03d3-44bb-9494-f9695c174bea req-2a7cd272-5050-4180-980d-94eff93f2d82 tempest-AttachVolumeShelveTestJSON-2087706243 None] No connector for attachment 05cefe01-2424-43a0-8860-74766bbdbddf; skipping storage backend terminate_connection call. {{(pid=86873) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 08 18:32:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-f91bfe63-03d3-44bb-9494-f9695c174bea req-2a7cd272-5050-4180-980d-94eff93f2d82 tempest-AttachVolumeShelveTestJSON-2087706243 None] Deleting attachment 05cefe01-2424-43a0-8860-74766bbdbddf. {{(pid=86873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 18:32:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-df6c1762-775b-4675-8219-0deb2fd7d705 tempest-GroupSnapshotsV319Test-1835041529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:32:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-df6c1762-775b-4675-8219-0deb2fd7d705 tempest-GroupSnapshotsV319Test-1835041529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:32:47 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-df6c1762-775b-4675-8219-0deb2fd7d705 tempest-GroupSnapshotsV319Test-1835041529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:32:47 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-df6c1762-775b-4675-8219-0deb2fd7d705 tempest-GroupSnapshotsV319Test-1835041529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:32:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-df6c1762-775b-4675-8219-0deb2fd7d705 tempest-GroupSnapshotsV319Test-1835041529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:32:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-df6c1762-775b-4675-8219-0deb2fd7d705 tempest-GroupSnapshotsV319Test-1835041529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:47 devstack sudo[88271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:32:47 devstack sudo[88271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:48 devstack cinder-volume[86873]: DEBUG oslo_service.periodic_task [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86873) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:32:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:32:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:32:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:32:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:32:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:32:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:48 devstack sudo[88276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:32:48 devstack sudo[88276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:48 devstack sudo[88271]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-df6c1762-775b-4675-8219-0deb2fd7d705 tempest-GroupSnapshotsV319Test-1835041529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 1.215s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:48 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-df6c1762-775b-4675-8219-0deb2fd7d705 tempest-GroupSnapshotsV319Test-1835041529 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:32:48 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-df6c1762-775b-4675-8219-0deb2fd7d705 tempest-GroupSnapshotsV319Test-1835041529 None] Delete group completed successfully. Jul 08 18:32:49 devstack sudo[88276]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 1.457s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:49 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:32:49 devstack cinder-volume[86873]: DEBUG oslo_service.periodic_task [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running periodic task VolumeManager._thread_info {{(pid=86873) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:32:49 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] thread count: 8 {{(pid=86873) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:32:49 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] thread info: [<_MainThread(MainThread, started 138577734545536)>, , , , , , , ] {{(pid=86873) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:32:51 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb6fb4dd-2d95-452a-95cd-f6b55e87566d tempest-DeleteServersTestJSON-1121967964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:32:51 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-cb6fb4dd-2d95-452a-95cd-f6b55e87566d tempest-DeleteServersTestJSON-1121967964 None] Flow 'volume_create_manager' (2c9bcc48-b893-486f-8bc4-c8caef6a8c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:32:51 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-cb6fb4dd-2d95-452a-95cd-f6b55e87566d tempest-DeleteServersTestJSON-1121967964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9b19187-f00d-4a9d-8ff7-353d8166ec29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:51 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-cb6fb4dd-2d95-452a-95cd-f6b55e87566d tempest-DeleteServersTestJSON-1121967964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9b19187-f00d-4a9d-8ff7-353d8166ec29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:32:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1799250029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=318666b0-ced9-4adf-9b3b-47101458f3d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='953d6e262c1146a390825ab452fcb7f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:32:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:32:51Z,use_quota=True,user_id='0116c1fff7f24530b1dbe08026c48737',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:51 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-cb6fb4dd-2d95-452a-95cd-f6b55e87566d tempest-DeleteServersTestJSON-1121967964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a482f07-0aee-4dbf-9fcf-bd2770d7edd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:51 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-cb6fb4dd-2d95-452a-95cd-f6b55e87566d tempest-DeleteServersTestJSON-1121967964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a482f07-0aee-4dbf-9fcf-bd2770d7edd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:51 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-cb6fb4dd-2d95-452a-95cd-f6b55e87566d tempest-DeleteServersTestJSON-1121967964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54d52415-be86-4db3-a0ed-46bf3aeba54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:51 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-cb6fb4dd-2d95-452a-95cd-f6b55e87566d tempest-DeleteServersTestJSON-1121967964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54d52415-be86-4db3-a0ed-46bf3aeba54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '318666b0-ced9-4adf-9b3b-47101458f3d6', 'volume_name': 'volume-318666b0-ced9-4adf-9b3b-47101458f3d6', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:51 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-cb6fb4dd-2d95-452a-95cd-f6b55e87566d tempest-DeleteServersTestJSON-1121967964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4adde124-561a-47f0-aec0-4119a1039a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:51 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-cb6fb4dd-2d95-452a-95cd-f6b55e87566d tempest-DeleteServersTestJSON-1121967964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4adde124-561a-47f0-aec0-4119a1039a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:51 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-cb6fb4dd-2d95-452a-95cd-f6b55e87566d tempest-DeleteServersTestJSON-1121967964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd07ee7e-491f-4232-a262-b43ab3cb7af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:51 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-cb6fb4dd-2d95-452a-95cd-f6b55e87566d tempest-DeleteServersTestJSON-1121967964 None] Volume 318666b0-ced9-4adf-9b3b-47101458f3d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-318666b0-ced9-4adf-9b3b-47101458f3d6', 'volume_size': 1} Jul 08 18:32:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-cb6fb4dd-2d95-452a-95cd-f6b55e87566d tempest-DeleteServersTestJSON-1121967964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:32:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-cb6fb4dd-2d95-452a-95cd-f6b55e87566d tempest-DeleteServersTestJSON-1121967964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:32:51 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-cb6fb4dd-2d95-452a-95cd-f6b55e87566d tempest-DeleteServersTestJSON-1121967964 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:32:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1799250029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=318666b0-ced9-4adf-9b3b-47101458f3d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='953d6e262c1146a390825ab452fcb7f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:32:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:32:51Z,use_quota=True,user_id='0116c1fff7f24530b1dbe08026c48737',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:32:51 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-cb6fb4dd-2d95-452a-95cd-f6b55e87566d tempest-DeleteServersTestJSON-1121967964 None] Creating volume 318666b0-ced9-4adf-9b3b-47101458f3d6 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:32:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-cb6fb4dd-2d95-452a-95cd-f6b55e87566d tempest-DeleteServersTestJSON-1121967964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:32:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-cb6fb4dd-2d95-452a-95cd-f6b55e87566d tempest-DeleteServersTestJSON-1121967964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:32:51 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-cb6fb4dd-2d95-452a-95cd-f6b55e87566d tempest-DeleteServersTestJSON-1121967964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:32:51 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-cb6fb4dd-2d95-452a-95cd-f6b55e87566d tempest-DeleteServersTestJSON-1121967964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:32:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-cb6fb4dd-2d95-452a-95cd-f6b55e87566d tempest-DeleteServersTestJSON-1121967964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:32:51 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-cb6fb4dd-2d95-452a-95cd-f6b55e87566d tempest-DeleteServersTestJSON-1121967964 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:32:51 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-cb6fb4dd-2d95-452a-95cd-f6b55e87566d tempest-DeleteServersTestJSON-1121967964 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:32:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-cb6fb4dd-2d95-452a-95cd-f6b55e87566d tempest-DeleteServersTestJSON-1121967964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-318666b0-ced9-4adf-9b3b-47101458f3d6 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:51 devstack sudo[88326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-318666b0-ced9-4adf-9b3b-47101458f3d6 1073741824 Jul 08 18:32:51 devstack sudo[88326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:52 devstack sudo[88326]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-cb6fb4dd-2d95-452a-95cd-f6b55e87566d tempest-DeleteServersTestJSON-1121967964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-318666b0-ced9-4adf-9b3b-47101458f3d6 1073741824" returned: 0 in 1.464s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:53 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-cb6fb4dd-2d95-452a-95cd-f6b55e87566d tempest-DeleteServersTestJSON-1121967964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-318666b0-ced9-4adf-9b3b-47101458f3d6 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:53 devstack sudo[88336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-318666b0-ced9-4adf-9b3b-47101458f3d6 Jul 08 18:32:53 devstack sudo[88336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:54 devstack sudo[88336]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-cb6fb4dd-2d95-452a-95cd-f6b55e87566d tempest-DeleteServersTestJSON-1121967964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-318666b0-ced9-4adf-9b3b-47101458f3d6" returned: 0 in 1.196s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:54 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-cb6fb4dd-2d95-452a-95cd-f6b55e87566d tempest-DeleteServersTestJSON-1121967964 None] <== create_volume: return (2745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:32:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-cb6fb4dd-2d95-452a-95cd-f6b55e87566d tempest-DeleteServersTestJSON-1121967964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.753s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:32:54 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-cb6fb4dd-2d95-452a-95cd-f6b55e87566d tempest-DeleteServersTestJSON-1121967964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd07ee7e-491f-4232-a262-b43ab3cb7af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-318666b0-ced9-4adf-9b3b-47101458f3d6', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:54 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-cb6fb4dd-2d95-452a-95cd-f6b55e87566d tempest-DeleteServersTestJSON-1121967964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99b84c11-4d7a-44bf-9008-0665f130c0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:54 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-cb6fb4dd-2d95-452a-95cd-f6b55e87566d tempest-DeleteServersTestJSON-1121967964 None] Volume volume-318666b0-ced9-4adf-9b3b-47101458f3d6 (318666b0-ced9-4adf-9b3b-47101458f3d6): created successfully Jul 08 18:32:54 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-cb6fb4dd-2d95-452a-95cd-f6b55e87566d tempest-DeleteServersTestJSON-1121967964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99b84c11-4d7a-44bf-9008-0665f130c0bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:54 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-cb6fb4dd-2d95-452a-95cd-f6b55e87566d tempest-DeleteServersTestJSON-1121967964 None] Flow 'volume_create_manager' (2c9bcc48-b893-486f-8bc4-c8caef6a8c4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:32:54 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-cb6fb4dd-2d95-452a-95cd-f6b55e87566d tempest-DeleteServersTestJSON-1121967964 None] Created volume successfully. Jul 08 18:32:59 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-e6eab872-e441-4346-b8a1-af79df27cadc tempest-GroupsV320Test-1472922944 None] Group tempest-GroupsV320Test-Group-1535955322: creating Jul 08 18:32:59 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-e6eab872-e441-4346-b8a1-af79df27cadc tempest-GroupsV320Test-1472922944 None] Group tempest-GroupsV320Test-Group-1535955322: created successfully Jul 08 18:32:59 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-e6eab872-e441-4346-b8a1-af79df27cadc tempest-GroupsV320Test-1472922944 None] Create group completed successfully. Jul 08 18:33:01 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-00e6a859-910f-4ba4-9aea-c2e26b4b88ba tempest-GroupsV320Test-1472922944 None] Created reservations ['9798a0b7-26fa-4413-823f-7acc5298af28'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:33:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-00e6a859-910f-4ba4-9aea-c2e26b4b88ba tempest-GroupsV320Test-1472922944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-00e6a859-910f-4ba4-9aea-c2e26b4b88ba tempest-GroupsV320Test-1472922944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:01 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-00e6a859-910f-4ba4-9aea-c2e26b4b88ba tempest-GroupsV320Test-1472922944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:33:01 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-00e6a859-910f-4ba4-9aea-c2e26b4b88ba tempest-GroupsV320Test-1472922944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:33:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-00e6a859-910f-4ba4-9aea-c2e26b4b88ba tempest-GroupsV320Test-1472922944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-00e6a859-910f-4ba4-9aea-c2e26b4b88ba tempest-GroupsV320Test-1472922944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:01 devstack sudo[88377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:33:01 devstack sudo[88377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-2025979d-447e-46f4-a89a-3f218d3b00d9 req-17e9d0cf-75fa-45f8-b452-ba137afc0687 tempest-DeleteServersTestJSON-1121967964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-2025979d-447e-46f4-a89a-3f218d3b00d9 req-17e9d0cf-75fa-45f8-b452-ba137afc0687 tempest-DeleteServersTestJSON-1121967964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:02 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2e34b4-1745-4409-9b69-61f3229022e5]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:33:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-2025979d-447e-46f4-a89a-3f218d3b00d9 req-17e9d0cf-75fa-45f8-b452-ba137afc0687 tempest-DeleteServersTestJSON-1121967964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-318666b0-ced9-4adf-9b3b-47101458f3d6 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:02 devstack sudo[88390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-318666b0-ced9-4adf-9b3b-47101458f3d6 Jul 08 18:33:02 devstack sudo[88390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:02 devstack sudo[88377]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-00e6a859-910f-4ba4-9aea-c2e26b4b88ba tempest-GroupsV320Test-1472922944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.842s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:02 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-00e6a859-910f-4ba4-9aea-c2e26b4b88ba tempest-GroupsV320Test-1472922944 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:33:02 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-00e6a859-910f-4ba4-9aea-c2e26b4b88ba tempest-GroupsV320Test-1472922944 None] Delete group completed successfully. Jul 08 18:33:03 devstack sudo[88390]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-2025979d-447e-46f4-a89a-3f218d3b00d9 req-17e9d0cf-75fa-45f8-b452-ba137afc0687 tempest-DeleteServersTestJSON-1121967964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-318666b0-ced9-4adf-9b3b-47101458f3d6" returned: 0 in 1.126s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-2025979d-447e-46f4-a89a-3f218d3b00d9 req-17e9d0cf-75fa-45f8-b452-ba137afc0687 tempest-DeleteServersTestJSON-1121967964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.201s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-2025979d-447e-46f4-a89a-3f218d3b00d9 req-17e9d0cf-75fa-45f8-b452-ba137afc0687 tempest-DeleteServersTestJSON-1121967964 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2', 'name': 'volume-318666b0-ced9-4adf-9b3b-47101458f3d6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9623b2b0-925a-43a0-8c58-8676cbf99658', 'enforce_multipath': True} {{(pid=86873) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 18:33:03 devstack cinder-volume[86873]: INFO cinder.volume.manager [req-2025979d-447e-46f4-a89a-3f218d3b00d9 req-17e9d0cf-75fa-45f8-b452-ba137afc0687 tempest-DeleteServersTestJSON-1121967964 None] attachment_update completed successfully. Jul 08 18:33:12 devstack cinder-volume[86873]: INFO cinder.volume.manager [req-1ba946fe-8a59-4209-b113-5c33a7af7db4 req-dbb21c53-16e3-45f1-b5ab-7652cd4e8aa7 tempest-DeleteServersTestJSON-1121967964 None] Terminate volume connection completed successfully. Jul 08 18:33:12 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-1ba946fe-8a59-4209-b113-5c33a7af7db4 req-dbb21c53-16e3-45f1-b5ab-7652cd4e8aa7 tempest-DeleteServersTestJSON-1121967964 None] Deleting attachment 9623b2b0-925a-43a0-8c58-8676cbf99658. {{(pid=86873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 18:33:13 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:SELECT=27,cinder:INSERT=4,cinder:UPDATE=22,cinder:DELETE=1 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:33:18 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b21eee2c-210f-4873-80e3-b7668f64d1cf tempest-DeleteServersTestJSON-1121967964 None] Acquiring lock "cinder-318666b0-ced9-4adf-9b3b-47101458f3d6-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:33:18 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b21eee2c-210f-4873-80e3-b7668f64d1cf tempest-DeleteServersTestJSON-1121967964 None] Lock "cinder-318666b0-ced9-4adf-9b3b-47101458f3d6-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:33:18 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b21eee2c-210f-4873-80e3-b7668f64d1cf tempest-DeleteServersTestJSON-1121967964 None] Acquiring lock "cinder-quobyte-318666b0-ced9-4adf-9b3b-47101458f3d6" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:33:18 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b21eee2c-210f-4873-80e3-b7668f64d1cf tempest-DeleteServersTestJSON-1121967964 None] Lock "cinder-quobyte-318666b0-ced9-4adf-9b3b-47101458f3d6" acquired by "delete_volume" :: waited 0.035s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:33:18 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb850ab-6ab2-4937-993b-d57c3cdcbb5a]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:33:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b21eee2c-210f-4873-80e3-b7668f64d1cf tempest-DeleteServersTestJSON-1121967964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-318666b0-ced9-4adf-9b3b-47101458f3d6 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:18 devstack sudo[89000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-318666b0-ced9-4adf-9b3b-47101458f3d6 Jul 08 18:33:18 devstack sudo[89000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:19 devstack sudo[89000]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:19 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b21eee2c-210f-4873-80e3-b7668f64d1cf tempest-DeleteServersTestJSON-1121967964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-318666b0-ced9-4adf-9b3b-47101458f3d6" returned: 0 in 1.247s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:19 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b21eee2c-210f-4873-80e3-b7668f64d1cf tempest-DeleteServersTestJSON-1121967964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-318666b0-ced9-4adf-9b3b-47101458f3d6 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:19 devstack sudo[89021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-318666b0-ced9-4adf-9b3b-47101458f3d6 Jul 08 18:33:19 devstack sudo[89021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:20 devstack sudo[89021]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b21eee2c-210f-4873-80e3-b7668f64d1cf tempest-DeleteServersTestJSON-1121967964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-318666b0-ced9-4adf-9b3b-47101458f3d6" returned: 0 in 1.203s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:20 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b21eee2c-210f-4873-80e3-b7668f64d1cf tempest-DeleteServersTestJSON-1121967964 None] Lock "cinder-quobyte-318666b0-ced9-4adf-9b3b-47101458f3d6" released by "delete_volume" :: held 2.530s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:33:20 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-b21eee2c-210f-4873-80e3-b7668f64d1cf tempest-DeleteServersTestJSON-1121967964 None] Created reservations ['baddc427-5982-408a-89dc-e9d41885789c', '6baa26f9-db4f-49cc-bd56-439ebd18cf25', 'f11c3945-c707-4355-9671-ff46e318396c', '701848af-196f-445f-9a36-c7339a4ba17d'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:33:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b21eee2c-210f-4873-80e3-b7668f64d1cf tempest-DeleteServersTestJSON-1121967964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b21eee2c-210f-4873-80e3-b7668f64d1cf tempest-DeleteServersTestJSON-1121967964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:21 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b21eee2c-210f-4873-80e3-b7668f64d1cf tempest-DeleteServersTestJSON-1121967964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:33:21 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b21eee2c-210f-4873-80e3-b7668f64d1cf tempest-DeleteServersTestJSON-1121967964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:33:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b21eee2c-210f-4873-80e3-b7668f64d1cf tempest-DeleteServersTestJSON-1121967964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b21eee2c-210f-4873-80e3-b7668f64d1cf tempest-DeleteServersTestJSON-1121967964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:21 devstack sudo[89068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:33:21 devstack sudo[89068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:22 devstack sudo[89068]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b21eee2c-210f-4873-80e3-b7668f64d1cf tempest-DeleteServersTestJSON-1121967964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 1.426s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:22 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-b21eee2c-210f-4873-80e3-b7668f64d1cf tempest-DeleteServersTestJSON-1121967964 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:33:22 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-b21eee2c-210f-4873-80e3-b7668f64d1cf tempest-DeleteServersTestJSON-1121967964 None] Deleted volume successfully. Jul 08 18:33:22 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b21eee2c-210f-4873-80e3-b7668f64d1cf tempest-DeleteServersTestJSON-1121967964 None] Lock "cinder-318666b0-ced9-4adf-9b3b-47101458f3d6-delete_volume" released by "delete_volume" :: held 4.497s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:33:25 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:SELECT=53,cinder:UPDATE=43,cinder:DELETE=1,cinder:INSERT=10 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:33:25 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-1977146c-43dc-47b1-9a15-c09ea71cf5ec tempest-VolumeQuotasAdminTestJSON-1120566736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:33:25 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1977146c-43dc-47b1-9a15-c09ea71cf5ec tempest-VolumeQuotasAdminTestJSON-1120566736 None] Flow 'volume_create_manager' (942b8e94-7c66-4f40-904e-d96aded55617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:33:25 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1977146c-43dc-47b1-9a15-c09ea71cf5ec tempest-VolumeQuotasAdminTestJSON-1120566736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3499bd0-122d-42fd-8838-166606c2e2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:25 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1977146c-43dc-47b1-9a15-c09ea71cf5ec tempest-VolumeQuotasAdminTestJSON-1120566736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3499bd0-122d-42fd-8838-166606c2e2b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1965235337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b284e7fa-2db0-42c1-a414-52e42e5fc17b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='743ff8c579b14ff68fdfdd504e64be30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:33:26Z,use_quota=True,user_id='e4e6d8ad9310491e8a32aab386aad48e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:25 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1977146c-43dc-47b1-9a15-c09ea71cf5ec tempest-VolumeQuotasAdminTestJSON-1120566736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2be1e440-472a-4a37-a087-9d9441c3cea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:25 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1977146c-43dc-47b1-9a15-c09ea71cf5ec tempest-VolumeQuotasAdminTestJSON-1120566736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2be1e440-472a-4a37-a087-9d9441c3cea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:25 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1977146c-43dc-47b1-9a15-c09ea71cf5ec tempest-VolumeQuotasAdminTestJSON-1120566736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (619c1710-fdc2-458c-8cb2-4c4cc371bc24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:25 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1977146c-43dc-47b1-9a15-c09ea71cf5ec tempest-VolumeQuotasAdminTestJSON-1120566736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (619c1710-fdc2-458c-8cb2-4c4cc371bc24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b284e7fa-2db0-42c1-a414-52e42e5fc17b', 'volume_name': 'volume-b284e7fa-2db0-42c1-a414-52e42e5fc17b', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:25 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1977146c-43dc-47b1-9a15-c09ea71cf5ec tempest-VolumeQuotasAdminTestJSON-1120566736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6adfb04f-90f3-4c07-9185-9dcfe93ae7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:25 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1977146c-43dc-47b1-9a15-c09ea71cf5ec tempest-VolumeQuotasAdminTestJSON-1120566736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6adfb04f-90f3-4c07-9185-9dcfe93ae7db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:25 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1977146c-43dc-47b1-9a15-c09ea71cf5ec tempest-VolumeQuotasAdminTestJSON-1120566736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (457cc8d6-027d-4cc7-99cf-637a36090aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:25 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-1977146c-43dc-47b1-9a15-c09ea71cf5ec tempest-VolumeQuotasAdminTestJSON-1120566736 None] Volume b284e7fa-2db0-42c1-a414-52e42e5fc17b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b284e7fa-2db0-42c1-a414-52e42e5fc17b', 'volume_size': 1} Jul 08 18:33:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1977146c-43dc-47b1-9a15-c09ea71cf5ec tempest-VolumeQuotasAdminTestJSON-1120566736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1977146c-43dc-47b1-9a15-c09ea71cf5ec tempest-VolumeQuotasAdminTestJSON-1120566736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:25 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-1977146c-43dc-47b1-9a15-c09ea71cf5ec tempest-VolumeQuotasAdminTestJSON-1120566736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1965235337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b284e7fa-2db0-42c1-a414-52e42e5fc17b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='743ff8c579b14ff68fdfdd504e64be30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:33:26Z,use_quota=True,user_id='e4e6d8ad9310491e8a32aab386aad48e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:33:25 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-1977146c-43dc-47b1-9a15-c09ea71cf5ec tempest-VolumeQuotasAdminTestJSON-1120566736 None] Creating volume b284e7fa-2db0-42c1-a414-52e42e5fc17b {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:33:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1977146c-43dc-47b1-9a15-c09ea71cf5ec tempest-VolumeQuotasAdminTestJSON-1120566736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1977146c-43dc-47b1-9a15-c09ea71cf5ec tempest-VolumeQuotasAdminTestJSON-1120566736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:25 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-1977146c-43dc-47b1-9a15-c09ea71cf5ec tempest-VolumeQuotasAdminTestJSON-1120566736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:33:25 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-1977146c-43dc-47b1-9a15-c09ea71cf5ec tempest-VolumeQuotasAdminTestJSON-1120566736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:33:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1977146c-43dc-47b1-9a15-c09ea71cf5ec tempest-VolumeQuotasAdminTestJSON-1120566736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:25 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-1977146c-43dc-47b1-9a15-c09ea71cf5ec tempest-VolumeQuotasAdminTestJSON-1120566736 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:33:25 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-1977146c-43dc-47b1-9a15-c09ea71cf5ec tempest-VolumeQuotasAdminTestJSON-1120566736 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:33:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1977146c-43dc-47b1-9a15-c09ea71cf5ec tempest-VolumeQuotasAdminTestJSON-1120566736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b284e7fa-2db0-42c1-a414-52e42e5fc17b 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:26 devstack sudo[89126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b284e7fa-2db0-42c1-a414-52e42e5fc17b 1073741824 Jul 08 18:33:26 devstack sudo[89126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:27 devstack sudo[89126]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1977146c-43dc-47b1-9a15-c09ea71cf5ec tempest-VolumeQuotasAdminTestJSON-1120566736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b284e7fa-2db0-42c1-a414-52e42e5fc17b 1073741824" returned: 0 in 1.744s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1977146c-43dc-47b1-9a15-c09ea71cf5ec tempest-VolumeQuotasAdminTestJSON-1120566736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b284e7fa-2db0-42c1-a414-52e42e5fc17b {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:27 devstack sudo[89135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b284e7fa-2db0-42c1-a414-52e42e5fc17b Jul 08 18:33:27 devstack sudo[89135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:29 devstack sudo[89135]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1977146c-43dc-47b1-9a15-c09ea71cf5ec tempest-VolumeQuotasAdminTestJSON-1120566736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b284e7fa-2db0-42c1-a414-52e42e5fc17b" returned: 0 in 1.378s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:29 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-1977146c-43dc-47b1-9a15-c09ea71cf5ec tempest-VolumeQuotasAdminTestJSON-1120566736 None] <== create_volume: return (3251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:33:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1977146c-43dc-47b1-9a15-c09ea71cf5ec tempest-VolumeQuotasAdminTestJSON-1120566736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.256s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:29 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1977146c-43dc-47b1-9a15-c09ea71cf5ec tempest-VolumeQuotasAdminTestJSON-1120566736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (457cc8d6-027d-4cc7-99cf-637a36090aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b284e7fa-2db0-42c1-a414-52e42e5fc17b', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:29 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1977146c-43dc-47b1-9a15-c09ea71cf5ec tempest-VolumeQuotasAdminTestJSON-1120566736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eac6614a-647d-4342-90fc-a9c9e3cb3970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:29 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-1977146c-43dc-47b1-9a15-c09ea71cf5ec tempest-VolumeQuotasAdminTestJSON-1120566736 None] Volume volume-b284e7fa-2db0-42c1-a414-52e42e5fc17b (b284e7fa-2db0-42c1-a414-52e42e5fc17b): created successfully Jul 08 18:33:29 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1977146c-43dc-47b1-9a15-c09ea71cf5ec tempest-VolumeQuotasAdminTestJSON-1120566736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eac6614a-647d-4342-90fc-a9c9e3cb3970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:29 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1977146c-43dc-47b1-9a15-c09ea71cf5ec tempest-VolumeQuotasAdminTestJSON-1120566736 None] Flow 'volume_create_manager' (942b8e94-7c66-4f40-904e-d96aded55617) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:33:29 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-1977146c-43dc-47b1-9a15-c09ea71cf5ec tempest-VolumeQuotasAdminTestJSON-1120566736 None] Created volume successfully. Jul 08 18:33:30 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-78931e70-fc42-41c4-9efb-ddaad6421acc tempest-VolumeQuotasAdminTestJSON-1120566736 None] Acquiring lock "cinder-b284e7fa-2db0-42c1-a414-52e42e5fc17b-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:33:30 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-78931e70-fc42-41c4-9efb-ddaad6421acc tempest-VolumeQuotasAdminTestJSON-1120566736 None] Lock "cinder-b284e7fa-2db0-42c1-a414-52e42e5fc17b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:33:30 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-78931e70-fc42-41c4-9efb-ddaad6421acc tempest-VolumeQuotasAdminTestJSON-1120566736 None] Acquiring lock "cinder-quobyte-b284e7fa-2db0-42c1-a414-52e42e5fc17b" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:33:30 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-78931e70-fc42-41c4-9efb-ddaad6421acc tempest-VolumeQuotasAdminTestJSON-1120566736 None] Lock "cinder-quobyte-b284e7fa-2db0-42c1-a414-52e42e5fc17b" acquired by "delete_volume" :: waited 0.068s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:33:30 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5abdc9-2ed6-493b-b9f7-0e9665174810]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:33:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-78931e70-fc42-41c4-9efb-ddaad6421acc tempest-VolumeQuotasAdminTestJSON-1120566736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b284e7fa-2db0-42c1-a414-52e42e5fc17b {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:30 devstack sudo[89143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b284e7fa-2db0-42c1-a414-52e42e5fc17b Jul 08 18:33:30 devstack sudo[89143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:32 devstack sudo[89143]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:32 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-78931e70-fc42-41c4-9efb-ddaad6421acc tempest-VolumeQuotasAdminTestJSON-1120566736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b284e7fa-2db0-42c1-a414-52e42e5fc17b" returned: 0 in 1.825s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:32 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-78931e70-fc42-41c4-9efb-ddaad6421acc tempest-VolumeQuotasAdminTestJSON-1120566736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b284e7fa-2db0-42c1-a414-52e42e5fc17b {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:32 devstack sudo[89151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b284e7fa-2db0-42c1-a414-52e42e5fc17b Jul 08 18:33:32 devstack sudo[89151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:33 devstack sudo[89151]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-78931e70-fc42-41c4-9efb-ddaad6421acc tempest-VolumeQuotasAdminTestJSON-1120566736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b284e7fa-2db0-42c1-a414-52e42e5fc17b" returned: 0 in 0.896s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:33 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-78931e70-fc42-41c4-9efb-ddaad6421acc tempest-VolumeQuotasAdminTestJSON-1120566736 None] Lock "cinder-quobyte-b284e7fa-2db0-42c1-a414-52e42e5fc17b" released by "delete_volume" :: held 2.801s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:33:33 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-78931e70-fc42-41c4-9efb-ddaad6421acc tempest-VolumeQuotasAdminTestJSON-1120566736 None] Created reservations ['61951aa5-9979-456c-9ce4-af9043070454', 'dfbddbb3-6bf4-4602-bdf5-213f175bf18f', '6126dda8-c5b7-48ea-a863-07a04f177918', 'e6e7a511-7b72-4d58-884e-38689f11c66a'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:33:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-78931e70-fc42-41c4-9efb-ddaad6421acc tempest-VolumeQuotasAdminTestJSON-1120566736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-78931e70-fc42-41c4-9efb-ddaad6421acc tempest-VolumeQuotasAdminTestJSON-1120566736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:33 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-78931e70-fc42-41c4-9efb-ddaad6421acc tempest-VolumeQuotasAdminTestJSON-1120566736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:33:33 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-78931e70-fc42-41c4-9efb-ddaad6421acc tempest-VolumeQuotasAdminTestJSON-1120566736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:33:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-78931e70-fc42-41c4-9efb-ddaad6421acc tempest-VolumeQuotasAdminTestJSON-1120566736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-78931e70-fc42-41c4-9efb-ddaad6421acc tempest-VolumeQuotasAdminTestJSON-1120566736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:33 devstack sudo[89154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:33:33 devstack sudo[89154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:34 devstack sudo[89154]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-78931e70-fc42-41c4-9efb-ddaad6421acc tempest-VolumeQuotasAdminTestJSON-1120566736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.967s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:34 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-78931e70-fc42-41c4-9efb-ddaad6421acc tempest-VolumeQuotasAdminTestJSON-1120566736 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:33:34 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-78931e70-fc42-41c4-9efb-ddaad6421acc tempest-VolumeQuotasAdminTestJSON-1120566736 None] Deleted volume successfully. Jul 08 18:33:34 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-78931e70-fc42-41c4-9efb-ddaad6421acc tempest-VolumeQuotasAdminTestJSON-1120566736 None] Lock "cinder-b284e7fa-2db0-42c1-a414-52e42e5fc17b-delete_volume" released by "delete_volume" :: held 4.228s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:33:34 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe88fe60-a810-4967-98d3-5385403c3748 tempest-VolumeQuotasAdminTestJSON-1120566736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:33:34 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fe88fe60-a810-4967-98d3-5385403c3748 tempest-VolumeQuotasAdminTestJSON-1120566736 None] Flow 'volume_create_manager' (f1684478-7d43-46f2-a489-d40e890a28d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:33:34 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fe88fe60-a810-4967-98d3-5385403c3748 tempest-VolumeQuotasAdminTestJSON-1120566736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a3cc465-7584-4e1f-9109-f49e490dfa6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:34 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fe88fe60-a810-4967-98d3-5385403c3748 tempest-VolumeQuotasAdminTestJSON-1120566736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a3cc465-7584-4e1f-9109-f49e490dfa6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:33:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1894522487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9727a545-97bc-4f50-ae21-a8187b4698d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='743ff8c579b14ff68fdfdd504e64be30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:33:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:33:35Z,use_quota=True,user_id='e4e6d8ad9310491e8a32aab386aad48e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:34 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fe88fe60-a810-4967-98d3-5385403c3748 tempest-VolumeQuotasAdminTestJSON-1120566736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e9e30da-7a7a-4a51-bbfc-0ee605e49219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:34 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fe88fe60-a810-4967-98d3-5385403c3748 tempest-VolumeQuotasAdminTestJSON-1120566736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e9e30da-7a7a-4a51-bbfc-0ee605e49219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:34 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fe88fe60-a810-4967-98d3-5385403c3748 tempest-VolumeQuotasAdminTestJSON-1120566736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f8cf705-407c-4c33-b010-677bd50c9ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:34 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fe88fe60-a810-4967-98d3-5385403c3748 tempest-VolumeQuotasAdminTestJSON-1120566736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f8cf705-407c-4c33-b010-677bd50c9ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9727a545-97bc-4f50-ae21-a8187b4698d2', 'volume_name': 'volume-9727a545-97bc-4f50-ae21-a8187b4698d2', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:34 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fe88fe60-a810-4967-98d3-5385403c3748 tempest-VolumeQuotasAdminTestJSON-1120566736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67458998-661f-4269-b286-770b3bf82dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:34 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fe88fe60-a810-4967-98d3-5385403c3748 tempest-VolumeQuotasAdminTestJSON-1120566736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67458998-661f-4269-b286-770b3bf82dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:34 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fe88fe60-a810-4967-98d3-5385403c3748 tempest-VolumeQuotasAdminTestJSON-1120566736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca4f0c4f-3406-4e22-a2c8-2fe642d69ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:34 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-fe88fe60-a810-4967-98d3-5385403c3748 tempest-VolumeQuotasAdminTestJSON-1120566736 None] Volume 9727a545-97bc-4f50-ae21-a8187b4698d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9727a545-97bc-4f50-ae21-a8187b4698d2', 'volume_size': 1} Jul 08 18:33:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-fe88fe60-a810-4967-98d3-5385403c3748 tempest-VolumeQuotasAdminTestJSON-1120566736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-fe88fe60-a810-4967-98d3-5385403c3748 tempest-VolumeQuotasAdminTestJSON-1120566736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:34 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-fe88fe60-a810-4967-98d3-5385403c3748 tempest-VolumeQuotasAdminTestJSON-1120566736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:33:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1894522487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9727a545-97bc-4f50-ae21-a8187b4698d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='743ff8c579b14ff68fdfdd504e64be30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:33:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:33:35Z,use_quota=True,user_id='e4e6d8ad9310491e8a32aab386aad48e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:33:34 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-fe88fe60-a810-4967-98d3-5385403c3748 tempest-VolumeQuotasAdminTestJSON-1120566736 None] Creating volume 9727a545-97bc-4f50-ae21-a8187b4698d2 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:33:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-fe88fe60-a810-4967-98d3-5385403c3748 tempest-VolumeQuotasAdminTestJSON-1120566736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-fe88fe60-a810-4967-98d3-5385403c3748 tempest-VolumeQuotasAdminTestJSON-1120566736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:34 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-fe88fe60-a810-4967-98d3-5385403c3748 tempest-VolumeQuotasAdminTestJSON-1120566736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:33:34 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-fe88fe60-a810-4967-98d3-5385403c3748 tempest-VolumeQuotasAdminTestJSON-1120566736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:33:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-fe88fe60-a810-4967-98d3-5385403c3748 tempest-VolumeQuotasAdminTestJSON-1120566736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:34 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-fe88fe60-a810-4967-98d3-5385403c3748 tempest-VolumeQuotasAdminTestJSON-1120566736 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:33:34 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-fe88fe60-a810-4967-98d3-5385403c3748 tempest-VolumeQuotasAdminTestJSON-1120566736 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:33:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-fe88fe60-a810-4967-98d3-5385403c3748 tempest-VolumeQuotasAdminTestJSON-1120566736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9727a545-97bc-4f50-ae21-a8187b4698d2 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:35 devstack sudo[89162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9727a545-97bc-4f50-ae21-a8187b4698d2 1073741824 Jul 08 18:33:35 devstack sudo[89162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:36 devstack sudo[89162]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-fe88fe60-a810-4967-98d3-5385403c3748 tempest-VolumeQuotasAdminTestJSON-1120566736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9727a545-97bc-4f50-ae21-a8187b4698d2 1073741824" returned: 0 in 1.061s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-fe88fe60-a810-4967-98d3-5385403c3748 tempest-VolumeQuotasAdminTestJSON-1120566736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9727a545-97bc-4f50-ae21-a8187b4698d2 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:36 devstack sudo[89175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9727a545-97bc-4f50-ae21-a8187b4698d2 Jul 08 18:33:36 devstack sudo[89175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:37 devstack sudo[89175]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-fe88fe60-a810-4967-98d3-5385403c3748 tempest-VolumeQuotasAdminTestJSON-1120566736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9727a545-97bc-4f50-ae21-a8187b4698d2" returned: 0 in 1.009s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:37 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-fe88fe60-a810-4967-98d3-5385403c3748 tempest-VolumeQuotasAdminTestJSON-1120566736 None] <== create_volume: return (2125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:33:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-fe88fe60-a810-4967-98d3-5385403c3748 tempest-VolumeQuotasAdminTestJSON-1120566736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.128s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:37 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fe88fe60-a810-4967-98d3-5385403c3748 tempest-VolumeQuotasAdminTestJSON-1120566736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca4f0c4f-3406-4e22-a2c8-2fe642d69ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9727a545-97bc-4f50-ae21-a8187b4698d2', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:37 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fe88fe60-a810-4967-98d3-5385403c3748 tempest-VolumeQuotasAdminTestJSON-1120566736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cdfd75d-5714-4bee-b486-0adb0883aaa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:37 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-fe88fe60-a810-4967-98d3-5385403c3748 tempest-VolumeQuotasAdminTestJSON-1120566736 None] Volume volume-9727a545-97bc-4f50-ae21-a8187b4698d2 (9727a545-97bc-4f50-ae21-a8187b4698d2): created successfully Jul 08 18:33:37 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fe88fe60-a810-4967-98d3-5385403c3748 tempest-VolumeQuotasAdminTestJSON-1120566736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cdfd75d-5714-4bee-b486-0adb0883aaa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:37 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fe88fe60-a810-4967-98d3-5385403c3748 tempest-VolumeQuotasAdminTestJSON-1120566736 None] Flow 'volume_create_manager' (f1684478-7d43-46f2-a489-d40e890a28d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:33:37 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-fe88fe60-a810-4967-98d3-5385403c3748 tempest-VolumeQuotasAdminTestJSON-1120566736 None] Created volume successfully. Jul 08 18:33:39 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-a73ab8f9-d75a-4d27-915a-9ebe49376302 tempest-VolumeQuotasAdminTestJSON-88605631 None] Transfer volume completed successfully. Jul 08 18:33:40 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-e3eff1a8-37e9-4bd2-a956-6b8e9c16d0e9 tempest-VolumeQuotasAdminTestJSON-48100063 None] Acquiring lock "cinder-9727a545-97bc-4f50-ae21-a8187b4698d2-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:33:40 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-e3eff1a8-37e9-4bd2-a956-6b8e9c16d0e9 tempest-VolumeQuotasAdminTestJSON-48100063 None] Lock "cinder-9727a545-97bc-4f50-ae21-a8187b4698d2-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:33:40 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-e3eff1a8-37e9-4bd2-a956-6b8e9c16d0e9 tempest-VolumeQuotasAdminTestJSON-48100063 None] Acquiring lock "cinder-quobyte-9727a545-97bc-4f50-ae21-a8187b4698d2" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:33:40 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-e3eff1a8-37e9-4bd2-a956-6b8e9c16d0e9 tempest-VolumeQuotasAdminTestJSON-48100063 None] Lock "cinder-quobyte-9727a545-97bc-4f50-ae21-a8187b4698d2" acquired by "delete_volume" :: waited 0.023s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:33:40 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[09aa4a8e-6194-44bb-8eac-1619994f581a]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:33:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e3eff1a8-37e9-4bd2-a956-6b8e9c16d0e9 tempest-VolumeQuotasAdminTestJSON-48100063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9727a545-97bc-4f50-ae21-a8187b4698d2 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:41 devstack sudo[89221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9727a545-97bc-4f50-ae21-a8187b4698d2 Jul 08 18:33:41 devstack sudo[89221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:42 devstack sudo[89221]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e3eff1a8-37e9-4bd2-a956-6b8e9c16d0e9 tempest-VolumeQuotasAdminTestJSON-48100063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9727a545-97bc-4f50-ae21-a8187b4698d2" returned: 0 in 1.345s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e3eff1a8-37e9-4bd2-a956-6b8e9c16d0e9 tempest-VolumeQuotasAdminTestJSON-48100063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9727a545-97bc-4f50-ae21-a8187b4698d2 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:42 devstack sudo[89228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9727a545-97bc-4f50-ae21-a8187b4698d2 Jul 08 18:33:42 devstack sudo[89228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:43 devstack sudo[89228]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e3eff1a8-37e9-4bd2-a956-6b8e9c16d0e9 tempest-VolumeQuotasAdminTestJSON-48100063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9727a545-97bc-4f50-ae21-a8187b4698d2" returned: 0 in 0.887s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:43 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-e3eff1a8-37e9-4bd2-a956-6b8e9c16d0e9 tempest-VolumeQuotasAdminTestJSON-48100063 None] Lock "cinder-quobyte-9727a545-97bc-4f50-ae21-a8187b4698d2" released by "delete_volume" :: held 2.314s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:33:43 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-e3eff1a8-37e9-4bd2-a956-6b8e9c16d0e9 tempest-VolumeQuotasAdminTestJSON-48100063 None] Created reservations ['246e14a9-847a-4c37-8ba2-c44cb5a412b7', '35bc580c-7f7a-45e0-9a79-c2d9c647be28', '2e26cb36-d62a-405c-a2fe-c7fa2def15e9', '3630e52e-ea9f-4b9a-9107-4e6e27a49fb5'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:33:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-e3eff1a8-37e9-4bd2-a956-6b8e9c16d0e9 tempest-VolumeQuotasAdminTestJSON-48100063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-e3eff1a8-37e9-4bd2-a956-6b8e9c16d0e9 tempest-VolumeQuotasAdminTestJSON-48100063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:43 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-e3eff1a8-37e9-4bd2-a956-6b8e9c16d0e9 tempest-VolumeQuotasAdminTestJSON-48100063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:33:43 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-e3eff1a8-37e9-4bd2-a956-6b8e9c16d0e9 tempest-VolumeQuotasAdminTestJSON-48100063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:33:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-e3eff1a8-37e9-4bd2-a956-6b8e9c16d0e9 tempest-VolumeQuotasAdminTestJSON-48100063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e3eff1a8-37e9-4bd2-a956-6b8e9c16d0e9 tempest-VolumeQuotasAdminTestJSON-48100063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:43 devstack sudo[89231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:33:43 devstack sudo[89231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:43 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-c44dd371-421d-4d2f-b0e0-ae88ffc37af6 tempest-ServerRescueNegativeTestJSON-1453280047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:33:43 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c44dd371-421d-4d2f-b0e0-ae88ffc37af6 tempest-ServerRescueNegativeTestJSON-1453280047 None] Flow 'volume_create_manager' (becf50dc-f93a-47ea-87f9-c0f8b7c41929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:33:43 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c44dd371-421d-4d2f-b0e0-ae88ffc37af6 tempest-ServerRescueNegativeTestJSON-1453280047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbcd90b7-752f-495c-bfd9-0b2eb17f89e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:43 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c44dd371-421d-4d2f-b0e0-ae88ffc37af6 tempest-ServerRescueNegativeTestJSON-1453280047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbcd90b7-752f-495c-bfd9-0b2eb17f89e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:33:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1592215956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48230ed5-86b5-46ad-ac56-90b885a24a11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5aaede3a43b94b72b1fdf8012e350243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:33:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:33:44Z,use_quota=True,user_id='a08eea06d3a24aea8aca3e87bd78f3f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:43 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c44dd371-421d-4d2f-b0e0-ae88ffc37af6 tempest-ServerRescueNegativeTestJSON-1453280047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08565418-f7ce-4d4d-9d8b-6cc0eeaf5fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:43 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c44dd371-421d-4d2f-b0e0-ae88ffc37af6 tempest-ServerRescueNegativeTestJSON-1453280047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08565418-f7ce-4d4d-9d8b-6cc0eeaf5fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:43 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c44dd371-421d-4d2f-b0e0-ae88ffc37af6 tempest-ServerRescueNegativeTestJSON-1453280047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8f55130-42d5-458d-8f8d-76b3e2c7b435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:43 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c44dd371-421d-4d2f-b0e0-ae88ffc37af6 tempest-ServerRescueNegativeTestJSON-1453280047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8f55130-42d5-458d-8f8d-76b3e2c7b435) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48230ed5-86b5-46ad-ac56-90b885a24a11', 'volume_name': 'volume-48230ed5-86b5-46ad-ac56-90b885a24a11', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:43 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c44dd371-421d-4d2f-b0e0-ae88ffc37af6 tempest-ServerRescueNegativeTestJSON-1453280047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f897b92-b22b-42e5-b9cf-a0afdbb77177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:43 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c44dd371-421d-4d2f-b0e0-ae88ffc37af6 tempest-ServerRescueNegativeTestJSON-1453280047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f897b92-b22b-42e5-b9cf-a0afdbb77177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:43 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c44dd371-421d-4d2f-b0e0-ae88ffc37af6 tempest-ServerRescueNegativeTestJSON-1453280047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeb702ef-dc74-41ec-adfc-d2539af4d850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:43 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-c44dd371-421d-4d2f-b0e0-ae88ffc37af6 tempest-ServerRescueNegativeTestJSON-1453280047 None] Volume 48230ed5-86b5-46ad-ac56-90b885a24a11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48230ed5-86b5-46ad-ac56-90b885a24a11', 'volume_size': 1} Jul 08 18:33:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c44dd371-421d-4d2f-b0e0-ae88ffc37af6 tempest-ServerRescueNegativeTestJSON-1453280047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c44dd371-421d-4d2f-b0e0-ae88ffc37af6 tempest-ServerRescueNegativeTestJSON-1453280047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:43 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c44dd371-421d-4d2f-b0e0-ae88ffc37af6 tempest-ServerRescueNegativeTestJSON-1453280047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:33:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1592215956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48230ed5-86b5-46ad-ac56-90b885a24a11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5aaede3a43b94b72b1fdf8012e350243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:33:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:33:44Z,use_quota=True,user_id='a08eea06d3a24aea8aca3e87bd78f3f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:33:43 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-c44dd371-421d-4d2f-b0e0-ae88ffc37af6 tempest-ServerRescueNegativeTestJSON-1453280047 None] Creating volume 48230ed5-86b5-46ad-ac56-90b885a24a11 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:33:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c44dd371-421d-4d2f-b0e0-ae88ffc37af6 tempest-ServerRescueNegativeTestJSON-1453280047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c44dd371-421d-4d2f-b0e0-ae88ffc37af6 tempest-ServerRescueNegativeTestJSON-1453280047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:43 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c44dd371-421d-4d2f-b0e0-ae88ffc37af6 tempest-ServerRescueNegativeTestJSON-1453280047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:33:43 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c44dd371-421d-4d2f-b0e0-ae88ffc37af6 tempest-ServerRescueNegativeTestJSON-1453280047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:33:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c44dd371-421d-4d2f-b0e0-ae88ffc37af6 tempest-ServerRescueNegativeTestJSON-1453280047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:43 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c44dd371-421d-4d2f-b0e0-ae88ffc37af6 tempest-ServerRescueNegativeTestJSON-1453280047 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:33:43 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-c44dd371-421d-4d2f-b0e0-ae88ffc37af6 tempest-ServerRescueNegativeTestJSON-1453280047 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:33:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c44dd371-421d-4d2f-b0e0-ae88ffc37af6 tempest-ServerRescueNegativeTestJSON-1453280047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-48230ed5-86b5-46ad-ac56-90b885a24a11 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:43 devstack sudo[89233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-48230ed5-86b5-46ad-ac56-90b885a24a11 1073741824 Jul 08 18:33:43 devstack sudo[89233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:44 devstack sudo[89231]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e3eff1a8-37e9-4bd2-a956-6b8e9c16d0e9 tempest-VolumeQuotasAdminTestJSON-48100063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 1.213s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:44 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-e3eff1a8-37e9-4bd2-a956-6b8e9c16d0e9 tempest-VolumeQuotasAdminTestJSON-48100063 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:33:44 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-e3eff1a8-37e9-4bd2-a956-6b8e9c16d0e9 tempest-VolumeQuotasAdminTestJSON-48100063 None] Deleted volume successfully. Jul 08 18:33:44 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-e3eff1a8-37e9-4bd2-a956-6b8e9c16d0e9 tempest-VolumeQuotasAdminTestJSON-48100063 None] Lock "cinder-9727a545-97bc-4f50-ae21-a8187b4698d2-delete_volume" released by "delete_volume" :: held 3.933s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:33:45 devstack sudo[89233]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c44dd371-421d-4d2f-b0e0-ae88ffc37af6 tempest-ServerRescueNegativeTestJSON-1453280047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-48230ed5-86b5-46ad-ac56-90b885a24a11 1073741824" returned: 0 in 1.208s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c44dd371-421d-4d2f-b0e0-ae88ffc37af6 tempest-ServerRescueNegativeTestJSON-1453280047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-48230ed5-86b5-46ad-ac56-90b885a24a11 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:45 devstack sudo[89240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-48230ed5-86b5-46ad-ac56-90b885a24a11 Jul 08 18:33:45 devstack sudo[89240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:46 devstack sudo[89240]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c44dd371-421d-4d2f-b0e0-ae88ffc37af6 tempest-ServerRescueNegativeTestJSON-1453280047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-48230ed5-86b5-46ad-ac56-90b885a24a11" returned: 0 in 1.350s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:46 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c44dd371-421d-4d2f-b0e0-ae88ffc37af6 tempest-ServerRescueNegativeTestJSON-1453280047 None] <== create_volume: return (2658ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:33:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c44dd371-421d-4d2f-b0e0-ae88ffc37af6 tempest-ServerRescueNegativeTestJSON-1453280047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.660s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:46 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c44dd371-421d-4d2f-b0e0-ae88ffc37af6 tempest-ServerRescueNegativeTestJSON-1453280047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeb702ef-dc74-41ec-adfc-d2539af4d850) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48230ed5-86b5-46ad-ac56-90b885a24a11', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:46 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c44dd371-421d-4d2f-b0e0-ae88ffc37af6 tempest-ServerRescueNegativeTestJSON-1453280047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a78f3197-984f-42b7-80a1-09d044a02a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:46 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-c44dd371-421d-4d2f-b0e0-ae88ffc37af6 tempest-ServerRescueNegativeTestJSON-1453280047 None] Volume volume-48230ed5-86b5-46ad-ac56-90b885a24a11 (48230ed5-86b5-46ad-ac56-90b885a24a11): created successfully Jul 08 18:33:46 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c44dd371-421d-4d2f-b0e0-ae88ffc37af6 tempest-ServerRescueNegativeTestJSON-1453280047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a78f3197-984f-42b7-80a1-09d044a02a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:46 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c44dd371-421d-4d2f-b0e0-ae88ffc37af6 tempest-ServerRescueNegativeTestJSON-1453280047 None] Flow 'volume_create_manager' (becf50dc-f93a-47ea-87f9-c0f8b7c41929) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:33:46 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-c44dd371-421d-4d2f-b0e0-ae88ffc37af6 tempest-ServerRescueNegativeTestJSON-1453280047 None] Created volume successfully. Jul 08 18:33:48 devstack cinder-volume[86873]: DEBUG oslo_service.periodic_task [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86873) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:33:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:33:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:33:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:48 devstack sudo[89244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:33:48 devstack sudo[89244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:49 devstack sudo[89244]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.945s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:49 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:33:56 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:SELECT=25,cinder:INSERT=6,cinder:UPDATE=33,cinder:DELETE=2 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:33:56 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:SELECT=13,cinder:UPDATE=25,cinder:INSERT=6,cinder:DELETE=4 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:34:08 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-de9ae38b-6614-4b7c-a500-9f1bfed377a5 tempest-AttachVolumeShelveTestJSON-2087706243 None] Acquiring lock "cinder-731236ea-3910-401d-93ba-6e8bb449abe6-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:34:08 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-de9ae38b-6614-4b7c-a500-9f1bfed377a5 tempest-AttachVolumeShelveTestJSON-2087706243 None] Lock "cinder-731236ea-3910-401d-93ba-6e8bb449abe6-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:34:08 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-de9ae38b-6614-4b7c-a500-9f1bfed377a5 tempest-AttachVolumeShelveTestJSON-2087706243 None] Acquiring lock "cinder-quobyte-731236ea-3910-401d-93ba-6e8bb449abe6" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:34:08 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-de9ae38b-6614-4b7c-a500-9f1bfed377a5 tempest-AttachVolumeShelveTestJSON-2087706243 None] Lock "cinder-quobyte-731236ea-3910-401d-93ba-6e8bb449abe6" acquired by "delete_volume" :: waited 0.025s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:34:08 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[525f3871-616c-4d59-b4fe-348781ee036f]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:34:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-de9ae38b-6614-4b7c-a500-9f1bfed377a5 tempest-AttachVolumeShelveTestJSON-2087706243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-731236ea-3910-401d-93ba-6e8bb449abe6 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:09 devstack sudo[89435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-731236ea-3910-401d-93ba-6e8bb449abe6 Jul 08 18:34:09 devstack sudo[89435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:10 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cca5013-5e14-489a-8fa6-bbb3620e3d6a tempest-VolumeTypesAccessTest-1271181837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:34:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6cca5013-5e14-489a-8fa6-bbb3620e3d6a tempest-VolumeTypesAccessTest-1271181837 None] Flow 'volume_create_manager' (9ba62dfb-0eb9-41c3-aae1-5af0919bb177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:34:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6cca5013-5e14-489a-8fa6-bbb3620e3d6a tempest-VolumeTypesAccessTest-1271181837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91864f2f-5927-4f9b-9a7a-811057be1db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6cca5013-5e14-489a-8fa6-bbb3620e3d6a tempest-VolumeTypesAccessTest-1271181837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91864f2f-5927-4f9b-9a7a-811057be1db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:34:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1722132121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e089d13-0f78-4954-8c8e-d99d22ea1b06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c56923b8fd284a95a99df5899784931e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:34:10Z,use_quota=True,user_id='bfdef66e53994b5286bf567a694accd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46d90ff0-fe0b-4c67-bab8-45b1317377bf),volume_type_id=46d90ff0-fe0b-4c67-bab8-45b1317377bf)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6cca5013-5e14-489a-8fa6-bbb3620e3d6a tempest-VolumeTypesAccessTest-1271181837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2385e34-fbdb-407a-afa2-0b3c273b16e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6cca5013-5e14-489a-8fa6-bbb3620e3d6a tempest-VolumeTypesAccessTest-1271181837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2385e34-fbdb-407a-afa2-0b3c273b16e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6cca5013-5e14-489a-8fa6-bbb3620e3d6a tempest-VolumeTypesAccessTest-1271181837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94c92a58-63c5-4b83-ad2e-3ba8bc9ef895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6cca5013-5e14-489a-8fa6-bbb3620e3d6a tempest-VolumeTypesAccessTest-1271181837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94c92a58-63c5-4b83-ad2e-3ba8bc9ef895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e089d13-0f78-4954-8c8e-d99d22ea1b06', 'volume_name': 'volume-9e089d13-0f78-4954-8c8e-d99d22ea1b06', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6cca5013-5e14-489a-8fa6-bbb3620e3d6a tempest-VolumeTypesAccessTest-1271181837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (190fce70-dad9-410d-8afe-a26f465182ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6cca5013-5e14-489a-8fa6-bbb3620e3d6a tempest-VolumeTypesAccessTest-1271181837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (190fce70-dad9-410d-8afe-a26f465182ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6cca5013-5e14-489a-8fa6-bbb3620e3d6a tempest-VolumeTypesAccessTest-1271181837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cd013ef-fe16-4b8c-a146-a1714bd89d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:10 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-6cca5013-5e14-489a-8fa6-bbb3620e3d6a tempest-VolumeTypesAccessTest-1271181837 None] Volume 9e089d13-0f78-4954-8c8e-d99d22ea1b06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e089d13-0f78-4954-8c8e-d99d22ea1b06', 'volume_size': 1} Jul 08 18:34:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6cca5013-5e14-489a-8fa6-bbb3620e3d6a tempest-VolumeTypesAccessTest-1271181837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:34:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6cca5013-5e14-489a-8fa6-bbb3620e3d6a tempest-VolumeTypesAccessTest-1271181837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:34:10 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-6cca5013-5e14-489a-8fa6-bbb3620e3d6a tempest-VolumeTypesAccessTest-1271181837 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:34:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1722132121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e089d13-0f78-4954-8c8e-d99d22ea1b06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c56923b8fd284a95a99df5899784931e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:34:10Z,use_quota=True,user_id='bfdef66e53994b5286bf567a694accd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46d90ff0-fe0b-4c67-bab8-45b1317377bf),volume_type_id=46d90ff0-fe0b-4c67-bab8-45b1317377bf)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:34:10 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-6cca5013-5e14-489a-8fa6-bbb3620e3d6a tempest-VolumeTypesAccessTest-1271181837 None] Creating volume 9e089d13-0f78-4954-8c8e-d99d22ea1b06 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:34:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6cca5013-5e14-489a-8fa6-bbb3620e3d6a tempest-VolumeTypesAccessTest-1271181837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:34:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6cca5013-5e14-489a-8fa6-bbb3620e3d6a tempest-VolumeTypesAccessTest-1271181837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:34:10 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-6cca5013-5e14-489a-8fa6-bbb3620e3d6a tempest-VolumeTypesAccessTest-1271181837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:34:10 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-6cca5013-5e14-489a-8fa6-bbb3620e3d6a tempest-VolumeTypesAccessTest-1271181837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:34:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6cca5013-5e14-489a-8fa6-bbb3620e3d6a tempest-VolumeTypesAccessTest-1271181837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:34:10 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-6cca5013-5e14-489a-8fa6-bbb3620e3d6a tempest-VolumeTypesAccessTest-1271181837 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:34:10 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-6cca5013-5e14-489a-8fa6-bbb3620e3d6a tempest-VolumeTypesAccessTest-1271181837 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:34:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6cca5013-5e14-489a-8fa6-bbb3620e3d6a tempest-VolumeTypesAccessTest-1271181837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9e089d13-0f78-4954-8c8e-d99d22ea1b06 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:10 devstack sudo[89437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9e089d13-0f78-4954-8c8e-d99d22ea1b06 1073741824 Jul 08 18:34:10 devstack sudo[89437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:10 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c2bed1d-2249-4cf5-9219-231c3df1a765 tempest-TaggedAttachmentsTest-1654568807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:34:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-0c2bed1d-2249-4cf5-9219-231c3df1a765 tempest-TaggedAttachmentsTest-1654568807 None] Flow 'volume_create_manager' (b6790b88-9c2b-45e6-8558-9b39265c848d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:34:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-0c2bed1d-2249-4cf5-9219-231c3df1a765 tempest-TaggedAttachmentsTest-1654568807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43ead597-0407-4aa9-9ef0-f5f870aad446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-0c2bed1d-2249-4cf5-9219-231c3df1a765 tempest-TaggedAttachmentsTest-1654568807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43ead597-0407-4aa9-9ef0-f5f870aad446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-154735841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d70002c-b84c-4bcb-947c-44f79e01f780,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11be88eb9a1e4b7695d7f8a8a92218e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:34:10Z,use_quota=True,user_id='7c90697604e641f4916e185ce2b1f43c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-0c2bed1d-2249-4cf5-9219-231c3df1a765 tempest-TaggedAttachmentsTest-1654568807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dd5d010-3bfe-42d6-851e-268328152760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-0c2bed1d-2249-4cf5-9219-231c3df1a765 tempest-TaggedAttachmentsTest-1654568807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dd5d010-3bfe-42d6-851e-268328152760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-0c2bed1d-2249-4cf5-9219-231c3df1a765 tempest-TaggedAttachmentsTest-1654568807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (197d698b-18d0-4646-a490-f50a5b09fd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-0c2bed1d-2249-4cf5-9219-231c3df1a765 tempest-TaggedAttachmentsTest-1654568807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (197d698b-18d0-4646-a490-f50a5b09fd39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d70002c-b84c-4bcb-947c-44f79e01f780', 'volume_name': 'volume-6d70002c-b84c-4bcb-947c-44f79e01f780', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-0c2bed1d-2249-4cf5-9219-231c3df1a765 tempest-TaggedAttachmentsTest-1654568807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41abf22f-636c-49e3-b495-7fa6b1d9c58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-0c2bed1d-2249-4cf5-9219-231c3df1a765 tempest-TaggedAttachmentsTest-1654568807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41abf22f-636c-49e3-b495-7fa6b1d9c58b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-0c2bed1d-2249-4cf5-9219-231c3df1a765 tempest-TaggedAttachmentsTest-1654568807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4fad5cd-2e7e-4f60-aaf6-2318f9ef0436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:10 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-0c2bed1d-2249-4cf5-9219-231c3df1a765 tempest-TaggedAttachmentsTest-1654568807 None] Volume 6d70002c-b84c-4bcb-947c-44f79e01f780: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d70002c-b84c-4bcb-947c-44f79e01f780', 'volume_size': 1} Jul 08 18:34:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-0c2bed1d-2249-4cf5-9219-231c3df1a765 tempest-TaggedAttachmentsTest-1654568807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:34:10 devstack sudo[89435]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-de9ae38b-6614-4b7c-a500-9f1bfed377a5 tempest-AttachVolumeShelveTestJSON-2087706243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-731236ea-3910-401d-93ba-6e8bb449abe6" returned: 0 in 1.764s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-de9ae38b-6614-4b7c-a500-9f1bfed377a5 tempest-AttachVolumeShelveTestJSON-2087706243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-731236ea-3910-401d-93ba-6e8bb449abe6 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:10 devstack sudo[89442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-731236ea-3910-401d-93ba-6e8bb449abe6 Jul 08 18:34:10 devstack sudo[89442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:11 devstack sudo[89437]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6cca5013-5e14-489a-8fa6-bbb3620e3d6a tempest-VolumeTypesAccessTest-1271181837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9e089d13-0f78-4954-8c8e-d99d22ea1b06 1073741824" returned: 0 in 1.110s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:11 devstack sudo[89442]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-de9ae38b-6614-4b7c-a500-9f1bfed377a5 tempest-AttachVolumeShelveTestJSON-2087706243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-731236ea-3910-401d-93ba-6e8bb449abe6" returned: 0 in 0.788s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:11 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-de9ae38b-6614-4b7c-a500-9f1bfed377a5 tempest-AttachVolumeShelveTestJSON-2087706243 None] Lock "cinder-quobyte-731236ea-3910-401d-93ba-6e8bb449abe6" released by "delete_volume" :: held 2.618s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:34:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6cca5013-5e14-489a-8fa6-bbb3620e3d6a tempest-VolumeTypesAccessTest-1271181837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9e089d13-0f78-4954-8c8e-d99d22ea1b06 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:11 devstack sudo[89456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9e089d13-0f78-4954-8c8e-d99d22ea1b06 Jul 08 18:34:11 devstack sudo[89456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:11 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-de9ae38b-6614-4b7c-a500-9f1bfed377a5 tempest-AttachVolumeShelveTestJSON-2087706243 None] Created reservations ['61855909-913d-4dd5-9c31-c2165999fde6', 'd1706a0a-0a1e-4d73-b61c-7923ed79c106', 'eec16a0e-192b-414a-8c58-afc75582ec81', '748a3bf7-17cf-44f6-884a-6068816957fd'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:34:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-de9ae38b-6614-4b7c-a500-9f1bfed377a5 tempest-AttachVolumeShelveTestJSON-2087706243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:34:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-de9ae38b-6614-4b7c-a500-9f1bfed377a5 tempest-AttachVolumeShelveTestJSON-2087706243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:34:11 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-de9ae38b-6614-4b7c-a500-9f1bfed377a5 tempest-AttachVolumeShelveTestJSON-2087706243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:34:11 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-de9ae38b-6614-4b7c-a500-9f1bfed377a5 tempest-AttachVolumeShelveTestJSON-2087706243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:34:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-de9ae38b-6614-4b7c-a500-9f1bfed377a5 tempest-AttachVolumeShelveTestJSON-2087706243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:34:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-de9ae38b-6614-4b7c-a500-9f1bfed377a5 tempest-AttachVolumeShelveTestJSON-2087706243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:11 devstack sudo[89461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:34:11 devstack sudo[89461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:12 devstack sudo[89456]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6cca5013-5e14-489a-8fa6-bbb3620e3d6a tempest-VolumeTypesAccessTest-1271181837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9e089d13-0f78-4954-8c8e-d99d22ea1b06" returned: 0 in 0.884s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:12 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-6cca5013-5e14-489a-8fa6-bbb3620e3d6a tempest-VolumeTypesAccessTest-1271181837 None] <== create_volume: return (2076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:34:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6cca5013-5e14-489a-8fa6-bbb3620e3d6a tempest-VolumeTypesAccessTest-1271181837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.081s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:34:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-0c2bed1d-2249-4cf5-9219-231c3df1a765 tempest-TaggedAttachmentsTest-1654568807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.754s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:34:12 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-0c2bed1d-2249-4cf5-9219-231c3df1a765 tempest-TaggedAttachmentsTest-1654568807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-154735841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d70002c-b84c-4bcb-947c-44f79e01f780,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11be88eb9a1e4b7695d7f8a8a92218e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:34:10Z,use_quota=True,user_id='7c90697604e641f4916e185ce2b1f43c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:34:12 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-0c2bed1d-2249-4cf5-9219-231c3df1a765 tempest-TaggedAttachmentsTest-1654568807 None] Creating volume 6d70002c-b84c-4bcb-947c-44f79e01f780 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:34:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-0c2bed1d-2249-4cf5-9219-231c3df1a765 tempest-TaggedAttachmentsTest-1654568807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:34:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-0c2bed1d-2249-4cf5-9219-231c3df1a765 tempest-TaggedAttachmentsTest-1654568807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:34:12 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-0c2bed1d-2249-4cf5-9219-231c3df1a765 tempest-TaggedAttachmentsTest-1654568807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:34:12 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-0c2bed1d-2249-4cf5-9219-231c3df1a765 tempest-TaggedAttachmentsTest-1654568807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:34:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-0c2bed1d-2249-4cf5-9219-231c3df1a765 tempest-TaggedAttachmentsTest-1654568807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:34:12 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-0c2bed1d-2249-4cf5-9219-231c3df1a765 tempest-TaggedAttachmentsTest-1654568807 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:34:12 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-0c2bed1d-2249-4cf5-9219-231c3df1a765 tempest-TaggedAttachmentsTest-1654568807 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:34:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-0c2bed1d-2249-4cf5-9219-231c3df1a765 tempest-TaggedAttachmentsTest-1654568807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6d70002c-b84c-4bcb-947c-44f79e01f780 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:12 devstack sudo[89485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6d70002c-b84c-4bcb-947c-44f79e01f780 1073741824 Jul 08 18:34:12 devstack sudo[89485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:12 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6cca5013-5e14-489a-8fa6-bbb3620e3d6a tempest-VolumeTypesAccessTest-1271181837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cd013ef-fe16-4b8c-a146-a1714bd89d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e089d13-0f78-4954-8c8e-d99d22ea1b06', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:12 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6cca5013-5e14-489a-8fa6-bbb3620e3d6a tempest-VolumeTypesAccessTest-1271181837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f64fab68-e3da-490c-a734-743ae016d744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:12 devstack sudo[89461]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-de9ae38b-6614-4b7c-a500-9f1bfed377a5 tempest-AttachVolumeShelveTestJSON-2087706243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.890s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:12 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-de9ae38b-6614-4b7c-a500-9f1bfed377a5 tempest-AttachVolumeShelveTestJSON-2087706243 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:34:12 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-6cca5013-5e14-489a-8fa6-bbb3620e3d6a tempest-VolumeTypesAccessTest-1271181837 None] Volume volume-9e089d13-0f78-4954-8c8e-d99d22ea1b06 (9e089d13-0f78-4954-8c8e-d99d22ea1b06): created successfully Jul 08 18:34:12 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6cca5013-5e14-489a-8fa6-bbb3620e3d6a tempest-VolumeTypesAccessTest-1271181837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f64fab68-e3da-490c-a734-743ae016d744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:12 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6cca5013-5e14-489a-8fa6-bbb3620e3d6a tempest-VolumeTypesAccessTest-1271181837 None] Flow 'volume_create_manager' (9ba62dfb-0eb9-41c3-aae1-5af0919bb177) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:34:12 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-de9ae38b-6614-4b7c-a500-9f1bfed377a5 tempest-AttachVolumeShelveTestJSON-2087706243 None] Deleted volume successfully. Jul 08 18:34:12 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-6cca5013-5e14-489a-8fa6-bbb3620e3d6a tempest-VolumeTypesAccessTest-1271181837 None] Created volume successfully. Jul 08 18:34:12 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-de9ae38b-6614-4b7c-a500-9f1bfed377a5 tempest-AttachVolumeShelveTestJSON-2087706243 None] Lock "cinder-731236ea-3910-401d-93ba-6e8bb449abe6-delete_volume" released by "delete_volume" :: held 3.866s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:34:13 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9b3fd574-ee35-436c-9c19-5942ddc0a8aa tempest-VolumeTypesAccessTest-1271181837 None] Acquiring lock "cinder-9e089d13-0f78-4954-8c8e-d99d22ea1b06-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:34:13 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9b3fd574-ee35-436c-9c19-5942ddc0a8aa tempest-VolumeTypesAccessTest-1271181837 None] Lock "cinder-9e089d13-0f78-4954-8c8e-d99d22ea1b06-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:34:13 devstack sudo[89485]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-0c2bed1d-2249-4cf5-9219-231c3df1a765 tempest-TaggedAttachmentsTest-1654568807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6d70002c-b84c-4bcb-947c-44f79e01f780 1073741824" returned: 0 in 1.267s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:13 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9b3fd574-ee35-436c-9c19-5942ddc0a8aa tempest-VolumeTypesAccessTest-1271181837 None] Acquiring lock "cinder-quobyte-9e089d13-0f78-4954-8c8e-d99d22ea1b06" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:34:13 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9b3fd574-ee35-436c-9c19-5942ddc0a8aa tempest-VolumeTypesAccessTest-1271181837 None] Lock "cinder-quobyte-9e089d13-0f78-4954-8c8e-d99d22ea1b06" acquired by "delete_volume" :: waited 0.023s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:34:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-0c2bed1d-2249-4cf5-9219-231c3df1a765 tempest-TaggedAttachmentsTest-1654568807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6d70002c-b84c-4bcb-947c-44f79e01f780 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:13 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[52abad76-665e-42b0-9754-9d6f6072f794]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:34:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9b3fd574-ee35-436c-9c19-5942ddc0a8aa tempest-VolumeTypesAccessTest-1271181837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9e089d13-0f78-4954-8c8e-d99d22ea1b06 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:13 devstack sudo[89492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6d70002c-b84c-4bcb-947c-44f79e01f780 Jul 08 18:34:13 devstack sudo[89492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:13 devstack sudo[89493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9e089d13-0f78-4954-8c8e-d99d22ea1b06 Jul 08 18:34:13 devstack sudo[89493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:14 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-d9fb04ca-5042-4f4a-9c9c-0d78fc134db2 tempest-ServerRescueNegativeTestJSON-1453280047 None] Acquiring lock "cinder-48230ed5-86b5-46ad-ac56-90b885a24a11-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:34:14 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-d9fb04ca-5042-4f4a-9c9c-0d78fc134db2 tempest-ServerRescueNegativeTestJSON-1453280047 None] Lock "cinder-48230ed5-86b5-46ad-ac56-90b885a24a11-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:34:14 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-d9fb04ca-5042-4f4a-9c9c-0d78fc134db2 tempest-ServerRescueNegativeTestJSON-1453280047 None] Acquiring lock "cinder-quobyte-48230ed5-86b5-46ad-ac56-90b885a24a11" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:34:14 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-d9fb04ca-5042-4f4a-9c9c-0d78fc134db2 tempest-ServerRescueNegativeTestJSON-1453280047 None] Lock "cinder-quobyte-48230ed5-86b5-46ad-ac56-90b885a24a11" acquired by "delete_volume" :: waited 0.054s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:34:14 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[0938a898-f567-4d5c-81da-6c567089133d]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:34:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d9fb04ca-5042-4f4a-9c9c-0d78fc134db2 tempest-ServerRescueNegativeTestJSON-1453280047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-48230ed5-86b5-46ad-ac56-90b885a24a11 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:14 devstack sudo[89492]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-0c2bed1d-2249-4cf5-9219-231c3df1a765 tempest-TaggedAttachmentsTest-1654568807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6d70002c-b84c-4bcb-947c-44f79e01f780" returned: 0 in 0.971s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:14 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-0c2bed1d-2249-4cf5-9219-231c3df1a765 tempest-TaggedAttachmentsTest-1654568807 None] <== create_volume: return (2359ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:34:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-0c2bed1d-2249-4cf5-9219-231c3df1a765 tempest-TaggedAttachmentsTest-1654568807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.367s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:34:14 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-0c2bed1d-2249-4cf5-9219-231c3df1a765 tempest-TaggedAttachmentsTest-1654568807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4fad5cd-2e7e-4f60-aaf6-2318f9ef0436) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d70002c-b84c-4bcb-947c-44f79e01f780', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:14 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-0c2bed1d-2249-4cf5-9219-231c3df1a765 tempest-TaggedAttachmentsTest-1654568807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71dbd3cb-0d0b-4533-9cc0-36079509cbae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:14 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-0c2bed1d-2249-4cf5-9219-231c3df1a765 tempest-TaggedAttachmentsTest-1654568807 None] Volume volume-6d70002c-b84c-4bcb-947c-44f79e01f780 (6d70002c-b84c-4bcb-947c-44f79e01f780): created successfully Jul 08 18:34:14 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-0c2bed1d-2249-4cf5-9219-231c3df1a765 tempest-TaggedAttachmentsTest-1654568807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71dbd3cb-0d0b-4533-9cc0-36079509cbae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:14 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-0c2bed1d-2249-4cf5-9219-231c3df1a765 tempest-TaggedAttachmentsTest-1654568807 None] Flow 'volume_create_manager' (b6790b88-9c2b-45e6-8558-9b39265c848d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:34:14 devstack sudo[89504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-48230ed5-86b5-46ad-ac56-90b885a24a11 Jul 08 18:34:14 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-0c2bed1d-2249-4cf5-9219-231c3df1a765 tempest-TaggedAttachmentsTest-1654568807 None] Created volume successfully. Jul 08 18:34:14 devstack sudo[89504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:15 devstack sudo[89493]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9b3fd574-ee35-436c-9c19-5942ddc0a8aa tempest-VolumeTypesAccessTest-1271181837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9e089d13-0f78-4954-8c8e-d99d22ea1b06" returned: 0 in 1.680s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9b3fd574-ee35-436c-9c19-5942ddc0a8aa tempest-VolumeTypesAccessTest-1271181837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9e089d13-0f78-4954-8c8e-d99d22ea1b06 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:15 devstack sudo[89510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9e089d13-0f78-4954-8c8e-d99d22ea1b06 Jul 08 18:34:15 devstack sudo[89510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:15 devstack sudo[89504]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d9fb04ca-5042-4f4a-9c9c-0d78fc134db2 tempest-ServerRescueNegativeTestJSON-1453280047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-48230ed5-86b5-46ad-ac56-90b885a24a11" returned: 0 in 1.259s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d9fb04ca-5042-4f4a-9c9c-0d78fc134db2 tempest-ServerRescueNegativeTestJSON-1453280047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-48230ed5-86b5-46ad-ac56-90b885a24a11 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:15 devstack sudo[89515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-48230ed5-86b5-46ad-ac56-90b885a24a11 Jul 08 18:34:15 devstack sudo[89515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:16 devstack sudo[89510]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9b3fd574-ee35-436c-9c19-5942ddc0a8aa tempest-VolumeTypesAccessTest-1271181837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9e089d13-0f78-4954-8c8e-d99d22ea1b06" returned: 0 in 1.196s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:16 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9b3fd574-ee35-436c-9c19-5942ddc0a8aa tempest-VolumeTypesAccessTest-1271181837 None] Lock "cinder-quobyte-9e089d13-0f78-4954-8c8e-d99d22ea1b06" released by "delete_volume" :: held 2.980s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:34:16 devstack cinder-volume[86873]: WARNING cinder.quota [None req-9b3fd574-ee35-436c-9c19-5942ddc0a8aa tempest-VolumeTypesAccessTest-1271181837 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-203386928 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-203386928, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:34:16 devstack cinder-volume[86873]: WARNING cinder.quota [None req-9b3fd574-ee35-436c-9c19-5942ddc0a8aa tempest-VolumeTypesAccessTest-1271181837 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-203386928 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-203386928, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:34:16 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-9b3fd574-ee35-436c-9c19-5942ddc0a8aa tempest-VolumeTypesAccessTest-1271181837 None] Created reservations ['889b6125-2a91-44bd-aaf4-751bbce91d2e', '2fa93127-20ad-4200-b4b7-59366a71f85e', 'e261f647-d511-4250-800d-20bc283cdb80', 'efb9c10a-54aa-4bc6-a173-3040e5a0a0d0'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:34:16 devstack sudo[89515]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d9fb04ca-5042-4f4a-9c9c-0d78fc134db2 tempest-ServerRescueNegativeTestJSON-1453280047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-48230ed5-86b5-46ad-ac56-90b885a24a11" returned: 0 in 1.063s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:16 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-d9fb04ca-5042-4f4a-9c9c-0d78fc134db2 tempest-ServerRescueNegativeTestJSON-1453280047 None] Lock "cinder-quobyte-48230ed5-86b5-46ad-ac56-90b885a24a11" released by "delete_volume" :: held 2.395s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:34:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-9b3fd574-ee35-436c-9c19-5942ddc0a8aa tempest-VolumeTypesAccessTest-1271181837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:34:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-9b3fd574-ee35-436c-9c19-5942ddc0a8aa tempest-VolumeTypesAccessTest-1271181837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:34:16 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-9b3fd574-ee35-436c-9c19-5942ddc0a8aa tempest-VolumeTypesAccessTest-1271181837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:34:16 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-9b3fd574-ee35-436c-9c19-5942ddc0a8aa tempest-VolumeTypesAccessTest-1271181837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:34:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-9b3fd574-ee35-436c-9c19-5942ddc0a8aa tempest-VolumeTypesAccessTest-1271181837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:34:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9b3fd574-ee35-436c-9c19-5942ddc0a8aa tempest-VolumeTypesAccessTest-1271181837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:16 devstack sudo[89519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:34:16 devstack sudo[89519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:17 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-d9fb04ca-5042-4f4a-9c9c-0d78fc134db2 tempest-ServerRescueNegativeTestJSON-1453280047 None] Created reservations ['0b657035-b4fb-4dd7-9d48-c4ca8adcf470', 'c6c404fd-d320-40d3-b855-c0c0822ef9e7', '73e38763-0af1-40e7-a67a-3da0380db305', '2978c235-9837-4351-a9b6-da9f40d77a39'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:34:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-d9fb04ca-5042-4f4a-9c9c-0d78fc134db2 tempest-ServerRescueNegativeTestJSON-1453280047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:34:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-d9fb04ca-5042-4f4a-9c9c-0d78fc134db2 tempest-ServerRescueNegativeTestJSON-1453280047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:34:17 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-d9fb04ca-5042-4f4a-9c9c-0d78fc134db2 tempest-ServerRescueNegativeTestJSON-1453280047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:34:17 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-d9fb04ca-5042-4f4a-9c9c-0d78fc134db2 tempest-ServerRescueNegativeTestJSON-1453280047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:34:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-d9fb04ca-5042-4f4a-9c9c-0d78fc134db2 tempest-ServerRescueNegativeTestJSON-1453280047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:34:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d9fb04ca-5042-4f4a-9c9c-0d78fc134db2 tempest-ServerRescueNegativeTestJSON-1453280047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:17 devstack sudo[89521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:34:17 devstack sudo[89521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:18 devstack sudo[89519]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9b3fd574-ee35-436c-9c19-5942ddc0a8aa tempest-VolumeTypesAccessTest-1271181837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 1.862s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:18 devstack sudo[89521]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:18 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-9b3fd574-ee35-436c-9c19-5942ddc0a8aa tempest-VolumeTypesAccessTest-1271181837 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:34:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d9fb04ca-5042-4f4a-9c9c-0d78fc134db2 tempest-ServerRescueNegativeTestJSON-1453280047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 1.542s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:18 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-d9fb04ca-5042-4f4a-9c9c-0d78fc134db2 tempest-ServerRescueNegativeTestJSON-1453280047 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:34:18 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-9b3fd574-ee35-436c-9c19-5942ddc0a8aa tempest-VolumeTypesAccessTest-1271181837 None] Deleted volume successfully. Jul 08 18:34:18 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9b3fd574-ee35-436c-9c19-5942ddc0a8aa tempest-VolumeTypesAccessTest-1271181837 None] Lock "cinder-9e089d13-0f78-4954-8c8e-d99d22ea1b06-delete_volume" released by "delete_volume" :: held 5.416s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:34:18 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-d9fb04ca-5042-4f4a-9c9c-0d78fc134db2 tempest-ServerRescueNegativeTestJSON-1453280047 None] Deleted volume successfully. Jul 08 18:34:18 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-d9fb04ca-5042-4f4a-9c9c-0d78fc134db2 tempest-ServerRescueNegativeTestJSON-1453280047 None] Lock "cinder-48230ed5-86b5-46ad-ac56-90b885a24a11-delete_volume" released by "delete_volume" :: held 4.635s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:34:26 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [req-0cebc61f-54ed-41e1-89f0-36265d5487fa req-2ccb4abf-6af2-4c32-8c96-ee3514213530 tempest-VolumesGetTestJSON-664746092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:34:26 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-0cebc61f-54ed-41e1-89f0-36265d5487fa req-2ccb4abf-6af2-4c32-8c96-ee3514213530 tempest-VolumesGetTestJSON-664746092 None] Flow 'volume_create_manager' (119cee43-a719-4311-a5f7-3c1680bbbaf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:34:26 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-0cebc61f-54ed-41e1-89f0-36265d5487fa req-2ccb4abf-6af2-4c32-8c96-ee3514213530 tempest-VolumesGetTestJSON-664746092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d39b408-4869-4d9d-ba07-6bf5b6866ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:26 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-0cebc61f-54ed-41e1-89f0-36265d5487fa req-2ccb4abf-6af2-4c32-8c96-ee3514213530 tempest-VolumesGetTestJSON-664746092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d39b408-4869-4d9d-ba07-6bf5b6866ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1203032780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3414a920-851a-4915-ad11-a6bd9050dc1d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d826145b17714e4aa640d19d05e7f719',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:34:26Z,use_quota=True,user_id='367c0e41c74f44c1b7fd02ec091f6996',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:26 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-0cebc61f-54ed-41e1-89f0-36265d5487fa req-2ccb4abf-6af2-4c32-8c96-ee3514213530 tempest-VolumesGetTestJSON-664746092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18cefde1-e24e-4ecd-80f9-ff5bf37c877c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:26 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-0cebc61f-54ed-41e1-89f0-36265d5487fa req-2ccb4abf-6af2-4c32-8c96-ee3514213530 tempest-VolumesGetTestJSON-664746092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18cefde1-e24e-4ecd-80f9-ff5bf37c877c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:26 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-0cebc61f-54ed-41e1-89f0-36265d5487fa req-2ccb4abf-6af2-4c32-8c96-ee3514213530 tempest-VolumesGetTestJSON-664746092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e789c94-7d05-496b-82b7-94bff135bba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:26 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-0cebc61f-54ed-41e1-89f0-36265d5487fa req-2ccb4abf-6af2-4c32-8c96-ee3514213530 tempest-VolumesGetTestJSON-664746092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e789c94-7d05-496b-82b7-94bff135bba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3414a920-851a-4915-ad11-a6bd9050dc1d', 'volume_name': 'volume-3414a920-851a-4915-ad11-a6bd9050dc1d', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:26 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-0cebc61f-54ed-41e1-89f0-36265d5487fa req-2ccb4abf-6af2-4c32-8c96-ee3514213530 tempest-VolumesGetTestJSON-664746092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01b9bdc1-3975-4ba4-bb7c-a65b14a8beb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:26 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-0cebc61f-54ed-41e1-89f0-36265d5487fa req-2ccb4abf-6af2-4c32-8c96-ee3514213530 tempest-VolumesGetTestJSON-664746092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01b9bdc1-3975-4ba4-bb7c-a65b14a8beb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:26 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-0cebc61f-54ed-41e1-89f0-36265d5487fa req-2ccb4abf-6af2-4c32-8c96-ee3514213530 tempest-VolumesGetTestJSON-664746092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b85f68f-3932-4c41-aaa9-d81c714d98ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:26 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [req-0cebc61f-54ed-41e1-89f0-36265d5487fa req-2ccb4abf-6af2-4c32-8c96-ee3514213530 tempest-VolumesGetTestJSON-664746092 None] Volume 3414a920-851a-4915-ad11-a6bd9050dc1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3414a920-851a-4915-ad11-a6bd9050dc1d', 'volume_size': 1} Jul 08 18:34:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-0cebc61f-54ed-41e1-89f0-36265d5487fa req-2ccb4abf-6af2-4c32-8c96-ee3514213530 tempest-VolumesGetTestJSON-664746092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:34:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-0cebc61f-54ed-41e1-89f0-36265d5487fa req-2ccb4abf-6af2-4c32-8c96-ee3514213530 tempest-VolumesGetTestJSON-664746092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:34:26 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [req-0cebc61f-54ed-41e1-89f0-36265d5487fa req-2ccb4abf-6af2-4c32-8c96-ee3514213530 tempest-VolumesGetTestJSON-664746092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1203032780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3414a920-851a-4915-ad11-a6bd9050dc1d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d826145b17714e4aa640d19d05e7f719',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:34:26Z,use_quota=True,user_id='367c0e41c74f44c1b7fd02ec091f6996',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:34:26 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [req-0cebc61f-54ed-41e1-89f0-36265d5487fa req-2ccb4abf-6af2-4c32-8c96-ee3514213530 tempest-VolumesGetTestJSON-664746092 None] Creating volume 3414a920-851a-4915-ad11-a6bd9050dc1d {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:34:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-0cebc61f-54ed-41e1-89f0-36265d5487fa req-2ccb4abf-6af2-4c32-8c96-ee3514213530 tempest-VolumesGetTestJSON-664746092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:34:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-0cebc61f-54ed-41e1-89f0-36265d5487fa req-2ccb4abf-6af2-4c32-8c96-ee3514213530 tempest-VolumesGetTestJSON-664746092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:34:26 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [req-0cebc61f-54ed-41e1-89f0-36265d5487fa req-2ccb4abf-6af2-4c32-8c96-ee3514213530 tempest-VolumesGetTestJSON-664746092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:34:26 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [req-0cebc61f-54ed-41e1-89f0-36265d5487fa req-2ccb4abf-6af2-4c32-8c96-ee3514213530 tempest-VolumesGetTestJSON-664746092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:34:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-0cebc61f-54ed-41e1-89f0-36265d5487fa req-2ccb4abf-6af2-4c32-8c96-ee3514213530 tempest-VolumesGetTestJSON-664746092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:34:26 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [req-0cebc61f-54ed-41e1-89f0-36265d5487fa req-2ccb4abf-6af2-4c32-8c96-ee3514213530 tempest-VolumesGetTestJSON-664746092 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:34:26 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [req-0cebc61f-54ed-41e1-89f0-36265d5487fa req-2ccb4abf-6af2-4c32-8c96-ee3514213530 tempest-VolumesGetTestJSON-664746092 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:34:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-0cebc61f-54ed-41e1-89f0-36265d5487fa req-2ccb4abf-6af2-4c32-8c96-ee3514213530 tempest-VolumesGetTestJSON-664746092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3414a920-851a-4915-ad11-a6bd9050dc1d 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:26 devstack sudo[89576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3414a920-851a-4915-ad11-a6bd9050dc1d 1073741824 Jul 08 18:34:26 devstack sudo[89576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:27 devstack sudo[89576]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-0cebc61f-54ed-41e1-89f0-36265d5487fa req-2ccb4abf-6af2-4c32-8c96-ee3514213530 tempest-VolumesGetTestJSON-664746092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3414a920-851a-4915-ad11-a6bd9050dc1d 1073741824" returned: 0 in 0.938s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-0cebc61f-54ed-41e1-89f0-36265d5487fa req-2ccb4abf-6af2-4c32-8c96-ee3514213530 tempest-VolumesGetTestJSON-664746092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3414a920-851a-4915-ad11-a6bd9050dc1d {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:27 devstack sudo[89587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3414a920-851a-4915-ad11-a6bd9050dc1d Jul 08 18:34:27 devstack sudo[89587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:28 devstack sudo[89587]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-0cebc61f-54ed-41e1-89f0-36265d5487fa req-2ccb4abf-6af2-4c32-8c96-ee3514213530 tempest-VolumesGetTestJSON-664746092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3414a920-851a-4915-ad11-a6bd9050dc1d" returned: 0 in 0.891s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:28 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [req-0cebc61f-54ed-41e1-89f0-36265d5487fa req-2ccb4abf-6af2-4c32-8c96-ee3514213530 tempest-VolumesGetTestJSON-664746092 None] <== create_volume: return (1875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:34:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-0cebc61f-54ed-41e1-89f0-36265d5487fa req-2ccb4abf-6af2-4c32-8c96-ee3514213530 tempest-VolumesGetTestJSON-664746092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.877s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:34:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-0cebc61f-54ed-41e1-89f0-36265d5487fa req-2ccb4abf-6af2-4c32-8c96-ee3514213530 tempest-VolumesGetTestJSON-664746092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b85f68f-3932-4c41-aaa9-d81c714d98ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3414a920-851a-4915-ad11-a6bd9050dc1d', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-0cebc61f-54ed-41e1-89f0-36265d5487fa req-2ccb4abf-6af2-4c32-8c96-ee3514213530 tempest-VolumesGetTestJSON-664746092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d481fbc4-27bf-47fd-a6e5-01308afde8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:28 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [req-0cebc61f-54ed-41e1-89f0-36265d5487fa req-2ccb4abf-6af2-4c32-8c96-ee3514213530 tempest-VolumesGetTestJSON-664746092 None] Volume volume-3414a920-851a-4915-ad11-a6bd9050dc1d (3414a920-851a-4915-ad11-a6bd9050dc1d): created successfully Jul 08 18:34:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-0cebc61f-54ed-41e1-89f0-36265d5487fa req-2ccb4abf-6af2-4c32-8c96-ee3514213530 tempest-VolumesGetTestJSON-664746092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d481fbc4-27bf-47fd-a6e5-01308afde8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-0cebc61f-54ed-41e1-89f0-36265d5487fa req-2ccb4abf-6af2-4c32-8c96-ee3514213530 tempest-VolumesGetTestJSON-664746092 None] Flow 'volume_create_manager' (119cee43-a719-4311-a5f7-3c1680bbbaf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:34:28 devstack cinder-volume[86873]: INFO cinder.volume.manager [req-0cebc61f-54ed-41e1-89f0-36265d5487fa req-2ccb4abf-6af2-4c32-8c96-ee3514213530 tempest-VolumesGetTestJSON-664746092 None] Created volume successfully. Jul 08 18:34:29 devstack cinder-volume[86873]: DEBUG cinder.coordination [req-5e04ee1e-ffd1-4feb-99d8-1579cbbfe259 req-8eeb0d0e-fbd4-4e6b-8b4d-efc17c5f4842 tempest-VolumesGetTestJSON-664746092 None] Acquiring lock "cinder-3414a920-851a-4915-ad11-a6bd9050dc1d-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:34:29 devstack cinder-volume[86873]: DEBUG cinder.coordination [req-5e04ee1e-ffd1-4feb-99d8-1579cbbfe259 req-8eeb0d0e-fbd4-4e6b-8b4d-efc17c5f4842 tempest-VolumesGetTestJSON-664746092 None] Lock "cinder-3414a920-851a-4915-ad11-a6bd9050dc1d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:34:29 devstack cinder-volume[86873]: DEBUG cinder.coordination [req-5e04ee1e-ffd1-4feb-99d8-1579cbbfe259 req-8eeb0d0e-fbd4-4e6b-8b4d-efc17c5f4842 tempest-VolumesGetTestJSON-664746092 None] Acquiring lock "cinder-quobyte-3414a920-851a-4915-ad11-a6bd9050dc1d" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:34:29 devstack cinder-volume[86873]: DEBUG cinder.coordination [req-5e04ee1e-ffd1-4feb-99d8-1579cbbfe259 req-8eeb0d0e-fbd4-4e6b-8b4d-efc17c5f4842 tempest-VolumesGetTestJSON-664746092 None] Lock "cinder-quobyte-3414a920-851a-4915-ad11-a6bd9050dc1d" acquired by "delete_volume" :: waited 0.017s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:34:29 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe9da54-fafe-49c0-9285-b73decf920a8]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:34:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-5e04ee1e-ffd1-4feb-99d8-1579cbbfe259 req-8eeb0d0e-fbd4-4e6b-8b4d-efc17c5f4842 tempest-VolumesGetTestJSON-664746092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3414a920-851a-4915-ad11-a6bd9050dc1d {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:29 devstack sudo[89610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3414a920-851a-4915-ad11-a6bd9050dc1d Jul 08 18:34:29 devstack sudo[89610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:30 devstack sudo[89610]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-5e04ee1e-ffd1-4feb-99d8-1579cbbfe259 req-8eeb0d0e-fbd4-4e6b-8b4d-efc17c5f4842 tempest-VolumesGetTestJSON-664746092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3414a920-851a-4915-ad11-a6bd9050dc1d" returned: 0 in 1.175s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-5e04ee1e-ffd1-4feb-99d8-1579cbbfe259 req-8eeb0d0e-fbd4-4e6b-8b4d-efc17c5f4842 tempest-VolumesGetTestJSON-664746092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3414a920-851a-4915-ad11-a6bd9050dc1d {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:30 devstack sudo[89616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3414a920-851a-4915-ad11-a6bd9050dc1d Jul 08 18:34:30 devstack sudo[89616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:31 devstack sudo[89616]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-5e04ee1e-ffd1-4feb-99d8-1579cbbfe259 req-8eeb0d0e-fbd4-4e6b-8b4d-efc17c5f4842 tempest-VolumesGetTestJSON-664746092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3414a920-851a-4915-ad11-a6bd9050dc1d" returned: 0 in 0.878s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:31 devstack cinder-volume[86873]: DEBUG cinder.coordination [req-5e04ee1e-ffd1-4feb-99d8-1579cbbfe259 req-8eeb0d0e-fbd4-4e6b-8b4d-efc17c5f4842 tempest-VolumesGetTestJSON-664746092 None] Lock "cinder-quobyte-3414a920-851a-4915-ad11-a6bd9050dc1d" released by "delete_volume" :: held 2.124s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:34:31 devstack cinder-volume[86873]: DEBUG cinder.quota [req-5e04ee1e-ffd1-4feb-99d8-1579cbbfe259 req-8eeb0d0e-fbd4-4e6b-8b4d-efc17c5f4842 tempest-VolumesGetTestJSON-664746092 None] Created reservations ['198baa55-c818-4a0a-9d19-64d273085738', '712539bf-8f36-427a-a64e-dfa5e9764248', '04bc56f8-a81c-49a9-bda2-345f9b9d77c6', '4981d400-1d91-4884-9ccc-37f2d6f9cf3a'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:34:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-5e04ee1e-ffd1-4feb-99d8-1579cbbfe259 req-8eeb0d0e-fbd4-4e6b-8b4d-efc17c5f4842 tempest-VolumesGetTestJSON-664746092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:34:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-5e04ee1e-ffd1-4feb-99d8-1579cbbfe259 req-8eeb0d0e-fbd4-4e6b-8b4d-efc17c5f4842 tempest-VolumesGetTestJSON-664746092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:34:31 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [req-5e04ee1e-ffd1-4feb-99d8-1579cbbfe259 req-8eeb0d0e-fbd4-4e6b-8b4d-efc17c5f4842 tempest-VolumesGetTestJSON-664746092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:34:31 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [req-5e04ee1e-ffd1-4feb-99d8-1579cbbfe259 req-8eeb0d0e-fbd4-4e6b-8b4d-efc17c5f4842 tempest-VolumesGetTestJSON-664746092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:34:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-5e04ee1e-ffd1-4feb-99d8-1579cbbfe259 req-8eeb0d0e-fbd4-4e6b-8b4d-efc17c5f4842 tempest-VolumesGetTestJSON-664746092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:34:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-5e04ee1e-ffd1-4feb-99d8-1579cbbfe259 req-8eeb0d0e-fbd4-4e6b-8b4d-efc17c5f4842 tempest-VolumesGetTestJSON-664746092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:31 devstack sudo[89637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:34:31 devstack sudo[89637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:32 devstack sudo[89637]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:32 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-5e04ee1e-ffd1-4feb-99d8-1579cbbfe259 req-8eeb0d0e-fbd4-4e6b-8b4d-efc17c5f4842 tempest-VolumesGetTestJSON-664746092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.799s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:32 devstack cinder-volume[86873]: DEBUG cinder.manager [req-5e04ee1e-ffd1-4feb-99d8-1579cbbfe259 req-8eeb0d0e-fbd4-4e6b-8b4d-efc17c5f4842 tempest-VolumesGetTestJSON-664746092 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:34:32 devstack cinder-volume[86873]: INFO cinder.volume.manager [req-5e04ee1e-ffd1-4feb-99d8-1579cbbfe259 req-8eeb0d0e-fbd4-4e6b-8b4d-efc17c5f4842 tempest-VolumesGetTestJSON-664746092 None] Deleted volume successfully. Jul 08 18:34:32 devstack cinder-volume[86873]: DEBUG cinder.coordination [req-5e04ee1e-ffd1-4feb-99d8-1579cbbfe259 req-8eeb0d0e-fbd4-4e6b-8b4d-efc17c5f4842 tempest-VolumesGetTestJSON-664746092 None] Lock "cinder-3414a920-851a-4915-ad11-a6bd9050dc1d-delete_volume" released by "delete_volume" :: held 3.248s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:34:37 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-35dc23fa-52e7-49fb-8b57-d48abfbfecd8 tempest-VolumesTestJSON-199217341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:34:37 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-35dc23fa-52e7-49fb-8b57-d48abfbfecd8 tempest-VolumesTestJSON-199217341 None] Flow 'volume_create_manager' (4c8a865f-3a1a-4096-9649-0b6b69758afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:34:37 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-35dc23fa-52e7-49fb-8b57-d48abfbfecd8 tempest-VolumesTestJSON-199217341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76d3d1e4-88ca-465a-9d87-c9596be8d64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:37 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-35dc23fa-52e7-49fb-8b57-d48abfbfecd8 tempest-VolumesTestJSON-199217341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76d3d1e4-88ca-465a-9d87-c9596be8d64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1357835001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e5b4759-3680-45f1-bde9-6b2ebbbe86eb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aa4901e913be4cb0b7b5d6dfbc6c5e18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:34:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:34:38Z,use_quota=True,user_id='4802ea543ede4bf6ba63f15435ef79e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:37 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-35dc23fa-52e7-49fb-8b57-d48abfbfecd8 tempest-VolumesTestJSON-199217341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff1a8bac-ea8b-4117-b2e7-42c8522ca70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:37 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-35dc23fa-52e7-49fb-8b57-d48abfbfecd8 tempest-VolumesTestJSON-199217341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff1a8bac-ea8b-4117-b2e7-42c8522ca70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:37 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-35dc23fa-52e7-49fb-8b57-d48abfbfecd8 tempest-VolumesTestJSON-199217341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7e9c2fe-09f3-464f-98fe-f7c3383162f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:37 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-35dc23fa-52e7-49fb-8b57-d48abfbfecd8 tempest-VolumesTestJSON-199217341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7e9c2fe-09f3-464f-98fe-f7c3383162f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e5b4759-3680-45f1-bde9-6b2ebbbe86eb', 'volume_name': 'volume-3e5b4759-3680-45f1-bde9-6b2ebbbe86eb', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:37 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-35dc23fa-52e7-49fb-8b57-d48abfbfecd8 tempest-VolumesTestJSON-199217341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b85e5e2c-10d7-4965-b0b7-2684f46fadd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:37 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-35dc23fa-52e7-49fb-8b57-d48abfbfecd8 tempest-VolumesTestJSON-199217341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b85e5e2c-10d7-4965-b0b7-2684f46fadd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:37 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-35dc23fa-52e7-49fb-8b57-d48abfbfecd8 tempest-VolumesTestJSON-199217341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c786075-583e-4db4-982d-03d6d739c207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:37 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-35dc23fa-52e7-49fb-8b57-d48abfbfecd8 tempest-VolumesTestJSON-199217341 None] Volume 3e5b4759-3680-45f1-bde9-6b2ebbbe86eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e5b4759-3680-45f1-bde9-6b2ebbbe86eb', 'volume_size': 1} Jul 08 18:34:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-35dc23fa-52e7-49fb-8b57-d48abfbfecd8 tempest-VolumesTestJSON-199217341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:34:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-35dc23fa-52e7-49fb-8b57-d48abfbfecd8 tempest-VolumesTestJSON-199217341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:34:37 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-35dc23fa-52e7-49fb-8b57-d48abfbfecd8 tempest-VolumesTestJSON-199217341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1357835001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e5b4759-3680-45f1-bde9-6b2ebbbe86eb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aa4901e913be4cb0b7b5d6dfbc6c5e18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:34:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:34:38Z,use_quota=True,user_id='4802ea543ede4bf6ba63f15435ef79e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:34:37 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-35dc23fa-52e7-49fb-8b57-d48abfbfecd8 tempest-VolumesTestJSON-199217341 None] Creating volume 3e5b4759-3680-45f1-bde9-6b2ebbbe86eb {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:34:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-35dc23fa-52e7-49fb-8b57-d48abfbfecd8 tempest-VolumesTestJSON-199217341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:34:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-35dc23fa-52e7-49fb-8b57-d48abfbfecd8 tempest-VolumesTestJSON-199217341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:34:37 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-35dc23fa-52e7-49fb-8b57-d48abfbfecd8 tempest-VolumesTestJSON-199217341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:34:37 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-35dc23fa-52e7-49fb-8b57-d48abfbfecd8 tempest-VolumesTestJSON-199217341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:34:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-35dc23fa-52e7-49fb-8b57-d48abfbfecd8 tempest-VolumesTestJSON-199217341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:34:37 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-35dc23fa-52e7-49fb-8b57-d48abfbfecd8 tempest-VolumesTestJSON-199217341 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:34:37 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-35dc23fa-52e7-49fb-8b57-d48abfbfecd8 tempest-VolumesTestJSON-199217341 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:34:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-35dc23fa-52e7-49fb-8b57-d48abfbfecd8 tempest-VolumesTestJSON-199217341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3e5b4759-3680-45f1-bde9-6b2ebbbe86eb 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:37 devstack sudo[89691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3e5b4759-3680-45f1-bde9-6b2ebbbe86eb 1073741824 Jul 08 18:34:38 devstack sudo[89691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:39 devstack sudo[89691]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:39 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-35dc23fa-52e7-49fb-8b57-d48abfbfecd8 tempest-VolumesTestJSON-199217341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3e5b4759-3680-45f1-bde9-6b2ebbbe86eb 1073741824" returned: 0 in 1.157s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:39 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-35dc23fa-52e7-49fb-8b57-d48abfbfecd8 tempest-VolumesTestJSON-199217341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3e5b4759-3680-45f1-bde9-6b2ebbbe86eb {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:39 devstack sudo[89718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3e5b4759-3680-45f1-bde9-6b2ebbbe86eb Jul 08 18:34:39 devstack sudo[89718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:40 devstack sudo[89718]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-35dc23fa-52e7-49fb-8b57-d48abfbfecd8 tempest-VolumesTestJSON-199217341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3e5b4759-3680-45f1-bde9-6b2ebbbe86eb" returned: 0 in 0.914s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:40 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-35dc23fa-52e7-49fb-8b57-d48abfbfecd8 tempest-VolumesTestJSON-199217341 None] <== create_volume: return (2146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:34:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-35dc23fa-52e7-49fb-8b57-d48abfbfecd8 tempest-VolumesTestJSON-199217341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.150s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:34:40 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-35dc23fa-52e7-49fb-8b57-d48abfbfecd8 tempest-VolumesTestJSON-199217341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c786075-583e-4db4-982d-03d6d739c207) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e5b4759-3680-45f1-bde9-6b2ebbbe86eb', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:40 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-35dc23fa-52e7-49fb-8b57-d48abfbfecd8 tempest-VolumesTestJSON-199217341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9cb5d10-6eab-4207-9a03-e0c7712a510f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:40 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-35dc23fa-52e7-49fb-8b57-d48abfbfecd8 tempest-VolumesTestJSON-199217341 None] Volume volume-3e5b4759-3680-45f1-bde9-6b2ebbbe86eb (3e5b4759-3680-45f1-bde9-6b2ebbbe86eb): created successfully Jul 08 18:34:40 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-35dc23fa-52e7-49fb-8b57-d48abfbfecd8 tempest-VolumesTestJSON-199217341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9cb5d10-6eab-4207-9a03-e0c7712a510f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:40 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-35dc23fa-52e7-49fb-8b57-d48abfbfecd8 tempest-VolumesTestJSON-199217341 None] Flow 'volume_create_manager' (4c8a865f-3a1a-4096-9649-0b6b69758afa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:34:40 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-35dc23fa-52e7-49fb-8b57-d48abfbfecd8 tempest-VolumesTestJSON-199217341 None] Created volume successfully. Jul 08 18:34:42 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-04b70ed2-794c-4132-9d4f-3405412be4d7 tempest-VolumesTestJSON-199217341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:34:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-04b70ed2-794c-4132-9d4f-3405412be4d7 tempest-VolumesTestJSON-199217341 None] Flow 'volume_create_manager' (9b138e0f-5a25-4a0f-8198-da0e76975854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:34:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-04b70ed2-794c-4132-9d4f-3405412be4d7 tempest-VolumesTestJSON-199217341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9a38bf1-d90b-4685-ae15-b42131a82e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-04b70ed2-794c-4132-9d4f-3405412be4d7 tempest-VolumesTestJSON-199217341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9a38bf1-d90b-4685-ae15-b42131a82e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:34:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-139408024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e8d786d-a18b-447d-90f9-5e90d0a43d5a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aa4901e913be4cb0b7b5d6dfbc6c5e18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:34:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:34:42Z,use_quota=True,user_id='4802ea543ede4bf6ba63f15435ef79e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-04b70ed2-794c-4132-9d4f-3405412be4d7 tempest-VolumesTestJSON-199217341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bb1e6ef-23e9-4e94-9125-0f1645941a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-04b70ed2-794c-4132-9d4f-3405412be4d7 tempest-VolumesTestJSON-199217341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bb1e6ef-23e9-4e94-9125-0f1645941a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-04b70ed2-794c-4132-9d4f-3405412be4d7 tempest-VolumesTestJSON-199217341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (835d4c89-d2ec-43bf-8727-2d2f3e2c4f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-04b70ed2-794c-4132-9d4f-3405412be4d7 tempest-VolumesTestJSON-199217341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (835d4c89-d2ec-43bf-8727-2d2f3e2c4f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e8d786d-a18b-447d-90f9-5e90d0a43d5a', 'volume_name': 'volume-1e8d786d-a18b-447d-90f9-5e90d0a43d5a', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-04b70ed2-794c-4132-9d4f-3405412be4d7 tempest-VolumesTestJSON-199217341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62525ed6-4c71-4d9d-b55e-4ca8a56147f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-04b70ed2-794c-4132-9d4f-3405412be4d7 tempest-VolumesTestJSON-199217341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62525ed6-4c71-4d9d-b55e-4ca8a56147f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-04b70ed2-794c-4132-9d4f-3405412be4d7 tempest-VolumesTestJSON-199217341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c46bb9f5-7806-4d8b-9747-b5a1c65d49b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:42 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-04b70ed2-794c-4132-9d4f-3405412be4d7 tempest-VolumesTestJSON-199217341 None] Volume 1e8d786d-a18b-447d-90f9-5e90d0a43d5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e8d786d-a18b-447d-90f9-5e90d0a43d5a', 'volume_size': 1} Jul 08 18:34:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-04b70ed2-794c-4132-9d4f-3405412be4d7 tempest-VolumesTestJSON-199217341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:34:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-04b70ed2-794c-4132-9d4f-3405412be4d7 tempest-VolumesTestJSON-199217341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:34:42 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-04b70ed2-794c-4132-9d4f-3405412be4d7 tempest-VolumesTestJSON-199217341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:34:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-139408024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e8d786d-a18b-447d-90f9-5e90d0a43d5a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aa4901e913be4cb0b7b5d6dfbc6c5e18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:34:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:34:42Z,use_quota=True,user_id='4802ea543ede4bf6ba63f15435ef79e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:34:42 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-04b70ed2-794c-4132-9d4f-3405412be4d7 tempest-VolumesTestJSON-199217341 None] Creating volume 1e8d786d-a18b-447d-90f9-5e90d0a43d5a {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:34:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-04b70ed2-794c-4132-9d4f-3405412be4d7 tempest-VolumesTestJSON-199217341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:34:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-04b70ed2-794c-4132-9d4f-3405412be4d7 tempest-VolumesTestJSON-199217341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:34:42 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-04b70ed2-794c-4132-9d4f-3405412be4d7 tempest-VolumesTestJSON-199217341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:34:42 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-04b70ed2-794c-4132-9d4f-3405412be4d7 tempest-VolumesTestJSON-199217341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:34:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-04b70ed2-794c-4132-9d4f-3405412be4d7 tempest-VolumesTestJSON-199217341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:34:42 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-04b70ed2-794c-4132-9d4f-3405412be4d7 tempest-VolumesTestJSON-199217341 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:34:42 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-04b70ed2-794c-4132-9d4f-3405412be4d7 tempest-VolumesTestJSON-199217341 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:34:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-04b70ed2-794c-4132-9d4f-3405412be4d7 tempest-VolumesTestJSON-199217341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-1e8d786d-a18b-447d-90f9-5e90d0a43d5a 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:42 devstack sudo[89725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-1e8d786d-a18b-447d-90f9-5e90d0a43d5a 1073741824 Jul 08 18:34:42 devstack sudo[89725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:43 devstack sudo[89725]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-04b70ed2-794c-4132-9d4f-3405412be4d7 tempest-VolumesTestJSON-199217341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-1e8d786d-a18b-447d-90f9-5e90d0a43d5a 1073741824" returned: 0 in 1.246s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-04b70ed2-794c-4132-9d4f-3405412be4d7 tempest-VolumesTestJSON-199217341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-1e8d786d-a18b-447d-90f9-5e90d0a43d5a {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:43 devstack sudo[89731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-1e8d786d-a18b-447d-90f9-5e90d0a43d5a Jul 08 18:34:43 devstack sudo[89731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:44 devstack sudo[89731]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-04b70ed2-794c-4132-9d4f-3405412be4d7 tempest-VolumesTestJSON-199217341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-1e8d786d-a18b-447d-90f9-5e90d0a43d5a" returned: 0 in 1.019s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:44 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-04b70ed2-794c-4132-9d4f-3405412be4d7 tempest-VolumesTestJSON-199217341 None] <== create_volume: return (2343ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:34:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-04b70ed2-794c-4132-9d4f-3405412be4d7 tempest-VolumesTestJSON-199217341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.346s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:34:44 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-04b70ed2-794c-4132-9d4f-3405412be4d7 tempest-VolumesTestJSON-199217341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c46bb9f5-7806-4d8b-9747-b5a1c65d49b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e8d786d-a18b-447d-90f9-5e90d0a43d5a', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:44 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-04b70ed2-794c-4132-9d4f-3405412be4d7 tempest-VolumesTestJSON-199217341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76621b30-d698-44b3-acd6-3f1c8e2edb16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:44 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-04b70ed2-794c-4132-9d4f-3405412be4d7 tempest-VolumesTestJSON-199217341 None] Volume volume-1e8d786d-a18b-447d-90f9-5e90d0a43d5a (1e8d786d-a18b-447d-90f9-5e90d0a43d5a): created successfully Jul 08 18:34:44 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-04b70ed2-794c-4132-9d4f-3405412be4d7 tempest-VolumesTestJSON-199217341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76621b30-d698-44b3-acd6-3f1c8e2edb16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:44 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-04b70ed2-794c-4132-9d4f-3405412be4d7 tempest-VolumesTestJSON-199217341 None] Flow 'volume_create_manager' (9b138e0f-5a25-4a0f-8198-da0e76975854) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:34:44 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-04b70ed2-794c-4132-9d4f-3405412be4d7 tempest-VolumesTestJSON-199217341 None] Created volume successfully. Jul 08 18:34:46 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a018f17-3504-4505-b965-c86e9a56ebe5 tempest-VolumesTestJSON-199217341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:34:46 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5a018f17-3504-4505-b965-c86e9a56ebe5 tempest-VolumesTestJSON-199217341 None] Flow 'volume_create_manager' (c07d9e7e-87bb-42a9-8609-82e49736bf25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:34:46 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5a018f17-3504-4505-b965-c86e9a56ebe5 tempest-VolumesTestJSON-199217341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e32d723-a97d-42ba-af17-60330bef3844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:46 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5a018f17-3504-4505-b965-c86e9a56ebe5 tempest-VolumesTestJSON-199217341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e32d723-a97d-42ba-af17-60330bef3844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:34:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-917155973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=676ddc76-8160-427f-9130-a8bee9ae2511,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aa4901e913be4cb0b7b5d6dfbc6c5e18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:34:46Z,use_quota=True,user_id='4802ea543ede4bf6ba63f15435ef79e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:46 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5a018f17-3504-4505-b965-c86e9a56ebe5 tempest-VolumesTestJSON-199217341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85b00320-0706-4342-8b61-b19f9a029b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:46 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5a018f17-3504-4505-b965-c86e9a56ebe5 tempest-VolumesTestJSON-199217341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85b00320-0706-4342-8b61-b19f9a029b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:46 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5a018f17-3504-4505-b965-c86e9a56ebe5 tempest-VolumesTestJSON-199217341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71c5d0c1-4157-4d42-aabd-4ddb577472cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:46 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5a018f17-3504-4505-b965-c86e9a56ebe5 tempest-VolumesTestJSON-199217341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71c5d0c1-4157-4d42-aabd-4ddb577472cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '676ddc76-8160-427f-9130-a8bee9ae2511', 'volume_name': 'volume-676ddc76-8160-427f-9130-a8bee9ae2511', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:46 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5a018f17-3504-4505-b965-c86e9a56ebe5 tempest-VolumesTestJSON-199217341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6c660f8-c4ed-47b9-ab2e-97eab290c88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:46 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5a018f17-3504-4505-b965-c86e9a56ebe5 tempest-VolumesTestJSON-199217341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6c660f8-c4ed-47b9-ab2e-97eab290c88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:46 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5a018f17-3504-4505-b965-c86e9a56ebe5 tempest-VolumesTestJSON-199217341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0930fb82-aa2d-4498-96a2-bea44c317cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:46 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-5a018f17-3504-4505-b965-c86e9a56ebe5 tempest-VolumesTestJSON-199217341 None] Volume 676ddc76-8160-427f-9130-a8bee9ae2511: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-676ddc76-8160-427f-9130-a8bee9ae2511', 'volume_size': 1} Jul 08 18:34:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5a018f17-3504-4505-b965-c86e9a56ebe5 tempest-VolumesTestJSON-199217341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:34:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5a018f17-3504-4505-b965-c86e9a56ebe5 tempest-VolumesTestJSON-199217341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:34:46 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-5a018f17-3504-4505-b965-c86e9a56ebe5 tempest-VolumesTestJSON-199217341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:34:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-917155973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=676ddc76-8160-427f-9130-a8bee9ae2511,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aa4901e913be4cb0b7b5d6dfbc6c5e18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:34:46Z,use_quota=True,user_id='4802ea543ede4bf6ba63f15435ef79e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:34:46 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-5a018f17-3504-4505-b965-c86e9a56ebe5 tempest-VolumesTestJSON-199217341 None] Creating volume 676ddc76-8160-427f-9130-a8bee9ae2511 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:34:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5a018f17-3504-4505-b965-c86e9a56ebe5 tempest-VolumesTestJSON-199217341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:34:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5a018f17-3504-4505-b965-c86e9a56ebe5 tempest-VolumesTestJSON-199217341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:34:46 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-5a018f17-3504-4505-b965-c86e9a56ebe5 tempest-VolumesTestJSON-199217341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:34:46 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-5a018f17-3504-4505-b965-c86e9a56ebe5 tempest-VolumesTestJSON-199217341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:34:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5a018f17-3504-4505-b965-c86e9a56ebe5 tempest-VolumesTestJSON-199217341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:34:46 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-5a018f17-3504-4505-b965-c86e9a56ebe5 tempest-VolumesTestJSON-199217341 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:34:46 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-5a018f17-3504-4505-b965-c86e9a56ebe5 tempest-VolumesTestJSON-199217341 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:34:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5a018f17-3504-4505-b965-c86e9a56ebe5 tempest-VolumesTestJSON-199217341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-676ddc76-8160-427f-9130-a8bee9ae2511 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:46 devstack sudo[89737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-676ddc76-8160-427f-9130-a8bee9ae2511 1073741824 Jul 08 18:34:46 devstack sudo[89737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:47 devstack sudo[89737]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5a018f17-3504-4505-b965-c86e9a56ebe5 tempest-VolumesTestJSON-199217341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-676ddc76-8160-427f-9130-a8bee9ae2511 1073741824" returned: 0 in 1.498s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5a018f17-3504-4505-b965-c86e9a56ebe5 tempest-VolumesTestJSON-199217341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-676ddc76-8160-427f-9130-a8bee9ae2511 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:48 devstack sudo[89743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-676ddc76-8160-427f-9130-a8bee9ae2511 Jul 08 18:34:48 devstack sudo[89743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:48 devstack cinder-volume[86873]: DEBUG oslo_service.periodic_task [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running periodic task VolumeManager._thread_info {{(pid=86873) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:34:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] thread count: 9 {{(pid=86873) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:34:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] thread info: [<_MainThread(MainThread, started 138577734545536)>, , , , , , , , ] {{(pid=86873) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:34:48 devstack sudo[89743]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5a018f17-3504-4505-b965-c86e9a56ebe5 tempest-VolumesTestJSON-199217341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-676ddc76-8160-427f-9130-a8bee9ae2511" returned: 0 in 0.925s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-5a018f17-3504-4505-b965-c86e9a56ebe5 tempest-VolumesTestJSON-199217341 None] <== create_volume: return (2505ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:34:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5a018f17-3504-4505-b965-c86e9a56ebe5 tempest-VolumesTestJSON-199217341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.507s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:34:49 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5a018f17-3504-4505-b965-c86e9a56ebe5 tempest-VolumesTestJSON-199217341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0930fb82-aa2d-4498-96a2-bea44c317cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-676ddc76-8160-427f-9130-a8bee9ae2511', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:49 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5a018f17-3504-4505-b965-c86e9a56ebe5 tempest-VolumesTestJSON-199217341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5f5642c-2cb8-4895-bc4a-b81ffbd9bfff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:49 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-5a018f17-3504-4505-b965-c86e9a56ebe5 tempest-VolumesTestJSON-199217341 None] Volume volume-676ddc76-8160-427f-9130-a8bee9ae2511 (676ddc76-8160-427f-9130-a8bee9ae2511): created successfully Jul 08 18:34:49 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5a018f17-3504-4505-b965-c86e9a56ebe5 tempest-VolumesTestJSON-199217341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5f5642c-2cb8-4895-bc4a-b81ffbd9bfff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:49 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5a018f17-3504-4505-b965-c86e9a56ebe5 tempest-VolumesTestJSON-199217341 None] Flow 'volume_create_manager' (c07d9e7e-87bb-42a9-8609-82e49736bf25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:34:49 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-5a018f17-3504-4505-b965-c86e9a56ebe5 tempest-VolumesTestJSON-199217341 None] Created volume successfully. Jul 08 18:34:51 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-c4ebc47a-a622-46ed-85f3-be6f53782dc7 tempest-VolumesTestJSON-199217341 None] Acquiring lock "cinder-676ddc76-8160-427f-9130-a8bee9ae2511-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:34:51 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-c4ebc47a-a622-46ed-85f3-be6f53782dc7 tempest-VolumesTestJSON-199217341 None] Lock "cinder-676ddc76-8160-427f-9130-a8bee9ae2511-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:34:51 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-c4ebc47a-a622-46ed-85f3-be6f53782dc7 tempest-VolumesTestJSON-199217341 None] Acquiring lock "cinder-quobyte-676ddc76-8160-427f-9130-a8bee9ae2511" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:34:51 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-c4ebc47a-a622-46ed-85f3-be6f53782dc7 tempest-VolumesTestJSON-199217341 None] Lock "cinder-quobyte-676ddc76-8160-427f-9130-a8bee9ae2511" acquired by "delete_volume" :: waited 0.028s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:34:51 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[704190e6-f565-474a-b41f-46759e8bd26e]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:34:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c4ebc47a-a622-46ed-85f3-be6f53782dc7 tempest-VolumesTestJSON-199217341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-676ddc76-8160-427f-9130-a8bee9ae2511 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:51 devstack sudo[89759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-676ddc76-8160-427f-9130-a8bee9ae2511 Jul 08 18:34:51 devstack sudo[89759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:52 devstack sudo[89759]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c4ebc47a-a622-46ed-85f3-be6f53782dc7 tempest-VolumesTestJSON-199217341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-676ddc76-8160-427f-9130-a8bee9ae2511" returned: 0 in 1.040s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c4ebc47a-a622-46ed-85f3-be6f53782dc7 tempest-VolumesTestJSON-199217341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-676ddc76-8160-427f-9130-a8bee9ae2511 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:52 devstack sudo[89785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-676ddc76-8160-427f-9130-a8bee9ae2511 Jul 08 18:34:52 devstack sudo[89785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:53 devstack sudo[89785]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:53 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c4ebc47a-a622-46ed-85f3-be6f53782dc7 tempest-VolumesTestJSON-199217341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-676ddc76-8160-427f-9130-a8bee9ae2511" returned: 0 in 0.872s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:53 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-c4ebc47a-a622-46ed-85f3-be6f53782dc7 tempest-VolumesTestJSON-199217341 None] Lock "cinder-quobyte-676ddc76-8160-427f-9130-a8bee9ae2511" released by "delete_volume" :: held 1.980s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:34:53 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-c4ebc47a-a622-46ed-85f3-be6f53782dc7 tempest-VolumesTestJSON-199217341 None] Created reservations ['c54b7d3a-9bf8-41d8-9f3b-401b872ae610', '25b17407-098e-42aa-99e1-77eb7fa60617', '691b8acd-5ad7-4b7f-b796-755aac5b6d0d', '8936b826-c42e-4a07-9886-e76f158930a6'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:34:53 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c4ebc47a-a622-46ed-85f3-be6f53782dc7 tempest-VolumesTestJSON-199217341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:34:53 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c4ebc47a-a622-46ed-85f3-be6f53782dc7 tempest-VolumesTestJSON-199217341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:34:53 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c4ebc47a-a622-46ed-85f3-be6f53782dc7 tempest-VolumesTestJSON-199217341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:34:53 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c4ebc47a-a622-46ed-85f3-be6f53782dc7 tempest-VolumesTestJSON-199217341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:34:53 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c4ebc47a-a622-46ed-85f3-be6f53782dc7 tempest-VolumesTestJSON-199217341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:34:53 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c4ebc47a-a622-46ed-85f3-be6f53782dc7 tempest-VolumesTestJSON-199217341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:53 devstack sudo[89824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:34:53 devstack sudo[89824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:53 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ca9fa482-fc2e-45a5-bf0c-f778de09dde2 tempest-VolumesTestJSON-199217341 None] Acquiring lock "cinder-1e8d786d-a18b-447d-90f9-5e90d0a43d5a-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:34:53 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ca9fa482-fc2e-45a5-bf0c-f778de09dde2 tempest-VolumesTestJSON-199217341 None] Lock "cinder-1e8d786d-a18b-447d-90f9-5e90d0a43d5a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:34:53 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ca9fa482-fc2e-45a5-bf0c-f778de09dde2 tempest-VolumesTestJSON-199217341 None] Acquiring lock "cinder-quobyte-1e8d786d-a18b-447d-90f9-5e90d0a43d5a" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:34:53 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ca9fa482-fc2e-45a5-bf0c-f778de09dde2 tempest-VolumesTestJSON-199217341 None] Lock "cinder-quobyte-1e8d786d-a18b-447d-90f9-5e90d0a43d5a" acquired by "delete_volume" :: waited 0.014s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:34:53 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7521ec-eb0b-4aa6-ba33-f933568d2cb1]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:34:53 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ca9fa482-fc2e-45a5-bf0c-f778de09dde2 tempest-VolumesTestJSON-199217341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-1e8d786d-a18b-447d-90f9-5e90d0a43d5a {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:53 devstack sudo[89826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-1e8d786d-a18b-447d-90f9-5e90d0a43d5a Jul 08 18:34:53 devstack sudo[89826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:54 devstack sudo[89824]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c4ebc47a-a622-46ed-85f3-be6f53782dc7 tempest-VolumesTestJSON-199217341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.865s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:54 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-c4ebc47a-a622-46ed-85f3-be6f53782dc7 tempest-VolumesTestJSON-199217341 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:34:54 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-c4ebc47a-a622-46ed-85f3-be6f53782dc7 tempest-VolumesTestJSON-199217341 None] Deleted volume successfully. Jul 08 18:34:54 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-c4ebc47a-a622-46ed-85f3-be6f53782dc7 tempest-VolumesTestJSON-199217341 None] Lock "cinder-676ddc76-8160-427f-9130-a8bee9ae2511-delete_volume" released by "delete_volume" :: held 3.138s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:34:54 devstack sudo[89826]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ca9fa482-fc2e-45a5-bf0c-f778de09dde2 tempest-VolumesTestJSON-199217341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-1e8d786d-a18b-447d-90f9-5e90d0a43d5a" returned: 0 in 1.015s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ca9fa482-fc2e-45a5-bf0c-f778de09dde2 tempest-VolumesTestJSON-199217341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-1e8d786d-a18b-447d-90f9-5e90d0a43d5a {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:54 devstack sudo[89832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-1e8d786d-a18b-447d-90f9-5e90d0a43d5a Jul 08 18:34:54 devstack sudo[89832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:55 devstack sudo[89832]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ca9fa482-fc2e-45a5-bf0c-f778de09dde2 tempest-VolumesTestJSON-199217341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-1e8d786d-a18b-447d-90f9-5e90d0a43d5a" returned: 0 in 0.692s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:55 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ca9fa482-fc2e-45a5-bf0c-f778de09dde2 tempest-VolumesTestJSON-199217341 None] Lock "cinder-quobyte-1e8d786d-a18b-447d-90f9-5e90d0a43d5a" released by "delete_volume" :: held 1.781s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:34:55 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-ca9fa482-fc2e-45a5-bf0c-f778de09dde2 tempest-VolumesTestJSON-199217341 None] Created reservations ['c2860015-0db1-4c29-8695-1a115e4ac262', '29dbcae6-79da-43e7-8e41-64694aec0812', '8977ea15-9197-43ff-99ae-5be0455d9914', '353f94e8-bb7c-4af0-987e-805e729a28a8'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:34:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-ca9fa482-fc2e-45a5-bf0c-f778de09dde2 tempest-VolumesTestJSON-199217341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:34:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-ca9fa482-fc2e-45a5-bf0c-f778de09dde2 tempest-VolumesTestJSON-199217341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:34:55 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-ca9fa482-fc2e-45a5-bf0c-f778de09dde2 tempest-VolumesTestJSON-199217341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:34:55 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-ca9fa482-fc2e-45a5-bf0c-f778de09dde2 tempest-VolumesTestJSON-199217341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:34:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-ca9fa482-fc2e-45a5-bf0c-f778de09dde2 tempest-VolumesTestJSON-199217341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:34:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ca9fa482-fc2e-45a5-bf0c-f778de09dde2 tempest-VolumesTestJSON-199217341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:55 devstack sudo[89835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:34:55 devstack sudo[89835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:55 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-959f6fb8-1e0e-4ada-be4d-104cacf2efc3 tempest-VolumesTestJSON-199217341 None] Acquiring lock "cinder-3e5b4759-3680-45f1-bde9-6b2ebbbe86eb-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:34:55 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-959f6fb8-1e0e-4ada-be4d-104cacf2efc3 tempest-VolumesTestJSON-199217341 None] Lock "cinder-3e5b4759-3680-45f1-bde9-6b2ebbbe86eb-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:34:56 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-959f6fb8-1e0e-4ada-be4d-104cacf2efc3 tempest-VolumesTestJSON-199217341 None] Acquiring lock "cinder-quobyte-3e5b4759-3680-45f1-bde9-6b2ebbbe86eb" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:34:56 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-959f6fb8-1e0e-4ada-be4d-104cacf2efc3 tempest-VolumesTestJSON-199217341 None] Lock "cinder-quobyte-3e5b4759-3680-45f1-bde9-6b2ebbbe86eb" acquired by "delete_volume" :: waited 0.028s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:34:56 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[029f4daa-a07f-4d39-8b1d-da4007f83e82]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:34:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-959f6fb8-1e0e-4ada-be4d-104cacf2efc3 tempest-VolumesTestJSON-199217341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3e5b4759-3680-45f1-bde9-6b2ebbbe86eb {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:56 devstack sudo[89837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3e5b4759-3680-45f1-bde9-6b2ebbbe86eb Jul 08 18:34:56 devstack sudo[89837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:56 devstack sudo[89835]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ca9fa482-fc2e-45a5-bf0c-f778de09dde2 tempest-VolumesTestJSON-199217341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 1.169s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:56 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-ca9fa482-fc2e-45a5-bf0c-f778de09dde2 tempest-VolumesTestJSON-199217341 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:34:56 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-ca9fa482-fc2e-45a5-bf0c-f778de09dde2 tempest-VolumesTestJSON-199217341 None] Deleted volume successfully. Jul 08 18:34:56 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ca9fa482-fc2e-45a5-bf0c-f778de09dde2 tempest-VolumesTestJSON-199217341 None] Lock "cinder-1e8d786d-a18b-447d-90f9-5e90d0a43d5a-delete_volume" released by "delete_volume" :: held 3.256s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:34:57 devstack sudo[89837]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-959f6fb8-1e0e-4ada-be4d-104cacf2efc3 tempest-VolumesTestJSON-199217341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3e5b4759-3680-45f1-bde9-6b2ebbbe86eb" returned: 0 in 1.054s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-959f6fb8-1e0e-4ada-be4d-104cacf2efc3 tempest-VolumesTestJSON-199217341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3e5b4759-3680-45f1-bde9-6b2ebbbe86eb {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:57 devstack sudo[89844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3e5b4759-3680-45f1-bde9-6b2ebbbe86eb Jul 08 18:34:57 devstack sudo[89844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:57 devstack sudo[89844]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-959f6fb8-1e0e-4ada-be4d-104cacf2efc3 tempest-VolumesTestJSON-199217341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3e5b4759-3680-45f1-bde9-6b2ebbbe86eb" returned: 0 in 0.809s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:58 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-959f6fb8-1e0e-4ada-be4d-104cacf2efc3 tempest-VolumesTestJSON-199217341 None] Lock "cinder-quobyte-3e5b4759-3680-45f1-bde9-6b2ebbbe86eb" released by "delete_volume" :: held 1.923s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:34:58 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-959f6fb8-1e0e-4ada-be4d-104cacf2efc3 tempest-VolumesTestJSON-199217341 None] Created reservations ['91218513-3e80-4fbc-8617-ec578220ecbe', 'cef80453-f2c6-4023-8275-142f6cf21c31', '66d182ca-7022-4b1d-ad23-d8fe9636a240', 'a76acf19-f042-417e-902a-0f739d9ead3b'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:34:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-959f6fb8-1e0e-4ada-be4d-104cacf2efc3 tempest-VolumesTestJSON-199217341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:34:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-959f6fb8-1e0e-4ada-be4d-104cacf2efc3 tempest-VolumesTestJSON-199217341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:34:58 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-959f6fb8-1e0e-4ada-be4d-104cacf2efc3 tempest-VolumesTestJSON-199217341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:34:58 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-959f6fb8-1e0e-4ada-be4d-104cacf2efc3 tempest-VolumesTestJSON-199217341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:34:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-959f6fb8-1e0e-4ada-be4d-104cacf2efc3 tempest-VolumesTestJSON-199217341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:34:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-959f6fb8-1e0e-4ada-be4d-104cacf2efc3 tempest-VolumesTestJSON-199217341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:58 devstack sudo[89849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:34:58 devstack sudo[89849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:59 devstack sudo[89849]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-959f6fb8-1e0e-4ada-be4d-104cacf2efc3 tempest-VolumesTestJSON-199217341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.919s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:59 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-959f6fb8-1e0e-4ada-be4d-104cacf2efc3 tempest-VolumesTestJSON-199217341 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:34:59 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-959f6fb8-1e0e-4ada-be4d-104cacf2efc3 tempest-VolumesTestJSON-199217341 None] Deleted volume successfully. Jul 08 18:34:59 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-959f6fb8-1e0e-4ada-be4d-104cacf2efc3 tempest-VolumesTestJSON-199217341 None] Lock "cinder-3e5b4759-3680-45f1-bde9-6b2ebbbe86eb-delete_volume" released by "delete_volume" :: held 3.128s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:35:08 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:UPDATE=80,cinder:SELECT=50,cinder:INSERT=13,cinder:DELETE=8 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:35:09 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:SELECT=45,cinder:UPDATE=69,cinder:INSERT=21,cinder:DELETE=5 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:35:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-786225a8-c80b-4d14-af43-be75887eeffa req-e1ef6537-e8f7-4fd5-a965-5a181b6f7597 tempest-TaggedAttachmentsTest-1654568807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:35:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-786225a8-c80b-4d14-af43-be75887eeffa req-e1ef6537-e8f7-4fd5-a965-5a181b6f7597 tempest-TaggedAttachmentsTest-1654568807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:35:22 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3a9a11-a036-4673-944d-b582bf4fdda8]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:35:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-786225a8-c80b-4d14-af43-be75887eeffa req-e1ef6537-e8f7-4fd5-a965-5a181b6f7597 tempest-TaggedAttachmentsTest-1654568807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6d70002c-b84c-4bcb-947c-44f79e01f780 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:22 devstack sudo[90107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6d70002c-b84c-4bcb-947c-44f79e01f780 Jul 08 18:35:22 devstack sudo[90107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:23 devstack sudo[90107]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-786225a8-c80b-4d14-af43-be75887eeffa req-e1ef6537-e8f7-4fd5-a965-5a181b6f7597 tempest-TaggedAttachmentsTest-1654568807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6d70002c-b84c-4bcb-947c-44f79e01f780" returned: 0 in 1.157s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-786225a8-c80b-4d14-af43-be75887eeffa req-e1ef6537-e8f7-4fd5-a965-5a181b6f7597 tempest-TaggedAttachmentsTest-1654568807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.212s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:35:23 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-786225a8-c80b-4d14-af43-be75887eeffa req-e1ef6537-e8f7-4fd5-a965-5a181b6f7597 tempest-TaggedAttachmentsTest-1654568807 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2', 'name': 'volume-6d70002c-b84c-4bcb-947c-44f79e01f780', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '62926e3f-4ebf-458f-b7d3-d308af62c6e4', 'enforce_multipath': True} {{(pid=86873) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 18:35:23 devstack cinder-volume[86873]: INFO cinder.volume.manager [req-786225a8-c80b-4d14-af43-be75887eeffa req-e1ef6537-e8f7-4fd5-a965-5a181b6f7597 tempest-TaggedAttachmentsTest-1654568807 None] attachment_update completed successfully. Jul 08 18:35:25 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a5bc8a2-eb1e-48cd-beb1-728400355de1 tempest-VolumesActionsTest-819162864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:35:25 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-8a5bc8a2-eb1e-48cd-beb1-728400355de1 tempest-VolumesActionsTest-819162864 None] Flow 'volume_create_manager' (49c5131a-1049-426f-ade4-85c3aacd4e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:35:25 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-8a5bc8a2-eb1e-48cd-beb1-728400355de1 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c012c4dc-6311-4e7d-9202-96e193f3403d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:35:25 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-8a5bc8a2-eb1e-48cd-beb1-728400355de1 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c012c4dc-6311-4e7d-9202-96e193f3403d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:35:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2100989423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=166fc047-e2c0-4b9d-b532-5cb6a623027a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e452bbf821a4f7788e64c8d16fa0245',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:35:26Z,use_quota=True,user_id='735015279d074ecba190123935ae97bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:35:25 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-8a5bc8a2-eb1e-48cd-beb1-728400355de1 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68ee4928-e4bf-49c0-a797-8a859fb31384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:35:25 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-8a5bc8a2-eb1e-48cd-beb1-728400355de1 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68ee4928-e4bf-49c0-a797-8a859fb31384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:35:25 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-8a5bc8a2-eb1e-48cd-beb1-728400355de1 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a66e5f7-f255-4ec0-8dbb-20c074e9e8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:35:25 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-8a5bc8a2-eb1e-48cd-beb1-728400355de1 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a66e5f7-f255-4ec0-8dbb-20c074e9e8ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '166fc047-e2c0-4b9d-b532-5cb6a623027a', 'volume_name': 'volume-166fc047-e2c0-4b9d-b532-5cb6a623027a', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:35:25 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-8a5bc8a2-eb1e-48cd-beb1-728400355de1 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bb14b81-9b9a-4c1b-8e75-7d9dc796443f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:35:25 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-8a5bc8a2-eb1e-48cd-beb1-728400355de1 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bb14b81-9b9a-4c1b-8e75-7d9dc796443f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:35:25 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-8a5bc8a2-eb1e-48cd-beb1-728400355de1 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5832fa4a-dea6-4c80-9683-ac4b6b0ba38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:35:25 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-8a5bc8a2-eb1e-48cd-beb1-728400355de1 tempest-VolumesActionsTest-819162864 None] Volume 166fc047-e2c0-4b9d-b532-5cb6a623027a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-166fc047-e2c0-4b9d-b532-5cb6a623027a', 'volume_size': 1} Jul 08 18:35:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-8a5bc8a2-eb1e-48cd-beb1-728400355de1 tempest-VolumesActionsTest-819162864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:35:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-8a5bc8a2-eb1e-48cd-beb1-728400355de1 tempest-VolumesActionsTest-819162864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:35:25 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-8a5bc8a2-eb1e-48cd-beb1-728400355de1 tempest-VolumesActionsTest-819162864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:35:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2100989423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=166fc047-e2c0-4b9d-b532-5cb6a623027a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e452bbf821a4f7788e64c8d16fa0245',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:35:26Z,use_quota=True,user_id='735015279d074ecba190123935ae97bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:35:25 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-8a5bc8a2-eb1e-48cd-beb1-728400355de1 tempest-VolumesActionsTest-819162864 None] Creating volume 166fc047-e2c0-4b9d-b532-5cb6a623027a {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:35:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-8a5bc8a2-eb1e-48cd-beb1-728400355de1 tempest-VolumesActionsTest-819162864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:35:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-8a5bc8a2-eb1e-48cd-beb1-728400355de1 tempest-VolumesActionsTest-819162864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:35:25 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-8a5bc8a2-eb1e-48cd-beb1-728400355de1 tempest-VolumesActionsTest-819162864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:35:25 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-8a5bc8a2-eb1e-48cd-beb1-728400355de1 tempest-VolumesActionsTest-819162864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:35:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-8a5bc8a2-eb1e-48cd-beb1-728400355de1 tempest-VolumesActionsTest-819162864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:35:25 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-8a5bc8a2-eb1e-48cd-beb1-728400355de1 tempest-VolumesActionsTest-819162864 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:35:25 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-8a5bc8a2-eb1e-48cd-beb1-728400355de1 tempest-VolumesActionsTest-819162864 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:35:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8a5bc8a2-eb1e-48cd-beb1-728400355de1 tempest-VolumesActionsTest-819162864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-166fc047-e2c0-4b9d-b532-5cb6a623027a 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:25 devstack sudo[90496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-166fc047-e2c0-4b9d-b532-5cb6a623027a 1073741824 Jul 08 18:35:25 devstack sudo[90496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:27 devstack sudo[90496]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8a5bc8a2-eb1e-48cd-beb1-728400355de1 tempest-VolumesActionsTest-819162864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-166fc047-e2c0-4b9d-b532-5cb6a623027a 1073741824" returned: 0 in 1.375s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8a5bc8a2-eb1e-48cd-beb1-728400355de1 tempest-VolumesActionsTest-819162864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-166fc047-e2c0-4b9d-b532-5cb6a623027a {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:27 devstack sudo[90502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-166fc047-e2c0-4b9d-b532-5cb6a623027a Jul 08 18:35:27 devstack sudo[90502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:28 devstack sudo[90502]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8a5bc8a2-eb1e-48cd-beb1-728400355de1 tempest-VolumesActionsTest-819162864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-166fc047-e2c0-4b9d-b532-5cb6a623027a" returned: 0 in 1.456s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:28 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-8a5bc8a2-eb1e-48cd-beb1-728400355de1 tempest-VolumesActionsTest-819162864 None] <== create_volume: return (2921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:35:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-8a5bc8a2-eb1e-48cd-beb1-728400355de1 tempest-VolumesActionsTest-819162864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.924s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:35:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-8a5bc8a2-eb1e-48cd-beb1-728400355de1 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5832fa4a-dea6-4c80-9683-ac4b6b0ba38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-166fc047-e2c0-4b9d-b532-5cb6a623027a', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:35:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-8a5bc8a2-eb1e-48cd-beb1-728400355de1 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c459a8f4-98bb-4374-91c7-6e05cc40af8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:35:28 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-8a5bc8a2-eb1e-48cd-beb1-728400355de1 tempest-VolumesActionsTest-819162864 None] Volume volume-166fc047-e2c0-4b9d-b532-5cb6a623027a (166fc047-e2c0-4b9d-b532-5cb6a623027a): created successfully Jul 08 18:35:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-8a5bc8a2-eb1e-48cd-beb1-728400355de1 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c459a8f4-98bb-4374-91c7-6e05cc40af8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:35:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-8a5bc8a2-eb1e-48cd-beb1-728400355de1 tempest-VolumesActionsTest-819162864 None] Flow 'volume_create_manager' (49c5131a-1049-426f-ade4-85c3aacd4e9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:35:28 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-8a5bc8a2-eb1e-48cd-beb1-728400355de1 tempest-VolumesActionsTest-819162864 None] Created volume successfully. Jul 08 18:35:28 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-28415823-2c5a-4561-97d8-0afe0e4d699d tempest-VolumesActionsTest-819162864 None] Acquiring lock "cinder-166fc047-e2c0-4b9d-b532-5cb6a623027a" by "attach_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:35:28 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-28415823-2c5a-4561-97d8-0afe0e4d699d tempest-VolumesActionsTest-819162864 None] Lock "cinder-166fc047-e2c0-4b9d-b532-5cb6a623027a" acquired by "attach_volume" :: waited 0.050s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:35:29 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-28415823-2c5a-4561-97d8-0afe0e4d699d tempest-VolumesActionsTest-819162864 None] Attaching volume 166fc047-e2c0-4b9d-b532-5cb6a623027a to instance a6663941-c37a-4b39-8b99-c36eb08db411 at mountpoint /dev/vdb on host None. Jul 08 18:35:29 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-28415823-2c5a-4561-97d8-0afe0e4d699d tempest-VolumesActionsTest-819162864 None] Attach volume completed successfully. Jul 08 18:35:29 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-28415823-2c5a-4561-97d8-0afe0e4d699d tempest-VolumesActionsTest-819162864 None] Lock "cinder-166fc047-e2c0-4b9d-b532-5cb6a623027a" released by "attach_volume" :: held 0.457s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:35:30 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-4ce0c76c-c934-457d-9eb7-cc171209de0f tempest-VolumesActionsTest-428775210 None] Terminate volume connection completed successfully. Jul 08 18:35:31 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-4ce0c76c-c934-457d-9eb7-cc171209de0f tempest-VolumesActionsTest-428775210 None] Acquiring lock "cinder-166fc047-e2c0-4b9d-b532-5cb6a623027a-detach_volume" by "detach_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:35:31 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-4ce0c76c-c934-457d-9eb7-cc171209de0f tempest-VolumesActionsTest-428775210 None] Lock "cinder-166fc047-e2c0-4b9d-b532-5cb6a623027a-detach_volume" acquired by "detach_volume" :: waited 0.047s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:35:31 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-4ce0c76c-c934-457d-9eb7-cc171209de0f tempest-VolumesActionsTest-428775210 None] Detaching volume 166fc047-e2c0-4b9d-b532-5cb6a623027a from instance a6663941-c37a-4b39-8b99-c36eb08db411. Jul 08 18:35:31 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-4ce0c76c-c934-457d-9eb7-cc171209de0f tempest-VolumesActionsTest-428775210 None] Detach volume completed successfully. Jul 08 18:35:31 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-4ce0c76c-c934-457d-9eb7-cc171209de0f tempest-VolumesActionsTest-428775210 None] Lock "cinder-166fc047-e2c0-4b9d-b532-5cb6a623027a-detach_volume" released by "detach_volume" :: held 0.216s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:35:31 devstack cinder-volume[86873]: INFO cinder.volume.manager [req-61ecc07e-6b56-4682-b889-ab30fc19b137 req-2486d03e-b233-4d96-ad6e-478facae79e7 tempest-TaggedAttachmentsTest-1654568807 None] Terminate volume connection completed successfully. Jul 08 18:35:31 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-61ecc07e-6b56-4682-b889-ab30fc19b137 req-2486d03e-b233-4d96-ad6e-478facae79e7 tempest-TaggedAttachmentsTest-1654568807 None] Deleting attachment 62926e3f-4ebf-458f-b7d3-d308af62c6e4. {{(pid=86873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 18:35:32 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-01176b12-1275-427e-ba80-c6b76a40422d tempest-VolumesActionsTest-819162864 None] Acquiring lock "cinder-166fc047-e2c0-4b9d-b532-5cb6a623027a-detach_volume" by "detach_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:35:32 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-01176b12-1275-427e-ba80-c6b76a40422d tempest-VolumesActionsTest-819162864 None] Lock "cinder-166fc047-e2c0-4b9d-b532-5cb6a623027a-detach_volume" acquired by "detach_volume" :: waited 0.043s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:35:32 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-01176b12-1275-427e-ba80-c6b76a40422d tempest-VolumesActionsTest-819162864 None] Volume detach called, but volume not attached. Jul 08 18:35:32 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-01176b12-1275-427e-ba80-c6b76a40422d tempest-VolumesActionsTest-819162864 None] Lock "cinder-166fc047-e2c0-4b9d-b532-5cb6a623027a-detach_volume" released by "detach_volume" :: held 0.051s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:35:33 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-09820a00-393a-4b85-8fea-9ccdfdbfd4c9 tempest-VolumesActionsTest-819162864 None] Acquiring lock "cinder-166fc047-e2c0-4b9d-b532-5cb6a623027a-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:35:33 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-09820a00-393a-4b85-8fea-9ccdfdbfd4c9 tempest-VolumesActionsTest-819162864 None] Lock "cinder-166fc047-e2c0-4b9d-b532-5cb6a623027a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:35:33 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-09820a00-393a-4b85-8fea-9ccdfdbfd4c9 tempest-VolumesActionsTest-819162864 None] Acquiring lock "cinder-quobyte-166fc047-e2c0-4b9d-b532-5cb6a623027a" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:35:33 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-09820a00-393a-4b85-8fea-9ccdfdbfd4c9 tempest-VolumesActionsTest-819162864 None] Lock "cinder-quobyte-166fc047-e2c0-4b9d-b532-5cb6a623027a" acquired by "delete_volume" :: waited 0.049s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:35:33 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc10e5e1-d0e4-4797-a23f-90f8c8f69fa2]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:35:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-09820a00-393a-4b85-8fea-9ccdfdbfd4c9 tempest-VolumesActionsTest-819162864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-166fc047-e2c0-4b9d-b532-5cb6a623027a {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:33 devstack sudo[90544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-166fc047-e2c0-4b9d-b532-5cb6a623027a Jul 08 18:35:33 devstack sudo[90544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:36 devstack sudo[90544]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-09820a00-393a-4b85-8fea-9ccdfdbfd4c9 tempest-VolumesActionsTest-819162864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-166fc047-e2c0-4b9d-b532-5cb6a623027a" returned: 0 in 2.814s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-09820a00-393a-4b85-8fea-9ccdfdbfd4c9 tempest-VolumesActionsTest-819162864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-166fc047-e2c0-4b9d-b532-5cb6a623027a {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:36 devstack sudo[90592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-166fc047-e2c0-4b9d-b532-5cb6a623027a Jul 08 18:35:36 devstack sudo[90592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:37 devstack sudo[90592]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-09820a00-393a-4b85-8fea-9ccdfdbfd4c9 tempest-VolumesActionsTest-819162864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-166fc047-e2c0-4b9d-b532-5cb6a623027a" returned: 0 in 1.566s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:37 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-09820a00-393a-4b85-8fea-9ccdfdbfd4c9 tempest-VolumesActionsTest-819162864 None] Lock "cinder-quobyte-166fc047-e2c0-4b9d-b532-5cb6a623027a" released by "delete_volume" :: held 4.476s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:35:37 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-09820a00-393a-4b85-8fea-9ccdfdbfd4c9 tempest-VolumesActionsTest-819162864 None] Created reservations ['d03f6b45-1956-4bd9-a845-ce54974f9860', '180d27f0-8dae-40e1-8775-ad01ae677c49', '33edd214-a5ab-4cb7-91e2-54fb9da0678c', '27203f71-2253-4526-97f0-a4edb9aa18a1'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:35:38 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-09820a00-393a-4b85-8fea-9ccdfdbfd4c9 tempest-VolumesActionsTest-819162864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:35:38 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-09820a00-393a-4b85-8fea-9ccdfdbfd4c9 tempest-VolumesActionsTest-819162864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:35:38 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-09820a00-393a-4b85-8fea-9ccdfdbfd4c9 tempest-VolumesActionsTest-819162864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:35:38 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-09820a00-393a-4b85-8fea-9ccdfdbfd4c9 tempest-VolumesActionsTest-819162864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:35:38 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-09820a00-393a-4b85-8fea-9ccdfdbfd4c9 tempest-VolumesActionsTest-819162864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.050s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:35:38 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-09820a00-393a-4b85-8fea-9ccdfdbfd4c9 tempest-VolumesActionsTest-819162864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:38 devstack sudo[90614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:35:38 devstack sudo[90614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:39 devstack sudo[90614]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:39 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-09820a00-393a-4b85-8fea-9ccdfdbfd4c9 tempest-VolumesActionsTest-819162864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 1.189s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:39 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-09820a00-393a-4b85-8fea-9ccdfdbfd4c9 tempest-VolumesActionsTest-819162864 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:35:39 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-09820a00-393a-4b85-8fea-9ccdfdbfd4c9 tempest-VolumesActionsTest-819162864 None] Deleted volume successfully. Jul 08 18:35:39 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-09820a00-393a-4b85-8fea-9ccdfdbfd4c9 tempest-VolumesActionsTest-819162864 None] Lock "cinder-166fc047-e2c0-4b9d-b532-5cb6a623027a-delete_volume" released by "delete_volume" :: held 6.357s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:35:47 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-babeb75a-1c47-4227-a47d-cd6a1a137688 tempest-VolumesActionsTest-819162864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:35:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-babeb75a-1c47-4227-a47d-cd6a1a137688 tempest-VolumesActionsTest-819162864 None] Flow 'volume_create_manager' (f7719e3d-2417-48c4-ab54-701e073c7b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:35:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-babeb75a-1c47-4227-a47d-cd6a1a137688 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eeb4a64-cdde-4fbc-af57-825a26aefd7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:35:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-babeb75a-1c47-4227-a47d-cd6a1a137688 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eeb4a64-cdde-4fbc-af57-825a26aefd7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:35:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1334146785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b2bfa84-c0c8-49ae-9e86-dcb728256888,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e452bbf821a4f7788e64c8d16fa0245',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:35:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:35:47Z,use_quota=True,user_id='735015279d074ecba190123935ae97bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:35:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-babeb75a-1c47-4227-a47d-cd6a1a137688 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d2d654e-2129-4d9a-a569-5e262410a770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:35:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-babeb75a-1c47-4227-a47d-cd6a1a137688 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d2d654e-2129-4d9a-a569-5e262410a770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:35:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-babeb75a-1c47-4227-a47d-cd6a1a137688 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a3891b8-2424-4960-aa6d-d49ff12a7318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:35:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-babeb75a-1c47-4227-a47d-cd6a1a137688 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a3891b8-2424-4960-aa6d-d49ff12a7318) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b2bfa84-c0c8-49ae-9e86-dcb728256888', 'volume_name': 'volume-4b2bfa84-c0c8-49ae-9e86-dcb728256888', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:35:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-babeb75a-1c47-4227-a47d-cd6a1a137688 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d324d1cc-e1a9-47f4-a8f0-40e01cca7d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:35:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-babeb75a-1c47-4227-a47d-cd6a1a137688 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d324d1cc-e1a9-47f4-a8f0-40e01cca7d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:35:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-babeb75a-1c47-4227-a47d-cd6a1a137688 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cbec461-711b-4713-a036-7f307cafdec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:35:47 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-babeb75a-1c47-4227-a47d-cd6a1a137688 tempest-VolumesActionsTest-819162864 None] Volume 4b2bfa84-c0c8-49ae-9e86-dcb728256888: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b2bfa84-c0c8-49ae-9e86-dcb728256888', 'volume_size': 1} Jul 08 18:35:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-babeb75a-1c47-4227-a47d-cd6a1a137688 tempest-VolumesActionsTest-819162864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:35:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-babeb75a-1c47-4227-a47d-cd6a1a137688 tempest-VolumesActionsTest-819162864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:35:47 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-babeb75a-1c47-4227-a47d-cd6a1a137688 tempest-VolumesActionsTest-819162864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:35:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1334146785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b2bfa84-c0c8-49ae-9e86-dcb728256888,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e452bbf821a4f7788e64c8d16fa0245',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:35:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:35:47Z,use_quota=True,user_id='735015279d074ecba190123935ae97bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:35:47 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-babeb75a-1c47-4227-a47d-cd6a1a137688 tempest-VolumesActionsTest-819162864 None] Creating volume 4b2bfa84-c0c8-49ae-9e86-dcb728256888 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:35:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-babeb75a-1c47-4227-a47d-cd6a1a137688 tempest-VolumesActionsTest-819162864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:35:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-babeb75a-1c47-4227-a47d-cd6a1a137688 tempest-VolumesActionsTest-819162864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:35:47 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-babeb75a-1c47-4227-a47d-cd6a1a137688 tempest-VolumesActionsTest-819162864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:35:47 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-babeb75a-1c47-4227-a47d-cd6a1a137688 tempest-VolumesActionsTest-819162864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:35:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-babeb75a-1c47-4227-a47d-cd6a1a137688 tempest-VolumesActionsTest-819162864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:35:47 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-babeb75a-1c47-4227-a47d-cd6a1a137688 tempest-VolumesActionsTest-819162864 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:35:47 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-babeb75a-1c47-4227-a47d-cd6a1a137688 tempest-VolumesActionsTest-819162864 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:35:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-babeb75a-1c47-4227-a47d-cd6a1a137688 tempest-VolumesActionsTest-819162864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4b2bfa84-c0c8-49ae-9e86-dcb728256888 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:47 devstack sudo[90739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4b2bfa84-c0c8-49ae-9e86-dcb728256888 1073741824 Jul 08 18:35:47 devstack sudo[90739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:48 devstack cinder-volume[86873]: DEBUG oslo_service.periodic_task [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86873) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:35:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:35:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:35:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:35:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:35:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.047s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:35:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:48 devstack sudo[90741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:35:48 devstack sudo[90741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:49 devstack sudo[90741]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 1.323s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:49 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:35:49 devstack cinder-volume[86873]: DEBUG oslo_service.periodic_task [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running periodic task VolumeManager._thread_info {{(pid=86873) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:35:49 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] thread count: 9 {{(pid=86873) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:35:49 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] thread info: [<_MainThread(MainThread, started 138577734545536)>, , , , , , , , ] {{(pid=86873) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:35:49 devstack sudo[90739]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-babeb75a-1c47-4227-a47d-cd6a1a137688 tempest-VolumesActionsTest-819162864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4b2bfa84-c0c8-49ae-9e86-dcb728256888 1073741824" returned: 0 in 2.101s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-babeb75a-1c47-4227-a47d-cd6a1a137688 tempest-VolumesActionsTest-819162864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4b2bfa84-c0c8-49ae-9e86-dcb728256888 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:49 devstack sudo[90750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4b2bfa84-c0c8-49ae-9e86-dcb728256888 Jul 08 18:35:49 devstack sudo[90750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:50 devstack sudo[90750]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-babeb75a-1c47-4227-a47d-cd6a1a137688 tempest-VolumesActionsTest-819162864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4b2bfa84-c0c8-49ae-9e86-dcb728256888" returned: 0 in 1.097s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:50 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-babeb75a-1c47-4227-a47d-cd6a1a137688 tempest-VolumesActionsTest-819162864 None] <== create_volume: return (3300ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:35:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-babeb75a-1c47-4227-a47d-cd6a1a137688 tempest-VolumesActionsTest-819162864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.318s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:35:50 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-babeb75a-1c47-4227-a47d-cd6a1a137688 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cbec461-711b-4713-a036-7f307cafdec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b2bfa84-c0c8-49ae-9e86-dcb728256888', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:35:50 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-babeb75a-1c47-4227-a47d-cd6a1a137688 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6625f25c-a991-4003-adce-de157861a692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:35:50 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-babeb75a-1c47-4227-a47d-cd6a1a137688 tempest-VolumesActionsTest-819162864 None] Volume volume-4b2bfa84-c0c8-49ae-9e86-dcb728256888 (4b2bfa84-c0c8-49ae-9e86-dcb728256888): created successfully Jul 08 18:35:50 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-babeb75a-1c47-4227-a47d-cd6a1a137688 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6625f25c-a991-4003-adce-de157861a692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:35:50 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-babeb75a-1c47-4227-a47d-cd6a1a137688 tempest-VolumesActionsTest-819162864 None] Flow 'volume_create_manager' (f7719e3d-2417-48c4-ab54-701e073c7b19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:35:50 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-babeb75a-1c47-4227-a47d-cd6a1a137688 tempest-VolumesActionsTest-819162864 None] Created volume successfully. Jul 08 18:35:51 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-c8f1d444-cc77-4017-ac3e-13e4840a0298 tempest-VolumesActionsTest-428775210 None] Acquiring lock "cinder-4b2bfa84-c0c8-49ae-9e86-dcb728256888-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:35:52 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-c8f1d444-cc77-4017-ac3e-13e4840a0298 tempest-VolumesActionsTest-428775210 None] Lock "cinder-4b2bfa84-c0c8-49ae-9e86-dcb728256888-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:35:52 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-c8f1d444-cc77-4017-ac3e-13e4840a0298 tempest-VolumesActionsTest-428775210 None] Acquiring lock "cinder-quobyte-4b2bfa84-c0c8-49ae-9e86-dcb728256888" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:35:52 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-c8f1d444-cc77-4017-ac3e-13e4840a0298 tempest-VolumesActionsTest-428775210 None] Lock "cinder-quobyte-4b2bfa84-c0c8-49ae-9e86-dcb728256888" acquired by "delete_volume" :: waited 0.045s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:35:52 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc37789-9065-4586-b02c-c94c8e8bbeb1]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:35:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c8f1d444-cc77-4017-ac3e-13e4840a0298 tempest-VolumesActionsTest-428775210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4b2bfa84-c0c8-49ae-9e86-dcb728256888 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:52 devstack sudo[90782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4b2bfa84-c0c8-49ae-9e86-dcb728256888 Jul 08 18:35:52 devstack sudo[90782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:53 devstack sudo[90782]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:53 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c8f1d444-cc77-4017-ac3e-13e4840a0298 tempest-VolumesActionsTest-428775210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4b2bfa84-c0c8-49ae-9e86-dcb728256888" returned: 0 in 1.329s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:53 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c8f1d444-cc77-4017-ac3e-13e4840a0298 tempest-VolumesActionsTest-428775210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4b2bfa84-c0c8-49ae-9e86-dcb728256888 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:53 devstack sudo[90833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4b2bfa84-c0c8-49ae-9e86-dcb728256888 Jul 08 18:35:53 devstack sudo[90833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:53 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-db9e7063-8e6c-4462-ae13-4c55f2b1673d tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:35:53 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-db9e7063-8e6c-4462-ae13-4c55f2b1673d tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Flow 'volume_create_manager' (0f4f139d-f578-4563-be78-2e693bbd1b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:35:53 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-db9e7063-8e6c-4462-ae13-4c55f2b1673d tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b14ee785-85ae-4e75-9221-8674bba4d245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:35:53 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-db9e7063-8e6c-4462-ae13-4c55f2b1673d tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b14ee785-85ae-4e75-9221-8674bba4d245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:35:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2131872827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e60eae4-4f30-4b40-ba4b-77b117cf9fa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8d1b78278974b9b9df3bf67f25019bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:35:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:35:54Z,use_quota=True,user_id='a05c1a5f66704f0297a8e5fa6998e614',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:35:53 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-db9e7063-8e6c-4462-ae13-4c55f2b1673d tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cf4b8c1-9802-4b74-9fa0-04e69d053555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:35:53 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-db9e7063-8e6c-4462-ae13-4c55f2b1673d tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cf4b8c1-9802-4b74-9fa0-04e69d053555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:35:53 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-db9e7063-8e6c-4462-ae13-4c55f2b1673d tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5194c9d2-7f30-4bca-aa72-3973cbf29b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:35:53 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-db9e7063-8e6c-4462-ae13-4c55f2b1673d tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5194c9d2-7f30-4bca-aa72-3973cbf29b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e60eae4-4f30-4b40-ba4b-77b117cf9fa1', 'volume_name': 'volume-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:35:53 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-db9e7063-8e6c-4462-ae13-4c55f2b1673d tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (131631de-fdb8-4b57-b042-22bc88f0199e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:35:53 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-db9e7063-8e6c-4462-ae13-4c55f2b1673d tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (131631de-fdb8-4b57-b042-22bc88f0199e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:35:53 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-db9e7063-8e6c-4462-ae13-4c55f2b1673d tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (656fcbc9-3951-491d-b34f-7f0f93fdf8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:35:53 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-db9e7063-8e6c-4462-ae13-4c55f2b1673d tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Volume 9e60eae4-4f30-4b40-ba4b-77b117cf9fa1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1', 'volume_size': 1} Jul 08 18:35:53 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-db9e7063-8e6c-4462-ae13-4c55f2b1673d tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:35:53 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-db9e7063-8e6c-4462-ae13-4c55f2b1673d tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:35:53 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-db9e7063-8e6c-4462-ae13-4c55f2b1673d tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:35:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2131872827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e60eae4-4f30-4b40-ba4b-77b117cf9fa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8d1b78278974b9b9df3bf67f25019bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:35:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:35:54Z,use_quota=True,user_id='a05c1a5f66704f0297a8e5fa6998e614',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:35:53 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-db9e7063-8e6c-4462-ae13-4c55f2b1673d tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Creating volume 9e60eae4-4f30-4b40-ba4b-77b117cf9fa1 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:35:53 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-db9e7063-8e6c-4462-ae13-4c55f2b1673d tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:35:53 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-db9e7063-8e6c-4462-ae13-4c55f2b1673d tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:35:53 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-db9e7063-8e6c-4462-ae13-4c55f2b1673d tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:35:53 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-db9e7063-8e6c-4462-ae13-4c55f2b1673d tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:35:53 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-db9e7063-8e6c-4462-ae13-4c55f2b1673d tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:35:53 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-db9e7063-8e6c-4462-ae13-4c55f2b1673d tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:35:53 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-db9e7063-8e6c-4462-ae13-4c55f2b1673d tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:35:53 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-db9e7063-8e6c-4462-ae13-4c55f2b1673d tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:53 devstack sudo[90837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1 1073741824 Jul 08 18:35:53 devstack sudo[90837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:54 devstack sudo[90833]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c8f1d444-cc77-4017-ac3e-13e4840a0298 tempest-VolumesActionsTest-428775210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4b2bfa84-c0c8-49ae-9e86-dcb728256888" returned: 0 in 1.020s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:54 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-0e4398d4-3645-4fe7-848f-083126e2ad41 tempest-TaggedAttachmentsTest-1654568807 None] Acquiring lock "cinder-6d70002c-b84c-4bcb-947c-44f79e01f780-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:35:54 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-c8f1d444-cc77-4017-ac3e-13e4840a0298 tempest-VolumesActionsTest-428775210 None] Lock "cinder-quobyte-4b2bfa84-c0c8-49ae-9e86-dcb728256888" released by "delete_volume" :: held 2.454s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:35:54 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-0e4398d4-3645-4fe7-848f-083126e2ad41 tempest-TaggedAttachmentsTest-1654568807 None] Lock "cinder-6d70002c-b84c-4bcb-947c-44f79e01f780-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:35:54 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-c8f1d444-cc77-4017-ac3e-13e4840a0298 tempest-VolumesActionsTest-428775210 None] Created reservations ['20e38484-3925-414d-8198-a6a8e1c1c827', 'f658a539-1e44-4f89-b3a4-f893e4fb8a9e', '8bdeba25-f425-49be-8477-9d10a5d812a0', '4892ce54-f500-4836-8fb1-adc0872fe7a6'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:35:54 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-0e4398d4-3645-4fe7-848f-083126e2ad41 tempest-TaggedAttachmentsTest-1654568807 None] Acquiring lock "cinder-quobyte-6d70002c-b84c-4bcb-947c-44f79e01f780" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:35:54 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-0e4398d4-3645-4fe7-848f-083126e2ad41 tempest-TaggedAttachmentsTest-1654568807 None] Lock "cinder-quobyte-6d70002c-b84c-4bcb-947c-44f79e01f780" acquired by "delete_volume" :: waited 0.022s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:35:54 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b9365f-bbaf-45f4-9191-92ec044cf570]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:35:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-0e4398d4-3645-4fe7-848f-083126e2ad41 tempest-TaggedAttachmentsTest-1654568807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6d70002c-b84c-4bcb-947c-44f79e01f780 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c8f1d444-cc77-4017-ac3e-13e4840a0298 tempest-VolumesActionsTest-428775210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:35:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c8f1d444-cc77-4017-ac3e-13e4840a0298 tempest-VolumesActionsTest-428775210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:35:54 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c8f1d444-cc77-4017-ac3e-13e4840a0298 tempest-VolumesActionsTest-428775210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:35:54 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c8f1d444-cc77-4017-ac3e-13e4840a0298 tempest-VolumesActionsTest-428775210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:35:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c8f1d444-cc77-4017-ac3e-13e4840a0298 tempest-VolumesActionsTest-428775210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:35:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c8f1d444-cc77-4017-ac3e-13e4840a0298 tempest-VolumesActionsTest-428775210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:54 devstack sudo[90845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:35:54 devstack sudo[90845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:54 devstack sudo[90844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6d70002c-b84c-4bcb-947c-44f79e01f780 Jul 08 18:35:54 devstack sudo[90844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:55 devstack sudo[90837]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-db9e7063-8e6c-4462-ae13-4c55f2b1673d tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1 1073741824" returned: 0 in 1.159s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-db9e7063-8e6c-4462-ae13-4c55f2b1673d tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:55 devstack sudo[90853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1 Jul 08 18:35:55 devstack sudo[90853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:55 devstack sudo[90845]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c8f1d444-cc77-4017-ac3e-13e4840a0298 tempest-VolumesActionsTest-428775210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.786s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:55 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-c8f1d444-cc77-4017-ac3e-13e4840a0298 tempest-VolumesActionsTest-428775210 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:35:55 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-c8f1d444-cc77-4017-ac3e-13e4840a0298 tempest-VolumesActionsTest-428775210 None] Deleted volume successfully. Jul 08 18:35:55 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-c8f1d444-cc77-4017-ac3e-13e4840a0298 tempest-VolumesActionsTest-428775210 None] Lock "cinder-4b2bfa84-c0c8-49ae-9e86-dcb728256888-delete_volume" released by "delete_volume" :: held 3.569s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:35:55 devstack sudo[90844]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-0e4398d4-3645-4fe7-848f-083126e2ad41 tempest-TaggedAttachmentsTest-1654568807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6d70002c-b84c-4bcb-947c-44f79e01f780" returned: 0 in 0.952s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-0e4398d4-3645-4fe7-848f-083126e2ad41 tempest-TaggedAttachmentsTest-1654568807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6d70002c-b84c-4bcb-947c-44f79e01f780 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:55 devstack sudo[90860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6d70002c-b84c-4bcb-947c-44f79e01f780 Jul 08 18:35:55 devstack sudo[90860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:56 devstack sudo[90853]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-db9e7063-8e6c-4462-ae13-4c55f2b1673d tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1" returned: 0 in 0.881s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:56 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-db9e7063-8e6c-4462-ae13-4c55f2b1673d tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] <== create_volume: return (2105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:35:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-db9e7063-8e6c-4462-ae13-4c55f2b1673d tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.107s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:35:56 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-db9e7063-8e6c-4462-ae13-4c55f2b1673d tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (656fcbc9-3951-491d-b34f-7f0f93fdf8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:35:56 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-db9e7063-8e6c-4462-ae13-4c55f2b1673d tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9790d9f-44af-4065-bdc3-9dcfeef3a4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:35:56 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-2052f95b-79e5-4d7b-a4cd-4d4b0a750e21 tempest-VolumesActionsTest-819162864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:35:56 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2052f95b-79e5-4d7b-a4cd-4d4b0a750e21 tempest-VolumesActionsTest-819162864 None] Flow 'volume_create_manager' (591a9bd2-dcef-479f-9050-226119a76572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:35:56 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2052f95b-79e5-4d7b-a4cd-4d4b0a750e21 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (191ce0cd-67cb-44f5-bbc9-5f76ab0650bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:35:56 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-db9e7063-8e6c-4462-ae13-4c55f2b1673d tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Volume volume-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1 (9e60eae4-4f30-4b40-ba4b-77b117cf9fa1): created successfully Jul 08 18:35:56 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-db9e7063-8e6c-4462-ae13-4c55f2b1673d tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9790d9f-44af-4065-bdc3-9dcfeef3a4d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:35:56 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-db9e7063-8e6c-4462-ae13-4c55f2b1673d tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Flow 'volume_create_manager' (0f4f139d-f578-4563-be78-2e693bbd1b46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:35:56 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2052f95b-79e5-4d7b-a4cd-4d4b0a750e21 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (191ce0cd-67cb-44f5-bbc9-5f76ab0650bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2141773516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01db4163-3998-45c4-bc92-3ab3f21688d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e452bbf821a4f7788e64c8d16fa0245',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:35:56Z,use_quota=True,user_id='735015279d074ecba190123935ae97bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:35:56 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2052f95b-79e5-4d7b-a4cd-4d4b0a750e21 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90ada265-0bd3-4559-84e2-90ebba5a7127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:35:56 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2052f95b-79e5-4d7b-a4cd-4d4b0a750e21 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90ada265-0bd3-4559-84e2-90ebba5a7127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:35:56 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2052f95b-79e5-4d7b-a4cd-4d4b0a750e21 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6193a865-fbc5-4402-adc1-bdc3e179727c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:35:56 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2052f95b-79e5-4d7b-a4cd-4d4b0a750e21 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6193a865-fbc5-4402-adc1-bdc3e179727c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01db4163-3998-45c4-bc92-3ab3f21688d5', 'volume_name': 'volume-01db4163-3998-45c4-bc92-3ab3f21688d5', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:35:56 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2052f95b-79e5-4d7b-a4cd-4d4b0a750e21 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6999583c-5f01-40d8-9ecf-440b3db732c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:35:56 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2052f95b-79e5-4d7b-a4cd-4d4b0a750e21 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6999583c-5f01-40d8-9ecf-440b3db732c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:35:56 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2052f95b-79e5-4d7b-a4cd-4d4b0a750e21 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9300f6e-b0b4-4ce5-aeca-32837c7b9ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:35:56 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-2052f95b-79e5-4d7b-a4cd-4d4b0a750e21 tempest-VolumesActionsTest-819162864 None] Volume 01db4163-3998-45c4-bc92-3ab3f21688d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01db4163-3998-45c4-bc92-3ab3f21688d5', 'volume_size': 1} Jul 08 18:35:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-2052f95b-79e5-4d7b-a4cd-4d4b0a750e21 tempest-VolumesActionsTest-819162864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:35:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-2052f95b-79e5-4d7b-a4cd-4d4b0a750e21 tempest-VolumesActionsTest-819162864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:35:56 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-2052f95b-79e5-4d7b-a4cd-4d4b0a750e21 tempest-VolumesActionsTest-819162864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2141773516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01db4163-3998-45c4-bc92-3ab3f21688d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e452bbf821a4f7788e64c8d16fa0245',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:35:56Z,use_quota=True,user_id='735015279d074ecba190123935ae97bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:35:56 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-2052f95b-79e5-4d7b-a4cd-4d4b0a750e21 tempest-VolumesActionsTest-819162864 None] Creating volume 01db4163-3998-45c4-bc92-3ab3f21688d5 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:35:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-2052f95b-79e5-4d7b-a4cd-4d4b0a750e21 tempest-VolumesActionsTest-819162864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:35:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-2052f95b-79e5-4d7b-a4cd-4d4b0a750e21 tempest-VolumesActionsTest-819162864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:35:56 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-2052f95b-79e5-4d7b-a4cd-4d4b0a750e21 tempest-VolumesActionsTest-819162864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:35:56 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-2052f95b-79e5-4d7b-a4cd-4d4b0a750e21 tempest-VolumesActionsTest-819162864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:35:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-2052f95b-79e5-4d7b-a4cd-4d4b0a750e21 tempest-VolumesActionsTest-819162864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:35:56 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-2052f95b-79e5-4d7b-a4cd-4d4b0a750e21 tempest-VolumesActionsTest-819162864 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:35:56 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-2052f95b-79e5-4d7b-a4cd-4d4b0a750e21 tempest-VolumesActionsTest-819162864 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:35:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2052f95b-79e5-4d7b-a4cd-4d4b0a750e21 tempest-VolumesActionsTest-819162864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-01db4163-3998-45c4-bc92-3ab3f21688d5 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:56 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-db9e7063-8e6c-4462-ae13-4c55f2b1673d tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Created volume successfully. Jul 08 18:35:56 devstack sudo[90863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-01db4163-3998-45c4-bc92-3ab3f21688d5 1073741824 Jul 08 18:35:56 devstack sudo[90863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:56 devstack sudo[90860]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-0e4398d4-3645-4fe7-848f-083126e2ad41 tempest-TaggedAttachmentsTest-1654568807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6d70002c-b84c-4bcb-947c-44f79e01f780" returned: 0 in 0.738s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:56 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-0e4398d4-3645-4fe7-848f-083126e2ad41 tempest-TaggedAttachmentsTest-1654568807 None] Lock "cinder-quobyte-6d70002c-b84c-4bcb-947c-44f79e01f780" released by "delete_volume" :: held 1.740s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:35:56 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-0e4398d4-3645-4fe7-848f-083126e2ad41 tempest-TaggedAttachmentsTest-1654568807 None] Created reservations ['84ed9dc1-ce0a-49f0-8598-7473e03ae6e2', '2adb62d4-e4ed-44ef-a31b-dc7606dfe8e2', 'd2479091-441a-4d89-9df6-ece3a555f504', '947e2fcb-ac86-4e62-8a09-2ba9b3f714c8'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:35:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-0e4398d4-3645-4fe7-848f-083126e2ad41 tempest-TaggedAttachmentsTest-1654568807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:35:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-0e4398d4-3645-4fe7-848f-083126e2ad41 tempest-TaggedAttachmentsTest-1654568807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:35:56 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-0e4398d4-3645-4fe7-848f-083126e2ad41 tempest-TaggedAttachmentsTest-1654568807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:35:56 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-0e4398d4-3645-4fe7-848f-083126e2ad41 tempest-TaggedAttachmentsTest-1654568807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:35:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-0e4398d4-3645-4fe7-848f-083126e2ad41 tempest-TaggedAttachmentsTest-1654568807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:35:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-0e4398d4-3645-4fe7-848f-083126e2ad41 tempest-TaggedAttachmentsTest-1654568807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:56 devstack sudo[90866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:35:56 devstack sudo[90866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-bd57d718-4aee-430d-bdca-5fb9f8468bd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:35:57 devstack sudo[90863]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2052f95b-79e5-4d7b-a4cd-4d4b0a750e21 tempest-VolumesActionsTest-819162864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-01db4163-3998-45c4-bc92-3ab3f21688d5 1073741824" returned: 0 in 1.118s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:57 devstack sudo[90866]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-0e4398d4-3645-4fe7-848f-083126e2ad41 tempest-TaggedAttachmentsTest-1654568807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.801s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:57 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-0e4398d4-3645-4fe7-848f-083126e2ad41 tempest-TaggedAttachmentsTest-1654568807 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:35:57 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-0e4398d4-3645-4fe7-848f-083126e2ad41 tempest-TaggedAttachmentsTest-1654568807 None] Deleted volume successfully. Jul 08 18:35:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2052f95b-79e5-4d7b-a4cd-4d4b0a750e21 tempest-VolumesActionsTest-819162864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-01db4163-3998-45c4-bc92-3ab3f21688d5 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:57 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-0e4398d4-3645-4fe7-848f-083126e2ad41 tempest-TaggedAttachmentsTest-1654568807 None] Lock "cinder-6d70002c-b84c-4bcb-947c-44f79e01f780-delete_volume" released by "delete_volume" :: held 2.800s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:35:57 devstack sudo[90874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-01db4163-3998-45c4-bc92-3ab3f21688d5 Jul 08 18:35:57 devstack sudo[90874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:58 devstack sudo[90874]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2052f95b-79e5-4d7b-a4cd-4d4b0a750e21 tempest-VolumesActionsTest-819162864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-01db4163-3998-45c4-bc92-3ab3f21688d5" returned: 0 in 0.731s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:58 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-2052f95b-79e5-4d7b-a4cd-4d4b0a750e21 tempest-VolumesActionsTest-819162864 None] <== create_volume: return (1904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:35:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-2052f95b-79e5-4d7b-a4cd-4d4b0a750e21 tempest-VolumesActionsTest-819162864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.907s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:35:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-bd57d718-4aee-430d-bdca-5fb9f8468bd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.869s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:35:58 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-bd57d718-4aee-430d-bdca-5fb9f8468bd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Creating offline snapshot f2cbf523-62c8-4493-a893-cc2832a7e136 of volume 9e60eae4-4f30-4b40-ba4b-77b117cf9fa1 {{(pid=86873) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:35:58 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2052f95b-79e5-4d7b-a4cd-4d4b0a750e21 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9300f6e-b0b4-4ce5-aeca-32837c7b9ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01db4163-3998-45c4-bc92-3ab3f21688d5', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:35:58 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2052f95b-79e5-4d7b-a4cd-4d4b0a750e21 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65b2c26e-4e98-43f9-92f0-1df731639a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:35:58 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[5536e613-1f13-4e94-a086-c1f59426af75]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:35:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-bd57d718-4aee-430d-bdca-5fb9f8468bd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:58 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-2052f95b-79e5-4d7b-a4cd-4d4b0a750e21 tempest-VolumesActionsTest-819162864 None] Volume volume-01db4163-3998-45c4-bc92-3ab3f21688d5 (01db4163-3998-45c4-bc92-3ab3f21688d5): created successfully Jul 08 18:35:58 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2052f95b-79e5-4d7b-a4cd-4d4b0a750e21 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65b2c26e-4e98-43f9-92f0-1df731639a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:35:58 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2052f95b-79e5-4d7b-a4cd-4d4b0a750e21 tempest-VolumesActionsTest-819162864 None] Flow 'volume_create_manager' (591a9bd2-dcef-479f-9050-226119a76572) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:35:58 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-2052f95b-79e5-4d7b-a4cd-4d4b0a750e21 tempest-VolumesActionsTest-819162864 None] Created volume successfully. Jul 08 18:35:58 devstack sudo[90877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1 Jul 08 18:35:58 devstack sudo[90877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:58 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-f580c422-b7ba-4bee-ba76-b02eb85e36cb tempest-ServersNegativeTestJSON-1330942785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:35:58 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f580c422-b7ba-4bee-ba76-b02eb85e36cb tempest-ServersNegativeTestJSON-1330942785 None] Flow 'volume_create_manager' (a8e85fd6-fbaf-44e2-978d-717827ceefcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:35:58 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f580c422-b7ba-4bee-ba76-b02eb85e36cb tempest-ServersNegativeTestJSON-1330942785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dccd3929-c7aa-44b2-a3fd-494de4b5cb86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:35:58 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f580c422-b7ba-4bee-ba76-b02eb85e36cb tempest-ServersNegativeTestJSON-1330942785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dccd3929-c7aa-44b2-a3fd-494de4b5cb86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:35:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-799652184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6403d89c-465b-408f-b58d-496793050d9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91d4c1fa492b4732bb51615d09741adf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:35:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:35:59Z,use_quota=True,user_id='80e00ca44171410fa6caf132f2069523',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:35:58 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f580c422-b7ba-4bee-ba76-b02eb85e36cb tempest-ServersNegativeTestJSON-1330942785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e1f0ce3-c40f-49c7-8fb0-a9bd605e1165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:35:59 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f580c422-b7ba-4bee-ba76-b02eb85e36cb tempest-ServersNegativeTestJSON-1330942785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e1f0ce3-c40f-49c7-8fb0-a9bd605e1165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:35:59 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f580c422-b7ba-4bee-ba76-b02eb85e36cb tempest-ServersNegativeTestJSON-1330942785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05a06732-e523-4a5a-b420-b40a6d6ff21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:35:59 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f580c422-b7ba-4bee-ba76-b02eb85e36cb tempest-ServersNegativeTestJSON-1330942785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05a06732-e523-4a5a-b420-b40a6d6ff21a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6403d89c-465b-408f-b58d-496793050d9c', 'volume_name': 'volume-6403d89c-465b-408f-b58d-496793050d9c', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:35:59 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f580c422-b7ba-4bee-ba76-b02eb85e36cb tempest-ServersNegativeTestJSON-1330942785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96c06231-01ab-4e34-94eb-f06f2c30de2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:35:59 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f580c422-b7ba-4bee-ba76-b02eb85e36cb tempest-ServersNegativeTestJSON-1330942785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96c06231-01ab-4e34-94eb-f06f2c30de2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:35:59 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f580c422-b7ba-4bee-ba76-b02eb85e36cb tempest-ServersNegativeTestJSON-1330942785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a007c60f-6747-430f-a2af-eb8c34f2ca85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:35:59 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-f580c422-b7ba-4bee-ba76-b02eb85e36cb tempest-ServersNegativeTestJSON-1330942785 None] Volume 6403d89c-465b-408f-b58d-496793050d9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6403d89c-465b-408f-b58d-496793050d9c', 'volume_size': 1} Jul 08 18:35:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f580c422-b7ba-4bee-ba76-b02eb85e36cb tempest-ServersNegativeTestJSON-1330942785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:35:59 devstack sudo[90877]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-bd57d718-4aee-430d-bdca-5fb9f8468bd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1" returned: 0 in 0.926s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-bd57d718-4aee-430d-bdca-5fb9f8468bd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1.f2cbf523-62c8-4493-a893-cc2832a7e136 1G {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:59 devstack sudo[90884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1.f2cbf523-62c8-4493-a893-cc2832a7e136 1G Jul 08 18:35:59 devstack sudo[90884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:59 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-38a64c85-6354-489e-b455-265b6f74e205 tempest-VolumesActionsTest-428775210 None] Acquiring lock "cinder-01db4163-3998-45c4-bc92-3ab3f21688d5-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:35:59 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-38a64c85-6354-489e-b455-265b6f74e205 tempest-VolumesActionsTest-428775210 None] Lock "cinder-01db4163-3998-45c4-bc92-3ab3f21688d5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:35:59 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-38a64c85-6354-489e-b455-265b6f74e205 tempest-VolumesActionsTest-428775210 None] Acquiring lock "cinder-quobyte-01db4163-3998-45c4-bc92-3ab3f21688d5" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:35:59 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-38a64c85-6354-489e-b455-265b6f74e205 tempest-VolumesActionsTest-428775210 None] Lock "cinder-quobyte-01db4163-3998-45c4-bc92-3ab3f21688d5" acquired by "delete_volume" :: waited 0.016s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:35:59 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[fddfe2ef-fa22-4299-805e-66528fd756a8]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:35:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-38a64c85-6354-489e-b455-265b6f74e205 tempest-VolumesActionsTest-428775210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-01db4163-3998-45c4-bc92-3ab3f21688d5 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:59 devstack sudo[90887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-01db4163-3998-45c4-bc92-3ab3f21688d5 Jul 08 18:35:59 devstack sudo[90887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:59 devstack sudo[90884]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-bd57d718-4aee-430d-bdca-5fb9f8468bd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1.f2cbf523-62c8-4493-a893-cc2832a7e136 1G" returned: 0 in 0.920s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-bd57d718-4aee-430d-bdca-5fb9f8468bd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1.f2cbf523-62c8-4493-a893-cc2832a7e136 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:00 devstack sudo[90894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1.f2cbf523-62c8-4493-a893-cc2832a7e136 Jul 08 18:36:00 devstack sudo[90894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:00 devstack sudo[90887]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-38a64c85-6354-489e-b455-265b6f74e205 tempest-VolumesActionsTest-428775210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-01db4163-3998-45c4-bc92-3ab3f21688d5" returned: 0 in 0.923s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-38a64c85-6354-489e-b455-265b6f74e205 tempest-VolumesActionsTest-428775210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-01db4163-3998-45c4-bc92-3ab3f21688d5 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:00 devstack sudo[90899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-01db4163-3998-45c4-bc92-3ab3f21688d5 Jul 08 18:36:00 devstack sudo[90899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:00 devstack sudo[90894]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-bd57d718-4aee-430d-bdca-5fb9f8468bd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1.f2cbf523-62c8-4493-a893-cc2832a7e136" returned: 0 in 0.846s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:00 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-bd57d718-4aee-430d-bdca-5fb9f8468bd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1.f2cbf523-62c8-4493-a893-cc2832a7e136 is being set with open permissions: ugo+rw Jul 08 18:36:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-bd57d718-4aee-430d-bdca-5fb9f8468bd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1.f2cbf523-62c8-4493-a893-cc2832a7e136 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:00 devstack sudo[90905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1.f2cbf523-62c8-4493-a893-cc2832a7e136 Jul 08 18:36:00 devstack sudo[90905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:01 devstack sudo[90899]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-38a64c85-6354-489e-b455-265b6f74e205 tempest-VolumesActionsTest-428775210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-01db4163-3998-45c4-bc92-3ab3f21688d5" returned: 0 in 0.711s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:01 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-38a64c85-6354-489e-b455-265b6f74e205 tempest-VolumesActionsTest-428775210 None] Lock "cinder-quobyte-01db4163-3998-45c4-bc92-3ab3f21688d5" released by "delete_volume" :: held 1.706s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:36:01 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-38a64c85-6354-489e-b455-265b6f74e205 tempest-VolumesActionsTest-428775210 None] Created reservations ['0c910ef1-e718-42a5-86d1-3b65f8fda858', '6a7e96f7-3ad1-4a01-8f55-706f150dcf50', 'e3168980-2eb3-4672-85d1-d752aaaaeb55', 'e95608ef-af9a-485b-a1af-cfca985d0bf0'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:36:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-38a64c85-6354-489e-b455-265b6f74e205 tempest-VolumesActionsTest-428775210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:36:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-38a64c85-6354-489e-b455-265b6f74e205 tempest-VolumesActionsTest-428775210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:36:01 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-38a64c85-6354-489e-b455-265b6f74e205 tempest-VolumesActionsTest-428775210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:36:01 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-38a64c85-6354-489e-b455-265b6f74e205 tempest-VolumesActionsTest-428775210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:36:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-38a64c85-6354-489e-b455-265b6f74e205 tempest-VolumesActionsTest-428775210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:36:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-38a64c85-6354-489e-b455-265b6f74e205 tempest-VolumesActionsTest-428775210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:01 devstack sudo[90908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:36:01 devstack sudo[90908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:01 devstack sudo[90905]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-bd57d718-4aee-430d-bdca-5fb9f8468bd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1.f2cbf523-62c8-4493-a893-cc2832a7e136" returned: 0 in 0.737s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-bd57d718-4aee-430d-bdca-5fb9f8468bd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:01 devstack sudo[90912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1.info Jul 08 18:36:01 devstack sudo[90912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:02 devstack sudo[90908]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-38a64c85-6354-489e-b455-265b6f74e205 tempest-VolumesActionsTest-428775210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.866s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:02 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-38a64c85-6354-489e-b455-265b6f74e205 tempest-VolumesActionsTest-428775210 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:36:02 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-38a64c85-6354-489e-b455-265b6f74e205 tempest-VolumesActionsTest-428775210 None] Deleted volume successfully. Jul 08 18:36:02 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-38a64c85-6354-489e-b455-265b6f74e205 tempest-VolumesActionsTest-428775210 None] Lock "cinder-01db4163-3998-45c4-bc92-3ab3f21688d5-delete_volume" released by "delete_volume" :: held 2.853s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:36:02 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-182d4d56-58fd-4a11-ba67-b4c9f834bb73 tempest-VolumesActionsTest-819162864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:36:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-182d4d56-58fd-4a11-ba67-b4c9f834bb73 tempest-VolumesActionsTest-819162864 None] Flow 'volume_create_manager' (48557e7e-be2f-47dc-9186-d19dd7dc6dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:36:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-182d4d56-58fd-4a11-ba67-b4c9f834bb73 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (186b3772-62b7-49ed-b599-ea918dd60353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-182d4d56-58fd-4a11-ba67-b4c9f834bb73 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (186b3772-62b7-49ed-b599-ea918dd60353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1391100982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9904888c-9b01-4718-b0f1-92f8b9a4d675,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e452bbf821a4f7788e64c8d16fa0245',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:36:02Z,use_quota=True,user_id='735015279d074ecba190123935ae97bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-182d4d56-58fd-4a11-ba67-b4c9f834bb73 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90cfcf6f-6894-43b8-b0e2-a826b8a3180a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-182d4d56-58fd-4a11-ba67-b4c9f834bb73 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90cfcf6f-6894-43b8-b0e2-a826b8a3180a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:02 devstack sudo[90912]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-182d4d56-58fd-4a11-ba67-b4c9f834bb73 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ce08b79-8f0b-4d16-8df6-a387338127c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-182d4d56-58fd-4a11-ba67-b4c9f834bb73 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ce08b79-8f0b-4d16-8df6-a387338127c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9904888c-9b01-4718-b0f1-92f8b9a4d675', 'volume_name': 'volume-9904888c-9b01-4718-b0f1-92f8b9a4d675', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-182d4d56-58fd-4a11-ba67-b4c9f834bb73 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee4398c9-7426-4a72-bd65-2554b450fbf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-182d4d56-58fd-4a11-ba67-b4c9f834bb73 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee4398c9-7426-4a72-bd65-2554b450fbf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-182d4d56-58fd-4a11-ba67-b4c9f834bb73 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ac97af9-81ae-4c34-a6b8-8381ca2e8bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:02 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-182d4d56-58fd-4a11-ba67-b4c9f834bb73 tempest-VolumesActionsTest-819162864 None] Volume 9904888c-9b01-4718-b0f1-92f8b9a4d675: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9904888c-9b01-4718-b0f1-92f8b9a4d675', 'volume_size': 1} Jul 08 18:36:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-182d4d56-58fd-4a11-ba67-b4c9f834bb73 tempest-VolumesActionsTest-819162864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:36:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-bd57d718-4aee-430d-bdca-5fb9f8468bd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1.info" returned: 0 in 0.886s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:02 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-bd57d718-4aee-430d-bdca-5fb9f8468bd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1.info is being set with open permissions: ugo+rw Jul 08 18:36:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-bd57d718-4aee-430d-bdca-5fb9f8468bd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:02 devstack sudo[90918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1.info Jul 08 18:36:02 devstack sudo[90918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:03 devstack sudo[90918]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-bd57d718-4aee-430d-bdca-5fb9f8468bd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1.info" returned: 0 in 0.718s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-bd57d718-4aee-430d-bdca-5fb9f8468bd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.166s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:36:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f580c422-b7ba-4bee-ba76-b02eb85e36cb tempest-ServersNegativeTestJSON-1330942785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.221s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:36:03 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-f580c422-b7ba-4bee-ba76-b02eb85e36cb tempest-ServersNegativeTestJSON-1330942785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:35:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-799652184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6403d89c-465b-408f-b58d-496793050d9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91d4c1fa492b4732bb51615d09741adf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:35:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:35:59Z,use_quota=True,user_id='80e00ca44171410fa6caf132f2069523',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:36:03 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-f580c422-b7ba-4bee-ba76-b02eb85e36cb tempest-ServersNegativeTestJSON-1330942785 None] Creating volume 6403d89c-465b-408f-b58d-496793050d9c {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:36:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f580c422-b7ba-4bee-ba76-b02eb85e36cb tempest-ServersNegativeTestJSON-1330942785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:36:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f580c422-b7ba-4bee-ba76-b02eb85e36cb tempest-ServersNegativeTestJSON-1330942785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:36:03 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-f580c422-b7ba-4bee-ba76-b02eb85e36cb tempest-ServersNegativeTestJSON-1330942785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:36:03 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-f580c422-b7ba-4bee-ba76-b02eb85e36cb tempest-ServersNegativeTestJSON-1330942785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:36:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f580c422-b7ba-4bee-ba76-b02eb85e36cb tempest-ServersNegativeTestJSON-1330942785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:36:03 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-f580c422-b7ba-4bee-ba76-b02eb85e36cb tempest-ServersNegativeTestJSON-1330942785 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:36:03 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-f580c422-b7ba-4bee-ba76-b02eb85e36cb tempest-ServersNegativeTestJSON-1330942785 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:36:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f580c422-b7ba-4bee-ba76-b02eb85e36cb tempest-ServersNegativeTestJSON-1330942785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6403d89c-465b-408f-b58d-496793050d9c 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:03 devstack sudo[90922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6403d89c-465b-408f-b58d-496793050d9c 1073741824 Jul 08 18:36:03 devstack sudo[90922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:03 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-bd57d718-4aee-430d-bdca-5fb9f8468bd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Create snapshot completed successfully Jul 08 18:36:04 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-379d3b90-1916-4133-94ee-9ff5d2a5cd9b tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Acquiring lock "cinder-f2cbf523-62c8-4493-a893-cc2832a7e136-delete_snapshot" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:36:04 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-379d3b90-1916-4133-94ee-9ff5d2a5cd9b tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Lock "cinder-f2cbf523-62c8-4493-a893-cc2832a7e136-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:36:04 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-379d3b90-1916-4133-94ee-9ff5d2a5cd9b tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Acquiring lock "cinder-quobyte-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:36:04 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-379d3b90-1916-4133-94ee-9ff5d2a5cd9b tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Lock "cinder-quobyte-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:36:04 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-379d3b90-1916-4133-94ee-9ff5d2a5cd9b tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Acquiring lock "cinder-quobyte-f2cbf523-62c8-4493-a893-cc2832a7e136" by "_delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:36:04 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-379d3b90-1916-4133-94ee-9ff5d2a5cd9b tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Lock "cinder-quobyte-f2cbf523-62c8-4493-a893-cc2832a7e136" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:36:04 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-379d3b90-1916-4133-94ee-9ff5d2a5cd9b tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Deleting offline snapshot f2cbf523-62c8-4493-a893-cc2832a7e136 of volume 9e60eae4-4f30-4b40-ba4b-77b117cf9fa1 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:36:04 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-379d3b90-1916-4133-94ee-9ff5d2a5cd9b tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] snapshot_file for this snap is: volume-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1.f2cbf523-62c8-4493-a893-cc2832a7e136 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:36:04 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6bf582f-bdcc-4c22-855e-18c6d5cf3e19]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:36:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-379d3b90-1916-4133-94ee-9ff5d2a5cd9b tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1.f2cbf523-62c8-4493-a893-cc2832a7e136 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:04 devstack sudo[90922]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f580c422-b7ba-4bee-ba76-b02eb85e36cb tempest-ServersNegativeTestJSON-1330942785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6403d89c-465b-408f-b58d-496793050d9c 1073741824" returned: 0 in 1.044s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f580c422-b7ba-4bee-ba76-b02eb85e36cb tempest-ServersNegativeTestJSON-1330942785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6403d89c-465b-408f-b58d-496793050d9c {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:04 devstack sudo[90929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6403d89c-465b-408f-b58d-496793050d9c Jul 08 18:36:04 devstack sudo[90928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1.f2cbf523-62c8-4493-a893-cc2832a7e136 Jul 08 18:36:04 devstack sudo[90928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:04 devstack sudo[90929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:05 devstack sudo[90929]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f580c422-b7ba-4bee-ba76-b02eb85e36cb tempest-ServersNegativeTestJSON-1330942785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6403d89c-465b-408f-b58d-496793050d9c" returned: 0 in 0.705s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:05 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-f580c422-b7ba-4bee-ba76-b02eb85e36cb tempest-ServersNegativeTestJSON-1330942785 None] <== create_volume: return (1823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:36:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f580c422-b7ba-4bee-ba76-b02eb85e36cb tempest-ServersNegativeTestJSON-1330942785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.828s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:36:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-182d4d56-58fd-4a11-ba67-b4c9f834bb73 tempest-VolumesActionsTest-819162864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.582s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:36:05 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-182d4d56-58fd-4a11-ba67-b4c9f834bb73 tempest-VolumesActionsTest-819162864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1391100982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9904888c-9b01-4718-b0f1-92f8b9a4d675,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e452bbf821a4f7788e64c8d16fa0245',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:36:02Z,use_quota=True,user_id='735015279d074ecba190123935ae97bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:36:05 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-182d4d56-58fd-4a11-ba67-b4c9f834bb73 tempest-VolumesActionsTest-819162864 None] Creating volume 9904888c-9b01-4718-b0f1-92f8b9a4d675 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:36:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-182d4d56-58fd-4a11-ba67-b4c9f834bb73 tempest-VolumesActionsTest-819162864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:36:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-182d4d56-58fd-4a11-ba67-b4c9f834bb73 tempest-VolumesActionsTest-819162864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:36:05 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-182d4d56-58fd-4a11-ba67-b4c9f834bb73 tempest-VolumesActionsTest-819162864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:36:05 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-182d4d56-58fd-4a11-ba67-b4c9f834bb73 tempest-VolumesActionsTest-819162864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:36:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-182d4d56-58fd-4a11-ba67-b4c9f834bb73 tempest-VolumesActionsTest-819162864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:36:05 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-182d4d56-58fd-4a11-ba67-b4c9f834bb73 tempest-VolumesActionsTest-819162864 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:36:05 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-182d4d56-58fd-4a11-ba67-b4c9f834bb73 tempest-VolumesActionsTest-819162864 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:36:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-182d4d56-58fd-4a11-ba67-b4c9f834bb73 tempest-VolumesActionsTest-819162864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9904888c-9b01-4718-b0f1-92f8b9a4d675 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:05 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f580c422-b7ba-4bee-ba76-b02eb85e36cb tempest-ServersNegativeTestJSON-1330942785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a007c60f-6747-430f-a2af-eb8c34f2ca85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6403d89c-465b-408f-b58d-496793050d9c', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:05 devstack sudo[90938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9904888c-9b01-4718-b0f1-92f8b9a4d675 1073741824 Jul 08 18:36:05 devstack sudo[90938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:05 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f580c422-b7ba-4bee-ba76-b02eb85e36cb tempest-ServersNegativeTestJSON-1330942785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c24a1c2a-ab52-4bfc-9e97-18195550d293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:05 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-f580c422-b7ba-4bee-ba76-b02eb85e36cb tempest-ServersNegativeTestJSON-1330942785 None] Volume volume-6403d89c-465b-408f-b58d-496793050d9c (6403d89c-465b-408f-b58d-496793050d9c): created successfully Jul 08 18:36:05 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f580c422-b7ba-4bee-ba76-b02eb85e36cb tempest-ServersNegativeTestJSON-1330942785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c24a1c2a-ab52-4bfc-9e97-18195550d293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:05 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f580c422-b7ba-4bee-ba76-b02eb85e36cb tempest-ServersNegativeTestJSON-1330942785 None] Flow 'volume_create_manager' (a8e85fd6-fbaf-44e2-978d-717827ceefcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:36:05 devstack sudo[90928]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:05 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-f580c422-b7ba-4bee-ba76-b02eb85e36cb tempest-ServersNegativeTestJSON-1330942785 None] Created volume successfully. Jul 08 18:36:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-379d3b90-1916-4133-94ee-9ff5d2a5cd9b tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1.f2cbf523-62c8-4493-a893-cc2832a7e136" returned: 0 in 0.909s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:05 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-379d3b90-1916-4133-94ee-9ff5d2a5cd9b tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:36:05 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e03f59-4192-471f-96ad-fb9c046332f6]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:36:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-379d3b90-1916-4133-94ee-9ff5d2a5cd9b tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:05 devstack sudo[90940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1 Jul 08 18:36:05 devstack sudo[90940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:06 devstack sudo[90940]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-379d3b90-1916-4133-94ee-9ff5d2a5cd9b tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1" returned: 0 in 0.913s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-379d3b90-1916-4133-94ee-9ff5d2a5cd9b tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1.f2cbf523-62c8-4493-a893-cc2832a7e136 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:06 devstack sudo[90951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1.f2cbf523-62c8-4493-a893-cc2832a7e136 Jul 08 18:36:06 devstack sudo[90938]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:06 devstack sudo[90951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-182d4d56-58fd-4a11-ba67-b4c9f834bb73 tempest-VolumesActionsTest-819162864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9904888c-9b01-4718-b0f1-92f8b9a4d675 1073741824" returned: 0 in 1.106s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-182d4d56-58fd-4a11-ba67-b4c9f834bb73 tempest-VolumesActionsTest-819162864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9904888c-9b01-4718-b0f1-92f8b9a4d675 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:06 devstack sudo[90953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9904888c-9b01-4718-b0f1-92f8b9a4d675 Jul 08 18:36:06 devstack sudo[90953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:07 devstack sudo[90951]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-379d3b90-1916-4133-94ee-9ff5d2a5cd9b tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1.f2cbf523-62c8-4493-a893-cc2832a7e136" returned: 0 in 0.936s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-379d3b90-1916-4133-94ee-9ff5d2a5cd9b tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1.f2cbf523-62c8-4493-a893-cc2832a7e136 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:07 devstack sudo[90953]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-182d4d56-58fd-4a11-ba67-b4c9f834bb73 tempest-VolumesActionsTest-819162864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9904888c-9b01-4718-b0f1-92f8b9a4d675" returned: 0 in 0.864s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:07 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-182d4d56-58fd-4a11-ba67-b4c9f834bb73 tempest-VolumesActionsTest-819162864 None] <== create_volume: return (2036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:36:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-182d4d56-58fd-4a11-ba67-b4c9f834bb73 tempest-VolumesActionsTest-819162864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.040s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:36:07 devstack sudo[90959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1.f2cbf523-62c8-4493-a893-cc2832a7e136 Jul 08 18:36:07 devstack sudo[90959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-182d4d56-58fd-4a11-ba67-b4c9f834bb73 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ac97af9-81ae-4c34-a6b8-8381ca2e8bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9904888c-9b01-4718-b0f1-92f8b9a4d675', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-182d4d56-58fd-4a11-ba67-b4c9f834bb73 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca304273-003f-4073-9f0e-3dec830ca7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:07 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-182d4d56-58fd-4a11-ba67-b4c9f834bb73 tempest-VolumesActionsTest-819162864 None] Volume volume-9904888c-9b01-4718-b0f1-92f8b9a4d675 (9904888c-9b01-4718-b0f1-92f8b9a4d675): created successfully Jul 08 18:36:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-182d4d56-58fd-4a11-ba67-b4c9f834bb73 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca304273-003f-4073-9f0e-3dec830ca7cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-182d4d56-58fd-4a11-ba67-b4c9f834bb73 tempest-VolumesActionsTest-819162864 None] Flow 'volume_create_manager' (48557e7e-be2f-47dc-9186-d19dd7dc6dde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:36:07 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-182d4d56-58fd-4a11-ba67-b4c9f834bb73 tempest-VolumesActionsTest-819162864 None] Created volume successfully. Jul 08 18:36:07 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac251958-06aa-44ad-b896-62364ce3d496 tempest-ServersNegativeTestJSON-1330942785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:36:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ac251958-06aa-44ad-b896-62364ce3d496 tempest-ServersNegativeTestJSON-1330942785 None] Flow 'volume_create_manager' (af899111-dbe6-4dfa-bee7-5532b2ba4e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:36:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ac251958-06aa-44ad-b896-62364ce3d496 tempest-ServersNegativeTestJSON-1330942785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd4afe2e-6d3e-4f33-ae49-cc4bc283cc6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ac251958-06aa-44ad-b896-62364ce3d496 tempest-ServersNegativeTestJSON-1330942785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd4afe2e-6d3e-4f33-ae49-cc4bc283cc6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:36:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1780702400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78a8c815-0cb4-4997-bbec-7a5930fd270c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91d4c1fa492b4732bb51615d09741adf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:36:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:36:08Z,use_quota=True,user_id='80e00ca44171410fa6caf132f2069523',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ac251958-06aa-44ad-b896-62364ce3d496 tempest-ServersNegativeTestJSON-1330942785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f77805c7-4ae7-4d75-b914-0afecd154bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ac251958-06aa-44ad-b896-62364ce3d496 tempest-ServersNegativeTestJSON-1330942785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f77805c7-4ae7-4d75-b914-0afecd154bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ac251958-06aa-44ad-b896-62364ce3d496 tempest-ServersNegativeTestJSON-1330942785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddfdc9b8-42dd-4e9d-b938-1c07b09a336a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ac251958-06aa-44ad-b896-62364ce3d496 tempest-ServersNegativeTestJSON-1330942785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddfdc9b8-42dd-4e9d-b938-1c07b09a336a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78a8c815-0cb4-4997-bbec-7a5930fd270c', 'volume_name': 'volume-78a8c815-0cb4-4997-bbec-7a5930fd270c', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ac251958-06aa-44ad-b896-62364ce3d496 tempest-ServersNegativeTestJSON-1330942785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (218b7e87-c2de-4126-b9f0-1095eee46d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ac251958-06aa-44ad-b896-62364ce3d496 tempest-ServersNegativeTestJSON-1330942785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (218b7e87-c2de-4126-b9f0-1095eee46d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ac251958-06aa-44ad-b896-62364ce3d496 tempest-ServersNegativeTestJSON-1330942785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0555bb12-edaa-4c4a-8ad3-5c4d1dbfcb38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:07 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-ac251958-06aa-44ad-b896-62364ce3d496 tempest-ServersNegativeTestJSON-1330942785 None] Volume 78a8c815-0cb4-4997-bbec-7a5930fd270c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78a8c815-0cb4-4997-bbec-7a5930fd270c', 'volume_size': 1} Jul 08 18:36:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-ac251958-06aa-44ad-b896-62364ce3d496 tempest-ServersNegativeTestJSON-1330942785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:36:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-ac251958-06aa-44ad-b896-62364ce3d496 tempest-ServersNegativeTestJSON-1330942785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:36:07 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-ac251958-06aa-44ad-b896-62364ce3d496 tempest-ServersNegativeTestJSON-1330942785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:36:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1780702400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78a8c815-0cb4-4997-bbec-7a5930fd270c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91d4c1fa492b4732bb51615d09741adf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:36:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:36:08Z,use_quota=True,user_id='80e00ca44171410fa6caf132f2069523',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:36:07 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-ac251958-06aa-44ad-b896-62364ce3d496 tempest-ServersNegativeTestJSON-1330942785 None] Creating volume 78a8c815-0cb4-4997-bbec-7a5930fd270c {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:36:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-ac251958-06aa-44ad-b896-62364ce3d496 tempest-ServersNegativeTestJSON-1330942785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:36:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-ac251958-06aa-44ad-b896-62364ce3d496 tempest-ServersNegativeTestJSON-1330942785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:36:07 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-ac251958-06aa-44ad-b896-62364ce3d496 tempest-ServersNegativeTestJSON-1330942785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:36:07 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-ac251958-06aa-44ad-b896-62364ce3d496 tempest-ServersNegativeTestJSON-1330942785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:36:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-ac251958-06aa-44ad-b896-62364ce3d496 tempest-ServersNegativeTestJSON-1330942785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:36:07 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-ac251958-06aa-44ad-b896-62364ce3d496 tempest-ServersNegativeTestJSON-1330942785 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:36:07 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-ac251958-06aa-44ad-b896-62364ce3d496 tempest-ServersNegativeTestJSON-1330942785 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:36:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ac251958-06aa-44ad-b896-62364ce3d496 tempest-ServersNegativeTestJSON-1330942785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-78a8c815-0cb4-4997-bbec-7a5930fd270c 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:07 devstack sudo[90962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-78a8c815-0cb4-4997-bbec-7a5930fd270c 1073741824 Jul 08 18:36:07 devstack sudo[90962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:07 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-cdd784c4-75a0-482e-9f8d-b48c8ee4747a tempest-VolumesActionsTest-428775210 None] Acquiring lock "cinder-9904888c-9b01-4718-b0f1-92f8b9a4d675-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:36:08 devstack sudo[90959]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-379d3b90-1916-4133-94ee-9ff5d2a5cd9b tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1.f2cbf523-62c8-4493-a893-cc2832a7e136" returned: 0 in 0.903s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:08 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-cdd784c4-75a0-482e-9f8d-b48c8ee4747a tempest-VolumesActionsTest-428775210 None] Lock "cinder-9904888c-9b01-4718-b0f1-92f8b9a4d675-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:36:08 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-379d3b90-1916-4133-94ee-9ff5d2a5cd9b tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Lock "cinder-quobyte-f2cbf523-62c8-4493-a893-cc2832a7e136" released by "_delete_snapshot" :: held 3.853s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:36:08 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-379d3b90-1916-4133-94ee-9ff5d2a5cd9b tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Lock "cinder-quobyte-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1" released by "delete_snapshot" :: held 3.890s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:36:08 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-cdd784c4-75a0-482e-9f8d-b48c8ee4747a tempest-VolumesActionsTest-428775210 None] Acquiring lock "cinder-quobyte-9904888c-9b01-4718-b0f1-92f8b9a4d675" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:36:08 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-cdd784c4-75a0-482e-9f8d-b48c8ee4747a tempest-VolumesActionsTest-428775210 None] Lock "cinder-quobyte-9904888c-9b01-4718-b0f1-92f8b9a4d675" acquired by "delete_volume" :: waited 0.018s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:36:08 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d27948-9177-4235-8bd1-ec1e83fdf748]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:36:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-cdd784c4-75a0-482e-9f8d-b48c8ee4747a tempest-VolumesActionsTest-428775210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9904888c-9b01-4718-b0f1-92f8b9a4d675 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:08 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-379d3b90-1916-4133-94ee-9ff5d2a5cd9b tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Created reservations ['03e10d6a-b2cb-4b06-8fa1-ce1757591ff0', '55749116-df10-499b-a0e5-755e76f62c9a', '98c2755c-c436-4ab8-9fb8-b0eb1106397b', 'cc2aba12-2285-4d08-9a9a-d172cf82aa41'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:36:08 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-379d3b90-1916-4133-94ee-9ff5d2a5cd9b tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Delete snapshot completed successfully. Jul 08 18:36:08 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-379d3b90-1916-4133-94ee-9ff5d2a5cd9b tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Lock "cinder-f2cbf523-62c8-4493-a893-cc2832a7e136-delete_snapshot" released by "delete_snapshot" :: held 4.131s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:36:08 devstack sudo[90964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9904888c-9b01-4718-b0f1-92f8b9a4d675 Jul 08 18:36:08 devstack sudo[90964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:08 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-3afce410-29fb-4605-bde4-1dd6abb84d01 tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Acquiring lock "cinder-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:36:08 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-3afce410-29fb-4605-bde4-1dd6abb84d01 tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Lock "cinder-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:36:08 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-3afce410-29fb-4605-bde4-1dd6abb84d01 tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Acquiring lock "cinder-quobyte-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:36:08 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-3afce410-29fb-4605-bde4-1dd6abb84d01 tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Lock "cinder-quobyte-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1" acquired by "delete_volume" :: waited 0.033s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:36:08 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d8404b-4614-4364-8e21-c6e9cd3bee34]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:36:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3afce410-29fb-4605-bde4-1dd6abb84d01 tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:08 devstack sudo[90970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1 Jul 08 18:36:08 devstack sudo[90970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:08 devstack sudo[90962]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ac251958-06aa-44ad-b896-62364ce3d496 tempest-ServersNegativeTestJSON-1330942785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-78a8c815-0cb4-4997-bbec-7a5930fd270c 1073741824" returned: 0 in 1.030s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ac251958-06aa-44ad-b896-62364ce3d496 tempest-ServersNegativeTestJSON-1330942785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-78a8c815-0cb4-4997-bbec-7a5930fd270c {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:09 devstack sudo[90974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-78a8c815-0cb4-4997-bbec-7a5930fd270c Jul 08 18:36:09 devstack sudo[90974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:09 devstack sudo[90964]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-cdd784c4-75a0-482e-9f8d-b48c8ee4747a tempest-VolumesActionsTest-428775210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9904888c-9b01-4718-b0f1-92f8b9a4d675" returned: 0 in 0.964s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-cdd784c4-75a0-482e-9f8d-b48c8ee4747a tempest-VolumesActionsTest-428775210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9904888c-9b01-4718-b0f1-92f8b9a4d675 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:09 devstack sudo[90977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9904888c-9b01-4718-b0f1-92f8b9a4d675 Jul 08 18:36:09 devstack sudo[90977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:09 devstack sudo[90970]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3afce410-29fb-4605-bde4-1dd6abb84d01 tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1" returned: 0 in 0.943s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3afce410-29fb-4605-bde4-1dd6abb84d01 tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:09 devstack sudo[90983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1 Jul 08 18:36:09 devstack sudo[90983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:09 devstack sudo[90974]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ac251958-06aa-44ad-b896-62364ce3d496 tempest-ServersNegativeTestJSON-1330942785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-78a8c815-0cb4-4997-bbec-7a5930fd270c" returned: 0 in 0.843s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:09 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-ac251958-06aa-44ad-b896-62364ce3d496 tempest-ServersNegativeTestJSON-1330942785 None] <== create_volume: return (1938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:36:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-ac251958-06aa-44ad-b896-62364ce3d496 tempest-ServersNegativeTestJSON-1330942785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.941s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:36:09 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ac251958-06aa-44ad-b896-62364ce3d496 tempest-ServersNegativeTestJSON-1330942785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0555bb12-edaa-4c4a-8ad3-5c4d1dbfcb38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78a8c815-0cb4-4997-bbec-7a5930fd270c', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:09 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ac251958-06aa-44ad-b896-62364ce3d496 tempest-ServersNegativeTestJSON-1330942785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3773bfc-f5aa-4729-9f8a-84c1274602db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:09 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-ac251958-06aa-44ad-b896-62364ce3d496 tempest-ServersNegativeTestJSON-1330942785 None] Volume volume-78a8c815-0cb4-4997-bbec-7a5930fd270c (78a8c815-0cb4-4997-bbec-7a5930fd270c): created successfully Jul 08 18:36:09 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ac251958-06aa-44ad-b896-62364ce3d496 tempest-ServersNegativeTestJSON-1330942785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3773bfc-f5aa-4729-9f8a-84c1274602db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:09 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ac251958-06aa-44ad-b896-62364ce3d496 tempest-ServersNegativeTestJSON-1330942785 None] Flow 'volume_create_manager' (af899111-dbe6-4dfa-bee7-5532b2ba4e18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:36:09 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-ac251958-06aa-44ad-b896-62364ce3d496 tempest-ServersNegativeTestJSON-1330942785 None] Created volume successfully. Jul 08 18:36:10 devstack sudo[90977]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-cdd784c4-75a0-482e-9f8d-b48c8ee4747a tempest-VolumesActionsTest-428775210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9904888c-9b01-4718-b0f1-92f8b9a4d675" returned: 0 in 0.921s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:10 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-cdd784c4-75a0-482e-9f8d-b48c8ee4747a tempest-VolumesActionsTest-428775210 None] Lock "cinder-quobyte-9904888c-9b01-4718-b0f1-92f8b9a4d675" released by "delete_volume" :: held 1.944s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:36:10 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-cdd784c4-75a0-482e-9f8d-b48c8ee4747a tempest-VolumesActionsTest-428775210 None] Created reservations ['56efb186-a8ba-4991-9b74-34915d11e40f', 'f9d8cc80-2a79-4e3f-a523-43c7430c0dc7', '55bccd82-479f-4835-874a-583bcae7a1b4', '4aecedb0-9dab-42bd-9d42-98c79f3d6dac'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:36:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-cdd784c4-75a0-482e-9f8d-b48c8ee4747a tempest-VolumesActionsTest-428775210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:36:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-cdd784c4-75a0-482e-9f8d-b48c8ee4747a tempest-VolumesActionsTest-428775210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:36:10 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-cdd784c4-75a0-482e-9f8d-b48c8ee4747a tempest-VolumesActionsTest-428775210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:36:10 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-cdd784c4-75a0-482e-9f8d-b48c8ee4747a tempest-VolumesActionsTest-428775210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:36:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-cdd784c4-75a0-482e-9f8d-b48c8ee4747a tempest-VolumesActionsTest-428775210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:36:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-cdd784c4-75a0-482e-9f8d-b48c8ee4747a tempest-VolumesActionsTest-428775210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:10 devstack sudo[90986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:36:10 devstack sudo[90986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:10 devstack sudo[90983]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3afce410-29fb-4605-bde4-1dd6abb84d01 tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1" returned: 0 in 0.904s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:10 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-3afce410-29fb-4605-bde4-1dd6abb84d01 tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Lock "cinder-quobyte-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1" released by "delete_volume" :: held 1.940s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:36:10 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-3afce410-29fb-4605-bde4-1dd6abb84d01 tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Created reservations ['c6d714a3-50ef-42b8-94f1-21b88382d4bd', 'df9ec7e0-29cd-41ce-8bfe-7f726c2e28d6', '186762da-5119-4707-9861-84fcb589e028', 'a2542a85-0995-443b-acf8-ee077be84990'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:36:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3afce410-29fb-4605-bde4-1dd6abb84d01 tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:36:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3afce410-29fb-4605-bde4-1dd6abb84d01 tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:36:10 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-3afce410-29fb-4605-bde4-1dd6abb84d01 tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:36:10 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-3afce410-29fb-4605-bde4-1dd6abb84d01 tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:36:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3afce410-29fb-4605-bde4-1dd6abb84d01 tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:36:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3afce410-29fb-4605-bde4-1dd6abb84d01 tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:10 devstack sudo[90990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:36:10 devstack sudo[90990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:11 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-c137b2c5-3106-41a8-bb9d-80f4450715e5 tempest-VolumesActionsTest-819162864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:36:11 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c137b2c5-3106-41a8-bb9d-80f4450715e5 tempest-VolumesActionsTest-819162864 None] Flow 'volume_create_manager' (7c2aee27-d96e-438b-9d90-d553fa695224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:36:11 devstack sudo[90986]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:11 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c137b2c5-3106-41a8-bb9d-80f4450715e5 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7629d14c-20e9-4220-973c-64201ed5d0ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-cdd784c4-75a0-482e-9f8d-b48c8ee4747a tempest-VolumesActionsTest-428775210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 1.012s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:11 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-cdd784c4-75a0-482e-9f8d-b48c8ee4747a tempest-VolumesActionsTest-428775210 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:36:11 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-cdd784c4-75a0-482e-9f8d-b48c8ee4747a tempest-VolumesActionsTest-428775210 None] Deleted volume successfully. Jul 08 18:36:11 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c137b2c5-3106-41a8-bb9d-80f4450715e5 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7629d14c-20e9-4220-973c-64201ed5d0ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:36:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1623759420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95e7befb-ab65-48e2-b6c1-4a195a65f2d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e452bbf821a4f7788e64c8d16fa0245',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:36:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:36:11Z,use_quota=True,user_id='735015279d074ecba190123935ae97bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:11 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c137b2c5-3106-41a8-bb9d-80f4450715e5 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bf7adc6-e9b8-4cca-82c4-89ae7fa2f88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:11 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c137b2c5-3106-41a8-bb9d-80f4450715e5 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bf7adc6-e9b8-4cca-82c4-89ae7fa2f88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:11 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c137b2c5-3106-41a8-bb9d-80f4450715e5 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa644533-5862-4b3b-8c91-9108db0e5803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:11 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c137b2c5-3106-41a8-bb9d-80f4450715e5 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa644533-5862-4b3b-8c91-9108db0e5803) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95e7befb-ab65-48e2-b6c1-4a195a65f2d0', 'volume_name': 'volume-95e7befb-ab65-48e2-b6c1-4a195a65f2d0', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:11 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c137b2c5-3106-41a8-bb9d-80f4450715e5 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90c3f9c9-7236-4445-81fa-e4b673647168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:11 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c137b2c5-3106-41a8-bb9d-80f4450715e5 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90c3f9c9-7236-4445-81fa-e4b673647168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:11 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c137b2c5-3106-41a8-bb9d-80f4450715e5 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df84ac87-48a4-40dc-a7d9-fdd479fd39d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:11 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-c137b2c5-3106-41a8-bb9d-80f4450715e5 tempest-VolumesActionsTest-819162864 None] Volume 95e7befb-ab65-48e2-b6c1-4a195a65f2d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95e7befb-ab65-48e2-b6c1-4a195a65f2d0', 'volume_size': 1} Jul 08 18:36:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c137b2c5-3106-41a8-bb9d-80f4450715e5 tempest-VolumesActionsTest-819162864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:36:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c137b2c5-3106-41a8-bb9d-80f4450715e5 tempest-VolumesActionsTest-819162864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:36:11 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c137b2c5-3106-41a8-bb9d-80f4450715e5 tempest-VolumesActionsTest-819162864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:36:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1623759420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95e7befb-ab65-48e2-b6c1-4a195a65f2d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e452bbf821a4f7788e64c8d16fa0245',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:36:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:36:11Z,use_quota=True,user_id='735015279d074ecba190123935ae97bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:36:11 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-c137b2c5-3106-41a8-bb9d-80f4450715e5 tempest-VolumesActionsTest-819162864 None] Creating volume 95e7befb-ab65-48e2-b6c1-4a195a65f2d0 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:36:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c137b2c5-3106-41a8-bb9d-80f4450715e5 tempest-VolumesActionsTest-819162864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:36:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c137b2c5-3106-41a8-bb9d-80f4450715e5 tempest-VolumesActionsTest-819162864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:36:11 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c137b2c5-3106-41a8-bb9d-80f4450715e5 tempest-VolumesActionsTest-819162864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:36:11 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c137b2c5-3106-41a8-bb9d-80f4450715e5 tempest-VolumesActionsTest-819162864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:36:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c137b2c5-3106-41a8-bb9d-80f4450715e5 tempest-VolumesActionsTest-819162864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:36:11 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c137b2c5-3106-41a8-bb9d-80f4450715e5 tempest-VolumesActionsTest-819162864 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:36:11 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-c137b2c5-3106-41a8-bb9d-80f4450715e5 tempest-VolumesActionsTest-819162864 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:36:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c137b2c5-3106-41a8-bb9d-80f4450715e5 tempest-VolumesActionsTest-819162864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-95e7befb-ab65-48e2-b6c1-4a195a65f2d0 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:11 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-cdd784c4-75a0-482e-9f8d-b48c8ee4747a tempest-VolumesActionsTest-428775210 None] Lock "cinder-9904888c-9b01-4718-b0f1-92f8b9a4d675-delete_volume" released by "delete_volume" :: held 3.487s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:36:11 devstack sudo[90993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-95e7befb-ab65-48e2-b6c1-4a195a65f2d0 1073741824 Jul 08 18:36:11 devstack sudo[90993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:11 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-0972b680-0845-49b5-b0ae-11c9a5e4a52e tempest-ServersNegativeTestJSON-1330942785 None] Acquiring lock "cinder-78a8c815-0cb4-4997-bbec-7a5930fd270c-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:36:11 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-0972b680-0845-49b5-b0ae-11c9a5e4a52e tempest-ServersNegativeTestJSON-1330942785 None] Lock "cinder-78a8c815-0cb4-4997-bbec-7a5930fd270c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:36:11 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-0972b680-0845-49b5-b0ae-11c9a5e4a52e tempest-ServersNegativeTestJSON-1330942785 None] Acquiring lock "cinder-quobyte-78a8c815-0cb4-4997-bbec-7a5930fd270c" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:36:11 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-0972b680-0845-49b5-b0ae-11c9a5e4a52e tempest-ServersNegativeTestJSON-1330942785 None] Lock "cinder-quobyte-78a8c815-0cb4-4997-bbec-7a5930fd270c" acquired by "delete_volume" :: waited 0.038s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:36:11 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06bc1bb-768f-4003-be89-0eb301b270be]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:36:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-0972b680-0845-49b5-b0ae-11c9a5e4a52e tempest-ServersNegativeTestJSON-1330942785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-78a8c815-0cb4-4997-bbec-7a5930fd270c {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:12 devstack sudo[90990]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3afce410-29fb-4605-bde4-1dd6abb84d01 tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 1.265s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:12 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-3afce410-29fb-4605-bde4-1dd6abb84d01 tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:36:12 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-3afce410-29fb-4605-bde4-1dd6abb84d01 tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Deleted volume successfully. Jul 08 18:36:12 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-3afce410-29fb-4605-bde4-1dd6abb84d01 tempest-VolumeSnapshotQuotasNegativeTestJSON-799052626 None] Lock "cinder-9e60eae4-4f30-4b40-ba4b-77b117cf9fa1-delete_volume" released by "delete_volume" :: held 3.505s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:36:12 devstack sudo[90997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-78a8c815-0cb4-4997-bbec-7a5930fd270c Jul 08 18:36:12 devstack sudo[90997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:12 devstack sudo[90993]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c137b2c5-3106-41a8-bb9d-80f4450715e5 tempest-VolumesActionsTest-819162864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-95e7befb-ab65-48e2-b6c1-4a195a65f2d0 1073741824" returned: 0 in 1.285s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c137b2c5-3106-41a8-bb9d-80f4450715e5 tempest-VolumesActionsTest-819162864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-95e7befb-ab65-48e2-b6c1-4a195a65f2d0 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:12 devstack sudo[91005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-95e7befb-ab65-48e2-b6c1-4a195a65f2d0 Jul 08 18:36:12 devstack sudo[91005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:12 devstack sudo[90997]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-0972b680-0845-49b5-b0ae-11c9a5e4a52e tempest-ServersNegativeTestJSON-1330942785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-78a8c815-0cb4-4997-bbec-7a5930fd270c" returned: 0 in 0.971s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-0972b680-0845-49b5-b0ae-11c9a5e4a52e tempest-ServersNegativeTestJSON-1330942785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-78a8c815-0cb4-4997-bbec-7a5930fd270c {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:13 devstack sudo[91008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-78a8c815-0cb4-4997-bbec-7a5930fd270c Jul 08 18:36:13 devstack sudo[91008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:13 devstack sudo[91005]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c137b2c5-3106-41a8-bb9d-80f4450715e5 tempest-VolumesActionsTest-819162864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-95e7befb-ab65-48e2-b6c1-4a195a65f2d0" returned: 0 in 0.840s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:13 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c137b2c5-3106-41a8-bb9d-80f4450715e5 tempest-VolumesActionsTest-819162864 None] <== create_volume: return (2204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:36:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c137b2c5-3106-41a8-bb9d-80f4450715e5 tempest-VolumesActionsTest-819162864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.209s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:36:13 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c137b2c5-3106-41a8-bb9d-80f4450715e5 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df84ac87-48a4-40dc-a7d9-fdd479fd39d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95e7befb-ab65-48e2-b6c1-4a195a65f2d0', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:13 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c137b2c5-3106-41a8-bb9d-80f4450715e5 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3bf835e-97dc-49c2-a0d8-6a54ebab1de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:13 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-c137b2c5-3106-41a8-bb9d-80f4450715e5 tempest-VolumesActionsTest-819162864 None] Volume volume-95e7befb-ab65-48e2-b6c1-4a195a65f2d0 (95e7befb-ab65-48e2-b6c1-4a195a65f2d0): created successfully Jul 08 18:36:13 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c137b2c5-3106-41a8-bb9d-80f4450715e5 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3bf835e-97dc-49c2-a0d8-6a54ebab1de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:13 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c137b2c5-3106-41a8-bb9d-80f4450715e5 tempest-VolumesActionsTest-819162864 None] Flow 'volume_create_manager' (7c2aee27-d96e-438b-9d90-d553fa695224) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:36:13 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-c137b2c5-3106-41a8-bb9d-80f4450715e5 tempest-VolumesActionsTest-819162864 None] Created volume successfully. Jul 08 18:36:13 devstack sudo[91008]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-0972b680-0845-49b5-b0ae-11c9a5e4a52e tempest-ServersNegativeTestJSON-1330942785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-78a8c815-0cb4-4997-bbec-7a5930fd270c" returned: 0 in 0.852s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:13 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-0972b680-0845-49b5-b0ae-11c9a5e4a52e tempest-ServersNegativeTestJSON-1330942785 None] Lock "cinder-quobyte-78a8c815-0cb4-4997-bbec-7a5930fd270c" released by "delete_volume" :: held 1.896s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:36:13 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-0972b680-0845-49b5-b0ae-11c9a5e4a52e tempest-ServersNegativeTestJSON-1330942785 None] Created reservations ['4069e614-341f-4a9a-846e-f10596b902b7', '26c4ac1d-f2fc-4069-b079-e1fb2cfb00d6', 'fb3ed99a-9516-4621-9e68-fe6cb380fcc7', 'd2f68637-2d63-40fe-844c-1b05ab4070ef'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:36:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-0972b680-0845-49b5-b0ae-11c9a5e4a52e tempest-ServersNegativeTestJSON-1330942785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:36:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-0972b680-0845-49b5-b0ae-11c9a5e4a52e tempest-ServersNegativeTestJSON-1330942785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:36:13 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-0972b680-0845-49b5-b0ae-11c9a5e4a52e tempest-ServersNegativeTestJSON-1330942785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:36:13 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-0972b680-0845-49b5-b0ae-11c9a5e4a52e tempest-ServersNegativeTestJSON-1330942785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:36:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-0972b680-0845-49b5-b0ae-11c9a5e4a52e tempest-ServersNegativeTestJSON-1330942785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:36:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-0972b680-0845-49b5-b0ae-11c9a5e4a52e tempest-ServersNegativeTestJSON-1330942785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:14 devstack sudo[91012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:36:14 devstack sudo[91012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:14 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-1bda7122-914e-48c0-9da4-6815f740d329 tempest-ServersNegativeTestJSON-1330942785 None] Acquiring lock "cinder-6403d89c-465b-408f-b58d-496793050d9c-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:36:14 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-1bda7122-914e-48c0-9da4-6815f740d329 tempest-ServersNegativeTestJSON-1330942785 None] Lock "cinder-6403d89c-465b-408f-b58d-496793050d9c-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:36:14 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-1bda7122-914e-48c0-9da4-6815f740d329 tempest-ServersNegativeTestJSON-1330942785 None] Acquiring lock "cinder-quobyte-6403d89c-465b-408f-b58d-496793050d9c" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:36:14 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-1bda7122-914e-48c0-9da4-6815f740d329 tempest-ServersNegativeTestJSON-1330942785 None] Lock "cinder-quobyte-6403d89c-465b-408f-b58d-496793050d9c" acquired by "delete_volume" :: waited 0.038s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:36:14 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb939988-6fb6-426b-8fc6-a788537a8e2d]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:36:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1bda7122-914e-48c0-9da4-6815f740d329 tempest-ServersNegativeTestJSON-1330942785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6403d89c-465b-408f-b58d-496793050d9c {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:14 devstack sudo[91017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6403d89c-465b-408f-b58d-496793050d9c Jul 08 18:36:14 devstack sudo[91017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:14 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b1f4ceca-3d92-4588-a1bd-ff4e427599f8 tempest-VolumesActionsTest-428775210 None] Acquiring lock "cinder-95e7befb-ab65-48e2-b6c1-4a195a65f2d0-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:36:14 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b1f4ceca-3d92-4588-a1bd-ff4e427599f8 tempest-VolumesActionsTest-428775210 None] Lock "cinder-95e7befb-ab65-48e2-b6c1-4a195a65f2d0-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:36:14 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b1f4ceca-3d92-4588-a1bd-ff4e427599f8 tempest-VolumesActionsTest-428775210 None] Acquiring lock "cinder-quobyte-95e7befb-ab65-48e2-b6c1-4a195a65f2d0" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:36:14 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b1f4ceca-3d92-4588-a1bd-ff4e427599f8 tempest-VolumesActionsTest-428775210 None] Lock "cinder-quobyte-95e7befb-ab65-48e2-b6c1-4a195a65f2d0" acquired by "delete_volume" :: waited 0.026s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:36:14 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[d273f2a6-710d-40a3-953a-de7ce56b09f7]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:36:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b1f4ceca-3d92-4588-a1bd-ff4e427599f8 tempest-VolumesActionsTest-428775210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-95e7befb-ab65-48e2-b6c1-4a195a65f2d0 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:14 devstack sudo[91023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-95e7befb-ab65-48e2-b6c1-4a195a65f2d0 Jul 08 18:36:14 devstack sudo[91023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:14 devstack sudo[91012]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-0972b680-0845-49b5-b0ae-11c9a5e4a52e tempest-ServersNegativeTestJSON-1330942785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.936s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:14 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-0972b680-0845-49b5-b0ae-11c9a5e4a52e tempest-ServersNegativeTestJSON-1330942785 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:36:14 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-0972b680-0845-49b5-b0ae-11c9a5e4a52e tempest-ServersNegativeTestJSON-1330942785 None] Deleted volume successfully. Jul 08 18:36:14 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-0972b680-0845-49b5-b0ae-11c9a5e4a52e tempest-ServersNegativeTestJSON-1330942785 None] Lock "cinder-78a8c815-0cb4-4997-bbec-7a5930fd270c-delete_volume" released by "delete_volume" :: held 3.122s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:36:15 devstack sudo[91017]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1bda7122-914e-48c0-9da4-6815f740d329 tempest-ServersNegativeTestJSON-1330942785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6403d89c-465b-408f-b58d-496793050d9c" returned: 0 in 1.237s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1bda7122-914e-48c0-9da4-6815f740d329 tempest-ServersNegativeTestJSON-1330942785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6403d89c-465b-408f-b58d-496793050d9c {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:15 devstack sudo[91031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6403d89c-465b-408f-b58d-496793050d9c Jul 08 18:36:15 devstack sudo[91031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:15 devstack sudo[91023]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b1f4ceca-3d92-4588-a1bd-ff4e427599f8 tempest-VolumesActionsTest-428775210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-95e7befb-ab65-48e2-b6c1-4a195a65f2d0" returned: 0 in 1.067s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b1f4ceca-3d92-4588-a1bd-ff4e427599f8 tempest-VolumesActionsTest-428775210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-95e7befb-ab65-48e2-b6c1-4a195a65f2d0 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:15 devstack sudo[91033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-95e7befb-ab65-48e2-b6c1-4a195a65f2d0 Jul 08 18:36:15 devstack sudo[91033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:16 devstack sudo[91031]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1bda7122-914e-48c0-9da4-6815f740d329 tempest-ServersNegativeTestJSON-1330942785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6403d89c-465b-408f-b58d-496793050d9c" returned: 0 in 0.943s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:16 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-1bda7122-914e-48c0-9da4-6815f740d329 tempest-ServersNegativeTestJSON-1330942785 None] Lock "cinder-quobyte-6403d89c-465b-408f-b58d-496793050d9c" released by "delete_volume" :: held 2.267s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:36:16 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-1bda7122-914e-48c0-9da4-6815f740d329 tempest-ServersNegativeTestJSON-1330942785 None] Created reservations ['5f961ebe-bca1-4b22-81ef-c699c1307f1a', '36f43f33-a7bc-4a04-9cf7-e43ae207f0c4', '9c4b3214-26b5-484d-aa55-2443dbbcf5de', '9833cceb-a1fc-4304-9b9d-1f425e85bc28'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:36:16 devstack sudo[91033]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b1f4ceca-3d92-4588-a1bd-ff4e427599f8 tempest-VolumesActionsTest-428775210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-95e7befb-ab65-48e2-b6c1-4a195a65f2d0" returned: 0 in 0.857s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:16 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b1f4ceca-3d92-4588-a1bd-ff4e427599f8 tempest-VolumesActionsTest-428775210 None] Lock "cinder-quobyte-95e7befb-ab65-48e2-b6c1-4a195a65f2d0" released by "delete_volume" :: held 1.988s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:36:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1bda7122-914e-48c0-9da4-6815f740d329 tempest-ServersNegativeTestJSON-1330942785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:36:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1bda7122-914e-48c0-9da4-6815f740d329 tempest-ServersNegativeTestJSON-1330942785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:36:16 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-1bda7122-914e-48c0-9da4-6815f740d329 tempest-ServersNegativeTestJSON-1330942785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:36:16 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-1bda7122-914e-48c0-9da4-6815f740d329 tempest-ServersNegativeTestJSON-1330942785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:36:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1bda7122-914e-48c0-9da4-6815f740d329 tempest-ServersNegativeTestJSON-1330942785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:36:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1bda7122-914e-48c0-9da4-6815f740d329 tempest-ServersNegativeTestJSON-1330942785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:16 devstack sudo[91037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:36:16 devstack sudo[91037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:16 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-b1f4ceca-3d92-4588-a1bd-ff4e427599f8 tempest-VolumesActionsTest-428775210 None] Created reservations ['6736171d-276e-4bef-94d3-b50a74dd68e6', '525e4dc4-92d6-4378-b1ec-c1c4953f988d', '54e19cc2-478d-4800-9fd6-b1661e5ed52c', '13c2c033-300c-48ac-a3e7-ace64492e4e5'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:36:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b1f4ceca-3d92-4588-a1bd-ff4e427599f8 tempest-VolumesActionsTest-428775210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:36:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b1f4ceca-3d92-4588-a1bd-ff4e427599f8 tempest-VolumesActionsTest-428775210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:36:16 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b1f4ceca-3d92-4588-a1bd-ff4e427599f8 tempest-VolumesActionsTest-428775210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:36:17 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b1f4ceca-3d92-4588-a1bd-ff4e427599f8 tempest-VolumesActionsTest-428775210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:36:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b1f4ceca-3d92-4588-a1bd-ff4e427599f8 tempest-VolumesActionsTest-428775210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:36:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b1f4ceca-3d92-4588-a1bd-ff4e427599f8 tempest-VolumesActionsTest-428775210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:17 devstack sudo[91039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:36:17 devstack sudo[91039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:17 devstack sudo[91037]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1bda7122-914e-48c0-9da4-6815f740d329 tempest-ServersNegativeTestJSON-1330942785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.842s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:17 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-1bda7122-914e-48c0-9da4-6815f740d329 tempest-ServersNegativeTestJSON-1330942785 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:36:17 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-1bda7122-914e-48c0-9da4-6815f740d329 tempest-ServersNegativeTestJSON-1330942785 None] Deleted volume successfully. Jul 08 18:36:17 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-1bda7122-914e-48c0-9da4-6815f740d329 tempest-ServersNegativeTestJSON-1330942785 None] Lock "cinder-6403d89c-465b-408f-b58d-496793050d9c-delete_volume" released by "delete_volume" :: held 3.476s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:36:17 devstack sudo[91039]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b1f4ceca-3d92-4588-a1bd-ff4e427599f8 tempest-VolumesActionsTest-428775210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.865s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:17 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-b1f4ceca-3d92-4588-a1bd-ff4e427599f8 tempest-VolumesActionsTest-428775210 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:36:17 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-b1f4ceca-3d92-4588-a1bd-ff4e427599f8 tempest-VolumesActionsTest-428775210 None] Deleted volume successfully. Jul 08 18:36:17 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b1f4ceca-3d92-4588-a1bd-ff4e427599f8 tempest-VolumesActionsTest-428775210 None] Lock "cinder-95e7befb-ab65-48e2-b6c1-4a195a65f2d0-delete_volume" released by "delete_volume" :: held 3.238s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:36:18 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:SELECT=85,cinder:UPDATE=115,cinder:DELETE=12,cinder:INSERT=28 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:36:18 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf5388cf-8339-4321-9a05-0146edff8405 tempest-VolumesActionsTest-819162864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:36:18 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-bf5388cf-8339-4321-9a05-0146edff8405 tempest-VolumesActionsTest-819162864 None] Flow 'volume_create_manager' (044663fe-df8d-4b79-8bb8-853f20315f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:36:18 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-bf5388cf-8339-4321-9a05-0146edff8405 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e48cd4a4-34e1-4359-9d4a-a76336ee7c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:18 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-bf5388cf-8339-4321-9a05-0146edff8405 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e48cd4a4-34e1-4359-9d4a-a76336ee7c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1912559384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bec4448c-3284-41ff-930f-5b82a5c4463c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e452bbf821a4f7788e64c8d16fa0245',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:36:19Z,use_quota=True,user_id='735015279d074ecba190123935ae97bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:18 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-bf5388cf-8339-4321-9a05-0146edff8405 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c25fbf2d-c76d-4b7c-bcbe-f6c8b2dd8aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:18 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-bf5388cf-8339-4321-9a05-0146edff8405 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c25fbf2d-c76d-4b7c-bcbe-f6c8b2dd8aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:18 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-bf5388cf-8339-4321-9a05-0146edff8405 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b926ce83-d027-4679-b92c-a3c8b03ba38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:18 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-bf5388cf-8339-4321-9a05-0146edff8405 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b926ce83-d027-4679-b92c-a3c8b03ba38a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bec4448c-3284-41ff-930f-5b82a5c4463c', 'volume_name': 'volume-bec4448c-3284-41ff-930f-5b82a5c4463c', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:18 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-bf5388cf-8339-4321-9a05-0146edff8405 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef50e1b0-c58b-41d6-a327-6c364aa3f773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:18 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-bf5388cf-8339-4321-9a05-0146edff8405 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef50e1b0-c58b-41d6-a327-6c364aa3f773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:18 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-bf5388cf-8339-4321-9a05-0146edff8405 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9359af26-cb85-4eee-a5d9-64e83ea4cdec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:18 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-bf5388cf-8339-4321-9a05-0146edff8405 tempest-VolumesActionsTest-819162864 None] Volume bec4448c-3284-41ff-930f-5b82a5c4463c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bec4448c-3284-41ff-930f-5b82a5c4463c', 'volume_size': 1} Jul 08 18:36:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-bf5388cf-8339-4321-9a05-0146edff8405 tempest-VolumesActionsTest-819162864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:36:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-bf5388cf-8339-4321-9a05-0146edff8405 tempest-VolumesActionsTest-819162864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:36:18 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-bf5388cf-8339-4321-9a05-0146edff8405 tempest-VolumesActionsTest-819162864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1912559384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bec4448c-3284-41ff-930f-5b82a5c4463c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e452bbf821a4f7788e64c8d16fa0245',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:36:19Z,use_quota=True,user_id='735015279d074ecba190123935ae97bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:36:18 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-bf5388cf-8339-4321-9a05-0146edff8405 tempest-VolumesActionsTest-819162864 None] Creating volume bec4448c-3284-41ff-930f-5b82a5c4463c {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:36:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-bf5388cf-8339-4321-9a05-0146edff8405 tempest-VolumesActionsTest-819162864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:36:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-bf5388cf-8339-4321-9a05-0146edff8405 tempest-VolumesActionsTest-819162864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:36:18 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-bf5388cf-8339-4321-9a05-0146edff8405 tempest-VolumesActionsTest-819162864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:36:18 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-bf5388cf-8339-4321-9a05-0146edff8405 tempest-VolumesActionsTest-819162864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:36:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-bf5388cf-8339-4321-9a05-0146edff8405 tempest-VolumesActionsTest-819162864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:36:18 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-bf5388cf-8339-4321-9a05-0146edff8405 tempest-VolumesActionsTest-819162864 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:36:18 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-bf5388cf-8339-4321-9a05-0146edff8405 tempest-VolumesActionsTest-819162864 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:36:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-bf5388cf-8339-4321-9a05-0146edff8405 tempest-VolumesActionsTest-819162864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bec4448c-3284-41ff-930f-5b82a5c4463c 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:18 devstack sudo[91044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bec4448c-3284-41ff-930f-5b82a5c4463c 1073741824 Jul 08 18:36:18 devstack sudo[91044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:20 devstack sudo[91044]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-bf5388cf-8339-4321-9a05-0146edff8405 tempest-VolumesActionsTest-819162864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bec4448c-3284-41ff-930f-5b82a5c4463c 1073741824" returned: 0 in 1.180s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:20 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:SELECT=86,cinder:UPDATE=102,cinder:INSERT=23,cinder:DELETE=6 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:36:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-bf5388cf-8339-4321-9a05-0146edff8405 tempest-VolumesActionsTest-819162864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bec4448c-3284-41ff-930f-5b82a5c4463c {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:20 devstack sudo[91068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bec4448c-3284-41ff-930f-5b82a5c4463c Jul 08 18:36:20 devstack sudo[91068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:21 devstack sudo[91068]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-bf5388cf-8339-4321-9a05-0146edff8405 tempest-VolumesActionsTest-819162864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bec4448c-3284-41ff-930f-5b82a5c4463c" returned: 0 in 0.975s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:21 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-bf5388cf-8339-4321-9a05-0146edff8405 tempest-VolumesActionsTest-819162864 None] <== create_volume: return (2220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:36:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-bf5388cf-8339-4321-9a05-0146edff8405 tempest-VolumesActionsTest-819162864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.223s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:36:21 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-bf5388cf-8339-4321-9a05-0146edff8405 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9359af26-cb85-4eee-a5d9-64e83ea4cdec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bec4448c-3284-41ff-930f-5b82a5c4463c', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:21 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-bf5388cf-8339-4321-9a05-0146edff8405 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1695a867-ab1f-4625-9103-a2671899a021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:21 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-bf5388cf-8339-4321-9a05-0146edff8405 tempest-VolumesActionsTest-819162864 None] Volume volume-bec4448c-3284-41ff-930f-5b82a5c4463c (bec4448c-3284-41ff-930f-5b82a5c4463c): created successfully Jul 08 18:36:21 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-bf5388cf-8339-4321-9a05-0146edff8405 tempest-VolumesActionsTest-819162864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1695a867-ab1f-4625-9103-a2671899a021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:21 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-bf5388cf-8339-4321-9a05-0146edff8405 tempest-VolumesActionsTest-819162864 None] Flow 'volume_create_manager' (044663fe-df8d-4b79-8bb8-853f20315f01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:36:21 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-bf5388cf-8339-4321-9a05-0146edff8405 tempest-VolumesActionsTest-819162864 None] Created volume successfully. Jul 08 18:36:22 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-019f158b-0ab4-4296-a581-279153ae15f8 tempest-VolumesActionsTest-819162864 None] Acquiring lock "cinder-bec4448c-3284-41ff-930f-5b82a5c4463c-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:36:22 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-019f158b-0ab4-4296-a581-279153ae15f8 tempest-VolumesActionsTest-819162864 None] Lock "cinder-bec4448c-3284-41ff-930f-5b82a5c4463c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:36:22 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-019f158b-0ab4-4296-a581-279153ae15f8 tempest-VolumesActionsTest-819162864 None] Acquiring lock "cinder-quobyte-bec4448c-3284-41ff-930f-5b82a5c4463c" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:36:22 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-019f158b-0ab4-4296-a581-279153ae15f8 tempest-VolumesActionsTest-819162864 None] Lock "cinder-quobyte-bec4448c-3284-41ff-930f-5b82a5c4463c" acquired by "delete_volume" :: waited 0.020s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:36:22 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ed22c7-ae27-423f-ada9-b4a35185bc12]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:36:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-019f158b-0ab4-4296-a581-279153ae15f8 tempest-VolumesActionsTest-819162864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bec4448c-3284-41ff-930f-5b82a5c4463c {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:22 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4cd3346-f826-4b80-a3d6-2fbf2365cec5 tempest-AbsoluteLimitsTests-1967551797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:36:22 devstack sudo[91079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bec4448c-3284-41ff-930f-5b82a5c4463c Jul 08 18:36:22 devstack sudo[91079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:22 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f4cd3346-f826-4b80-a3d6-2fbf2365cec5 tempest-AbsoluteLimitsTests-1967551797 None] Flow 'volume_create_manager' (9755a4eb-67de-4255-8e45-ac7c957b01d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:36:22 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f4cd3346-f826-4b80-a3d6-2fbf2365cec5 tempest-AbsoluteLimitsTests-1967551797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31853356-7095-4b03-9864-a7411d0e8fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:23 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f4cd3346-f826-4b80-a3d6-2fbf2365cec5 tempest-AbsoluteLimitsTests-1967551797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31853356-7095-4b03-9864-a7411d0e8fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-99508137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75e90ec9-ff87-4b98-a6ae-aeeab674f86f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc4f293ae0c64674aabeca9c3fea9814',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:36:23Z,use_quota=True,user_id='cce7e16520f54de4a3251b3bd84e78b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:23 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f4cd3346-f826-4b80-a3d6-2fbf2365cec5 tempest-AbsoluteLimitsTests-1967551797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21628eac-f5fc-4759-b2b0-7d8a5b8fd00a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:23 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f4cd3346-f826-4b80-a3d6-2fbf2365cec5 tempest-AbsoluteLimitsTests-1967551797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21628eac-f5fc-4759-b2b0-7d8a5b8fd00a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:23 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f4cd3346-f826-4b80-a3d6-2fbf2365cec5 tempest-AbsoluteLimitsTests-1967551797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (095b726b-7ec0-4050-b998-b851d897a249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:23 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f4cd3346-f826-4b80-a3d6-2fbf2365cec5 tempest-AbsoluteLimitsTests-1967551797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (095b726b-7ec0-4050-b998-b851d897a249) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75e90ec9-ff87-4b98-a6ae-aeeab674f86f', 'volume_name': 'volume-75e90ec9-ff87-4b98-a6ae-aeeab674f86f', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:23 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f4cd3346-f826-4b80-a3d6-2fbf2365cec5 tempest-AbsoluteLimitsTests-1967551797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd1fc0b3-10a1-402c-b7c2-e77a226603b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:23 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f4cd3346-f826-4b80-a3d6-2fbf2365cec5 tempest-AbsoluteLimitsTests-1967551797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd1fc0b3-10a1-402c-b7c2-e77a226603b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:23 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f4cd3346-f826-4b80-a3d6-2fbf2365cec5 tempest-AbsoluteLimitsTests-1967551797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67206cdc-c702-45d9-84d2-f5e4678bffd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:23 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-f4cd3346-f826-4b80-a3d6-2fbf2365cec5 tempest-AbsoluteLimitsTests-1967551797 None] Volume 75e90ec9-ff87-4b98-a6ae-aeeab674f86f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75e90ec9-ff87-4b98-a6ae-aeeab674f86f', 'volume_size': 1} Jul 08 18:36:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f4cd3346-f826-4b80-a3d6-2fbf2365cec5 tempest-AbsoluteLimitsTests-1967551797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:36:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f4cd3346-f826-4b80-a3d6-2fbf2365cec5 tempest-AbsoluteLimitsTests-1967551797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:36:23 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-f4cd3346-f826-4b80-a3d6-2fbf2365cec5 tempest-AbsoluteLimitsTests-1967551797 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-99508137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75e90ec9-ff87-4b98-a6ae-aeeab674f86f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc4f293ae0c64674aabeca9c3fea9814',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:36:23Z,use_quota=True,user_id='cce7e16520f54de4a3251b3bd84e78b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:36:23 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-f4cd3346-f826-4b80-a3d6-2fbf2365cec5 tempest-AbsoluteLimitsTests-1967551797 None] Creating volume 75e90ec9-ff87-4b98-a6ae-aeeab674f86f {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:36:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f4cd3346-f826-4b80-a3d6-2fbf2365cec5 tempest-AbsoluteLimitsTests-1967551797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:36:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f4cd3346-f826-4b80-a3d6-2fbf2365cec5 tempest-AbsoluteLimitsTests-1967551797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:36:23 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-f4cd3346-f826-4b80-a3d6-2fbf2365cec5 tempest-AbsoluteLimitsTests-1967551797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:36:23 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-f4cd3346-f826-4b80-a3d6-2fbf2365cec5 tempest-AbsoluteLimitsTests-1967551797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:36:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f4cd3346-f826-4b80-a3d6-2fbf2365cec5 tempest-AbsoluteLimitsTests-1967551797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:36:23 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-f4cd3346-f826-4b80-a3d6-2fbf2365cec5 tempest-AbsoluteLimitsTests-1967551797 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:36:23 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-f4cd3346-f826-4b80-a3d6-2fbf2365cec5 tempest-AbsoluteLimitsTests-1967551797 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:36:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f4cd3346-f826-4b80-a3d6-2fbf2365cec5 tempest-AbsoluteLimitsTests-1967551797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-75e90ec9-ff87-4b98-a6ae-aeeab674f86f 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:23 devstack sudo[91082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-75e90ec9-ff87-4b98-a6ae-aeeab674f86f 1073741824 Jul 08 18:36:23 devstack sudo[91082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:23 devstack sudo[91079]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-019f158b-0ab4-4296-a581-279153ae15f8 tempest-VolumesActionsTest-819162864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bec4448c-3284-41ff-930f-5b82a5c4463c" returned: 0 in 1.069s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-019f158b-0ab4-4296-a581-279153ae15f8 tempest-VolumesActionsTest-819162864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bec4448c-3284-41ff-930f-5b82a5c4463c {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:23 devstack sudo[91090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bec4448c-3284-41ff-930f-5b82a5c4463c Jul 08 18:36:23 devstack sudo[91090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:24 devstack sudo[91082]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f4cd3346-f826-4b80-a3d6-2fbf2365cec5 tempest-AbsoluteLimitsTests-1967551797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-75e90ec9-ff87-4b98-a6ae-aeeab674f86f 1073741824" returned: 0 in 1.148s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f4cd3346-f826-4b80-a3d6-2fbf2365cec5 tempest-AbsoluteLimitsTests-1967551797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-75e90ec9-ff87-4b98-a6ae-aeeab674f86f {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:24 devstack sudo[91094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-75e90ec9-ff87-4b98-a6ae-aeeab674f86f Jul 08 18:36:24 devstack sudo[91094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:24 devstack sudo[91090]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-019f158b-0ab4-4296-a581-279153ae15f8 tempest-VolumesActionsTest-819162864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bec4448c-3284-41ff-930f-5b82a5c4463c" returned: 0 in 0.687s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:24 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-019f158b-0ab4-4296-a581-279153ae15f8 tempest-VolumesActionsTest-819162864 None] Lock "cinder-quobyte-bec4448c-3284-41ff-930f-5b82a5c4463c" released by "delete_volume" :: held 1.828s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:36:24 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-019f158b-0ab4-4296-a581-279153ae15f8 tempest-VolumesActionsTest-819162864 None] Created reservations ['48131cae-ae3a-47da-9361-a43271a90c54', 'b55a2c76-2481-4552-b1ac-7cba105fc994', '31c8d6c3-b826-4a40-a52a-bdbaab91ec93', '075f9663-a6ce-4522-8cfe-0f49faf09e7e'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:36:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-019f158b-0ab4-4296-a581-279153ae15f8 tempest-VolumesActionsTest-819162864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:36:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-019f158b-0ab4-4296-a581-279153ae15f8 tempest-VolumesActionsTest-819162864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:36:24 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-019f158b-0ab4-4296-a581-279153ae15f8 tempest-VolumesActionsTest-819162864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:36:24 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-019f158b-0ab4-4296-a581-279153ae15f8 tempest-VolumesActionsTest-819162864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:36:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-019f158b-0ab4-4296-a581-279153ae15f8 tempest-VolumesActionsTest-819162864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:36:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-019f158b-0ab4-4296-a581-279153ae15f8 tempest-VolumesActionsTest-819162864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:24 devstack sudo[91097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:36:24 devstack sudo[91097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:25 devstack sudo[91094]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f4cd3346-f826-4b80-a3d6-2fbf2365cec5 tempest-AbsoluteLimitsTests-1967551797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-75e90ec9-ff87-4b98-a6ae-aeeab674f86f" returned: 0 in 0.826s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:25 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-f4cd3346-f826-4b80-a3d6-2fbf2365cec5 tempest-AbsoluteLimitsTests-1967551797 None] <== create_volume: return (2027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:36:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f4cd3346-f826-4b80-a3d6-2fbf2365cec5 tempest-AbsoluteLimitsTests-1967551797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.029s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:36:25 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f4cd3346-f826-4b80-a3d6-2fbf2365cec5 tempest-AbsoluteLimitsTests-1967551797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67206cdc-c702-45d9-84d2-f5e4678bffd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75e90ec9-ff87-4b98-a6ae-aeeab674f86f', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:25 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f4cd3346-f826-4b80-a3d6-2fbf2365cec5 tempest-AbsoluteLimitsTests-1967551797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a88674d5-43d5-49e2-9c05-23a8f2d4d775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:25 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-f4cd3346-f826-4b80-a3d6-2fbf2365cec5 tempest-AbsoluteLimitsTests-1967551797 None] Volume volume-75e90ec9-ff87-4b98-a6ae-aeeab674f86f (75e90ec9-ff87-4b98-a6ae-aeeab674f86f): created successfully Jul 08 18:36:25 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f4cd3346-f826-4b80-a3d6-2fbf2365cec5 tempest-AbsoluteLimitsTests-1967551797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a88674d5-43d5-49e2-9c05-23a8f2d4d775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:25 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f4cd3346-f826-4b80-a3d6-2fbf2365cec5 tempest-AbsoluteLimitsTests-1967551797 None] Flow 'volume_create_manager' (9755a4eb-67de-4255-8e45-ac7c957b01d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:36:25 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-f4cd3346-f826-4b80-a3d6-2fbf2365cec5 tempest-AbsoluteLimitsTests-1967551797 None] Created volume successfully. Jul 08 18:36:25 devstack sudo[91097]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-019f158b-0ab4-4296-a581-279153ae15f8 tempest-VolumesActionsTest-819162864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.812s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:25 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-019f158b-0ab4-4296-a581-279153ae15f8 tempest-VolumesActionsTest-819162864 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:36:25 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-019f158b-0ab4-4296-a581-279153ae15f8 tempest-VolumesActionsTest-819162864 None] Deleted volume successfully. Jul 08 18:36:25 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-019f158b-0ab4-4296-a581-279153ae15f8 tempest-VolumesActionsTest-819162864 None] Lock "cinder-bec4448c-3284-41ff-930f-5b82a5c4463c-delete_volume" released by "delete_volume" :: held 2.866s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:36:26 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b102339c-04ff-466e-be4e-88e09ca0957f tempest-AbsoluteLimitsTests-1967551797 None] Acquiring lock "cinder-75e90ec9-ff87-4b98-a6ae-aeeab674f86f-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:36:26 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b102339c-04ff-466e-be4e-88e09ca0957f tempest-AbsoluteLimitsTests-1967551797 None] Lock "cinder-75e90ec9-ff87-4b98-a6ae-aeeab674f86f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:36:26 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b102339c-04ff-466e-be4e-88e09ca0957f tempest-AbsoluteLimitsTests-1967551797 None] Acquiring lock "cinder-quobyte-75e90ec9-ff87-4b98-a6ae-aeeab674f86f" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:36:26 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b102339c-04ff-466e-be4e-88e09ca0957f tempest-AbsoluteLimitsTests-1967551797 None] Lock "cinder-quobyte-75e90ec9-ff87-4b98-a6ae-aeeab674f86f" acquired by "delete_volume" :: waited 0.020s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:36:26 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[828f647a-e6ff-41ed-85ab-26ae48e88828]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:36:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b102339c-04ff-466e-be4e-88e09ca0957f tempest-AbsoluteLimitsTests-1967551797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-75e90ec9-ff87-4b98-a6ae-aeeab674f86f {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:26 devstack sudo[91101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-75e90ec9-ff87-4b98-a6ae-aeeab674f86f Jul 08 18:36:26 devstack sudo[91101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:27 devstack sudo[91101]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b102339c-04ff-466e-be4e-88e09ca0957f tempest-AbsoluteLimitsTests-1967551797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-75e90ec9-ff87-4b98-a6ae-aeeab674f86f" returned: 0 in 0.857s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b102339c-04ff-466e-be4e-88e09ca0957f tempest-AbsoluteLimitsTests-1967551797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-75e90ec9-ff87-4b98-a6ae-aeeab674f86f {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:27 devstack sudo[91107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-75e90ec9-ff87-4b98-a6ae-aeeab674f86f Jul 08 18:36:27 devstack sudo[91107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:27 devstack sudo[91107]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b102339c-04ff-466e-be4e-88e09ca0957f tempest-AbsoluteLimitsTests-1967551797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-75e90ec9-ff87-4b98-a6ae-aeeab674f86f" returned: 0 in 0.742s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:27 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b102339c-04ff-466e-be4e-88e09ca0957f tempest-AbsoluteLimitsTests-1967551797 None] Lock "cinder-quobyte-75e90ec9-ff87-4b98-a6ae-aeeab674f86f" released by "delete_volume" :: held 1.660s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:36:27 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-b102339c-04ff-466e-be4e-88e09ca0957f tempest-AbsoluteLimitsTests-1967551797 None] Created reservations ['a26f8e12-2f9d-46c8-8be1-c5f14cd2e0d6', '77a46f77-45ce-4d34-ac73-53f94551c332', 'e8335f90-e6d9-4640-be62-0ac492d45eb9', '2394f311-9177-4a9e-a331-d492d2e91259'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:36:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b102339c-04ff-466e-be4e-88e09ca0957f tempest-AbsoluteLimitsTests-1967551797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:36:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b102339c-04ff-466e-be4e-88e09ca0957f tempest-AbsoluteLimitsTests-1967551797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:36:28 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b102339c-04ff-466e-be4e-88e09ca0957f tempest-AbsoluteLimitsTests-1967551797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:36:28 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b102339c-04ff-466e-be4e-88e09ca0957f tempest-AbsoluteLimitsTests-1967551797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:36:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b102339c-04ff-466e-be4e-88e09ca0957f tempest-AbsoluteLimitsTests-1967551797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:36:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b102339c-04ff-466e-be4e-88e09ca0957f tempest-AbsoluteLimitsTests-1967551797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:28 devstack sudo[91111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:36:28 devstack sudo[91111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:28 devstack sudo[91111]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b102339c-04ff-466e-be4e-88e09ca0957f tempest-AbsoluteLimitsTests-1967551797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.800s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:28 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-b102339c-04ff-466e-be4e-88e09ca0957f tempest-AbsoluteLimitsTests-1967551797 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:36:28 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-b102339c-04ff-466e-be4e-88e09ca0957f tempest-AbsoluteLimitsTests-1967551797 None] Deleted volume successfully. Jul 08 18:36:28 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b102339c-04ff-466e-be4e-88e09ca0957f tempest-AbsoluteLimitsTests-1967551797 None] Lock "cinder-75e90ec9-ff87-4b98-a6ae-aeeab674f86f-delete_volume" released by "delete_volume" :: held 2.738s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:36:35 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcc45e9f-37bb-46d6-9437-00588a2e0316 tempest-VolumesMetadataTest-5931053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:36:35 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fcc45e9f-37bb-46d6-9437-00588a2e0316 tempest-VolumesMetadataTest-5931053 None] Flow 'volume_create_manager' (20b918e6-3e87-4ddf-9b42-c6f64483529a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:36:35 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fcc45e9f-37bb-46d6-9437-00588a2e0316 tempest-VolumesMetadataTest-5931053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b75ae628-16b8-42e2-bc92-8aeb094685ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:35 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fcc45e9f-37bb-46d6-9437-00588a2e0316 tempest-VolumesMetadataTest-5931053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b75ae628-16b8-42e2-bc92-8aeb094685ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:36:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-17466286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1190288-95b7-442b-a2aa-989d9b955019,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb1a24398b5a4ab3afe3fd922bfdec1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:36:35Z,use_quota=True,user_id='45a887590ee940048554d2363b9044bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:35 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fcc45e9f-37bb-46d6-9437-00588a2e0316 tempest-VolumesMetadataTest-5931053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65f372bd-667e-4980-9f6e-6cf21cd46f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:35 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fcc45e9f-37bb-46d6-9437-00588a2e0316 tempest-VolumesMetadataTest-5931053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65f372bd-667e-4980-9f6e-6cf21cd46f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:35 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fcc45e9f-37bb-46d6-9437-00588a2e0316 tempest-VolumesMetadataTest-5931053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cc35572-1e37-48e2-8b05-3830b58ebcb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:35 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fcc45e9f-37bb-46d6-9437-00588a2e0316 tempest-VolumesMetadataTest-5931053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cc35572-1e37-48e2-8b05-3830b58ebcb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1190288-95b7-442b-a2aa-989d9b955019', 'volume_name': 'volume-f1190288-95b7-442b-a2aa-989d9b955019', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:35 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fcc45e9f-37bb-46d6-9437-00588a2e0316 tempest-VolumesMetadataTest-5931053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d7fe67b-9055-4865-8f23-da210c1e63c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:35 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fcc45e9f-37bb-46d6-9437-00588a2e0316 tempest-VolumesMetadataTest-5931053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d7fe67b-9055-4865-8f23-da210c1e63c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:35 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fcc45e9f-37bb-46d6-9437-00588a2e0316 tempest-VolumesMetadataTest-5931053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfd260d8-1eaa-436c-9d5c-0769f3950946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:35 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-fcc45e9f-37bb-46d6-9437-00588a2e0316 tempest-VolumesMetadataTest-5931053 None] Volume f1190288-95b7-442b-a2aa-989d9b955019: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1190288-95b7-442b-a2aa-989d9b955019', 'volume_size': 1} Jul 08 18:36:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-fcc45e9f-37bb-46d6-9437-00588a2e0316 tempest-VolumesMetadataTest-5931053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:36:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-fcc45e9f-37bb-46d6-9437-00588a2e0316 tempest-VolumesMetadataTest-5931053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:36:35 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-fcc45e9f-37bb-46d6-9437-00588a2e0316 tempest-VolumesMetadataTest-5931053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:36:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-17466286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1190288-95b7-442b-a2aa-989d9b955019,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb1a24398b5a4ab3afe3fd922bfdec1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:36:35Z,use_quota=True,user_id='45a887590ee940048554d2363b9044bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:36:35 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-fcc45e9f-37bb-46d6-9437-00588a2e0316 tempest-VolumesMetadataTest-5931053 None] Creating volume f1190288-95b7-442b-a2aa-989d9b955019 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:36:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-fcc45e9f-37bb-46d6-9437-00588a2e0316 tempest-VolumesMetadataTest-5931053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:36:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-fcc45e9f-37bb-46d6-9437-00588a2e0316 tempest-VolumesMetadataTest-5931053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:36:35 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-fcc45e9f-37bb-46d6-9437-00588a2e0316 tempest-VolumesMetadataTest-5931053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:36:35 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-fcc45e9f-37bb-46d6-9437-00588a2e0316 tempest-VolumesMetadataTest-5931053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:36:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-fcc45e9f-37bb-46d6-9437-00588a2e0316 tempest-VolumesMetadataTest-5931053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:36:35 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-fcc45e9f-37bb-46d6-9437-00588a2e0316 tempest-VolumesMetadataTest-5931053 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:36:35 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-fcc45e9f-37bb-46d6-9437-00588a2e0316 tempest-VolumesMetadataTest-5931053 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:36:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-fcc45e9f-37bb-46d6-9437-00588a2e0316 tempest-VolumesMetadataTest-5931053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f1190288-95b7-442b-a2aa-989d9b955019 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:35 devstack sudo[91123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f1190288-95b7-442b-a2aa-989d9b955019 1073741824 Jul 08 18:36:35 devstack sudo[91123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:36 devstack sudo[91123]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-fcc45e9f-37bb-46d6-9437-00588a2e0316 tempest-VolumesMetadataTest-5931053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f1190288-95b7-442b-a2aa-989d9b955019 1073741824" returned: 0 in 1.125s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-fcc45e9f-37bb-46d6-9437-00588a2e0316 tempest-VolumesMetadataTest-5931053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f1190288-95b7-442b-a2aa-989d9b955019 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:36 devstack sudo[91129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f1190288-95b7-442b-a2aa-989d9b955019 Jul 08 18:36:36 devstack sudo[91129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:37 devstack sudo[91129]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-fcc45e9f-37bb-46d6-9437-00588a2e0316 tempest-VolumesMetadataTest-5931053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f1190288-95b7-442b-a2aa-989d9b955019" returned: 0 in 0.831s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:37 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-fcc45e9f-37bb-46d6-9437-00588a2e0316 tempest-VolumesMetadataTest-5931053 None] <== create_volume: return (2010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:36:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-fcc45e9f-37bb-46d6-9437-00588a2e0316 tempest-VolumesMetadataTest-5931053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.013s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:36:37 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fcc45e9f-37bb-46d6-9437-00588a2e0316 tempest-VolumesMetadataTest-5931053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfd260d8-1eaa-436c-9d5c-0769f3950946) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1190288-95b7-442b-a2aa-989d9b955019', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:37 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fcc45e9f-37bb-46d6-9437-00588a2e0316 tempest-VolumesMetadataTest-5931053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63a3060d-39c3-4963-8f73-372661cf7ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:37 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-fcc45e9f-37bb-46d6-9437-00588a2e0316 tempest-VolumesMetadataTest-5931053 None] Volume volume-f1190288-95b7-442b-a2aa-989d9b955019 (f1190288-95b7-442b-a2aa-989d9b955019): created successfully Jul 08 18:36:37 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fcc45e9f-37bb-46d6-9437-00588a2e0316 tempest-VolumesMetadataTest-5931053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63a3060d-39c3-4963-8f73-372661cf7ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:37 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fcc45e9f-37bb-46d6-9437-00588a2e0316 tempest-VolumesMetadataTest-5931053 None] Flow 'volume_create_manager' (20b918e6-3e87-4ddf-9b42-c6f64483529a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:36:37 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-fcc45e9f-37bb-46d6-9437-00588a2e0316 tempest-VolumesMetadataTest-5931053 None] Created volume successfully. Jul 08 18:36:39 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-2185af7c-ba47-46d5-bca5-58109a712b84 tempest-VolumesMetadataTest-5931053 None] Acquiring lock "cinder-f1190288-95b7-442b-a2aa-989d9b955019-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:36:39 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-2185af7c-ba47-46d5-bca5-58109a712b84 tempest-VolumesMetadataTest-5931053 None] Lock "cinder-f1190288-95b7-442b-a2aa-989d9b955019-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:36:39 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-2185af7c-ba47-46d5-bca5-58109a712b84 tempest-VolumesMetadataTest-5931053 None] Acquiring lock "cinder-quobyte-f1190288-95b7-442b-a2aa-989d9b955019" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:36:39 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-2185af7c-ba47-46d5-bca5-58109a712b84 tempest-VolumesMetadataTest-5931053 None] Lock "cinder-quobyte-f1190288-95b7-442b-a2aa-989d9b955019" acquired by "delete_volume" :: waited 0.035s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:36:40 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8bd446-cd70-4186-991a-f030e0709ce3]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:36:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2185af7c-ba47-46d5-bca5-58109a712b84 tempest-VolumesMetadataTest-5931053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f1190288-95b7-442b-a2aa-989d9b955019 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:40 devstack sudo[91133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f1190288-95b7-442b-a2aa-989d9b955019 Jul 08 18:36:40 devstack sudo[91133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:41 devstack sudo[91133]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2185af7c-ba47-46d5-bca5-58109a712b84 tempest-VolumesMetadataTest-5931053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f1190288-95b7-442b-a2aa-989d9b955019" returned: 0 in 1.186s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2185af7c-ba47-46d5-bca5-58109a712b84 tempest-VolumesMetadataTest-5931053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f1190288-95b7-442b-a2aa-989d9b955019 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:41 devstack sudo[91154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f1190288-95b7-442b-a2aa-989d9b955019 Jul 08 18:36:41 devstack sudo[91154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:42 devstack sudo[91154]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2185af7c-ba47-46d5-bca5-58109a712b84 tempest-VolumesMetadataTest-5931053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f1190288-95b7-442b-a2aa-989d9b955019" returned: 0 in 0.957s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:42 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-2185af7c-ba47-46d5-bca5-58109a712b84 tempest-VolumesMetadataTest-5931053 None] Lock "cinder-quobyte-f1190288-95b7-442b-a2aa-989d9b955019" released by "delete_volume" :: held 2.217s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:36:42 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-2185af7c-ba47-46d5-bca5-58109a712b84 tempest-VolumesMetadataTest-5931053 None] Created reservations ['23e33ebb-32b6-4c92-94f9-73177b6baade', 'ff30ac5d-3cd1-41cc-9046-1f588ebbfeca', '25d90957-2d18-4588-9135-10f2b5804d7a', 'a24db2c6-13c1-4a72-a9f4-b2cacf124411'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:36:42 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f9a471a-55f9-4cdd-b095-123cd44d138d tempest-VolumesListAdminTestJSON-1382528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:36:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5f9a471a-55f9-4cdd-b095-123cd44d138d tempest-VolumesListAdminTestJSON-1382528 None] Flow 'volume_create_manager' (69b7ddb6-474e-4614-885d-63f2a432fca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:36:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5f9a471a-55f9-4cdd-b095-123cd44d138d tempest-VolumesListAdminTestJSON-1382528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98d347f0-c491-42e5-af69-f6e576fd167e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5f9a471a-55f9-4cdd-b095-123cd44d138d tempest-VolumesListAdminTestJSON-1382528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98d347f0-c491-42e5-af69-f6e576fd167e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:36:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-329315868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d00c0da-217a-44d5-af20-da58e1407df4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='506aadc19d794217bd98762fba02c166',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:36:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:36:42Z,use_quota=True,user_id='a74c286050a5408f92631291aca3b1d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5f9a471a-55f9-4cdd-b095-123cd44d138d tempest-VolumesListAdminTestJSON-1382528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e290d89f-a321-4f44-9e31-410431a59e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5f9a471a-55f9-4cdd-b095-123cd44d138d tempest-VolumesListAdminTestJSON-1382528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e290d89f-a321-4f44-9e31-410431a59e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5f9a471a-55f9-4cdd-b095-123cd44d138d tempest-VolumesListAdminTestJSON-1382528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4bdbb19-8832-4342-bb35-9265d798cfa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5f9a471a-55f9-4cdd-b095-123cd44d138d tempest-VolumesListAdminTestJSON-1382528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4bdbb19-8832-4342-bb35-9265d798cfa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d00c0da-217a-44d5-af20-da58e1407df4', 'volume_name': 'volume-0d00c0da-217a-44d5-af20-da58e1407df4', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5f9a471a-55f9-4cdd-b095-123cd44d138d tempest-VolumesListAdminTestJSON-1382528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f54b6d1-9628-489b-a136-e661e4b8bd48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5f9a471a-55f9-4cdd-b095-123cd44d138d tempest-VolumesListAdminTestJSON-1382528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f54b6d1-9628-489b-a136-e661e4b8bd48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5f9a471a-55f9-4cdd-b095-123cd44d138d tempest-VolumesListAdminTestJSON-1382528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0b8a578-1947-4211-ad63-fd915f544de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:42 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-5f9a471a-55f9-4cdd-b095-123cd44d138d tempest-VolumesListAdminTestJSON-1382528 None] Volume 0d00c0da-217a-44d5-af20-da58e1407df4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d00c0da-217a-44d5-af20-da58e1407df4', 'volume_size': 1} Jul 08 18:36:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5f9a471a-55f9-4cdd-b095-123cd44d138d tempest-VolumesListAdminTestJSON-1382528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:36:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5f9a471a-55f9-4cdd-b095-123cd44d138d tempest-VolumesListAdminTestJSON-1382528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:36:42 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-5f9a471a-55f9-4cdd-b095-123cd44d138d tempest-VolumesListAdminTestJSON-1382528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:36:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-329315868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d00c0da-217a-44d5-af20-da58e1407df4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='506aadc19d794217bd98762fba02c166',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:36:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:36:42Z,use_quota=True,user_id='a74c286050a5408f92631291aca3b1d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:36:42 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-5f9a471a-55f9-4cdd-b095-123cd44d138d tempest-VolumesListAdminTestJSON-1382528 None] Creating volume 0d00c0da-217a-44d5-af20-da58e1407df4 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:36:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5f9a471a-55f9-4cdd-b095-123cd44d138d tempest-VolumesListAdminTestJSON-1382528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:36:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5f9a471a-55f9-4cdd-b095-123cd44d138d tempest-VolumesListAdminTestJSON-1382528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:36:42 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-5f9a471a-55f9-4cdd-b095-123cd44d138d tempest-VolumesListAdminTestJSON-1382528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:36:42 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-5f9a471a-55f9-4cdd-b095-123cd44d138d tempest-VolumesListAdminTestJSON-1382528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:36:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5f9a471a-55f9-4cdd-b095-123cd44d138d tempest-VolumesListAdminTestJSON-1382528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:36:42 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-5f9a471a-55f9-4cdd-b095-123cd44d138d tempest-VolumesListAdminTestJSON-1382528 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:36:42 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-5f9a471a-55f9-4cdd-b095-123cd44d138d tempest-VolumesListAdminTestJSON-1382528 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:36:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5f9a471a-55f9-4cdd-b095-123cd44d138d tempest-VolumesListAdminTestJSON-1382528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0d00c0da-217a-44d5-af20-da58e1407df4 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:42 devstack sudo[91158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0d00c0da-217a-44d5-af20-da58e1407df4 1073741824 Jul 08 18:36:42 devstack sudo[91158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-2185af7c-ba47-46d5-bca5-58109a712b84 tempest-VolumesMetadataTest-5931053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:36:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-2185af7c-ba47-46d5-bca5-58109a712b84 tempest-VolumesMetadataTest-5931053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:36:42 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-2185af7c-ba47-46d5-bca5-58109a712b84 tempest-VolumesMetadataTest-5931053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:36:42 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-2185af7c-ba47-46d5-bca5-58109a712b84 tempest-VolumesMetadataTest-5931053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:36:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-2185af7c-ba47-46d5-bca5-58109a712b84 tempest-VolumesMetadataTest-5931053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:36:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2185af7c-ba47-46d5-bca5-58109a712b84 tempest-VolumesMetadataTest-5931053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:42 devstack sudo[91160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:36:42 devstack sudo[91160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:43 devstack sudo[91160]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2185af7c-ba47-46d5-bca5-58109a712b84 tempest-VolumesMetadataTest-5931053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.998s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:43 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-2185af7c-ba47-46d5-bca5-58109a712b84 tempest-VolumesMetadataTest-5931053 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:36:43 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-2185af7c-ba47-46d5-bca5-58109a712b84 tempest-VolumesMetadataTest-5931053 None] Deleted volume successfully. Jul 08 18:36:43 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-2185af7c-ba47-46d5-bca5-58109a712b84 tempest-VolumesMetadataTest-5931053 None] Lock "cinder-f1190288-95b7-442b-a2aa-989d9b955019-delete_volume" released by "delete_volume" :: held 3.739s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:36:43 devstack sudo[91158]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5f9a471a-55f9-4cdd-b095-123cd44d138d tempest-VolumesListAdminTestJSON-1382528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0d00c0da-217a-44d5-af20-da58e1407df4 1073741824" returned: 0 in 1.251s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5f9a471a-55f9-4cdd-b095-123cd44d138d tempest-VolumesListAdminTestJSON-1382528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0d00c0da-217a-44d5-af20-da58e1407df4 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:43 devstack sudo[91166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0d00c0da-217a-44d5-af20-da58e1407df4 Jul 08 18:36:43 devstack sudo[91166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:44 devstack sudo[91166]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5f9a471a-55f9-4cdd-b095-123cd44d138d tempest-VolumesListAdminTestJSON-1382528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0d00c0da-217a-44d5-af20-da58e1407df4" returned: 0 in 0.786s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:44 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-5f9a471a-55f9-4cdd-b095-123cd44d138d tempest-VolumesListAdminTestJSON-1382528 None] <== create_volume: return (2089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:36:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5f9a471a-55f9-4cdd-b095-123cd44d138d tempest-VolumesListAdminTestJSON-1382528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.093s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:36:44 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5f9a471a-55f9-4cdd-b095-123cd44d138d tempest-VolumesListAdminTestJSON-1382528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0b8a578-1947-4211-ad63-fd915f544de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d00c0da-217a-44d5-af20-da58e1407df4', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:44 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5f9a471a-55f9-4cdd-b095-123cd44d138d tempest-VolumesListAdminTestJSON-1382528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff46b9d9-a3cb-490c-aa51-0284c7db27b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:44 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-5f9a471a-55f9-4cdd-b095-123cd44d138d tempest-VolumesListAdminTestJSON-1382528 None] Volume volume-0d00c0da-217a-44d5-af20-da58e1407df4 (0d00c0da-217a-44d5-af20-da58e1407df4): created successfully Jul 08 18:36:44 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5f9a471a-55f9-4cdd-b095-123cd44d138d tempest-VolumesListAdminTestJSON-1382528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff46b9d9-a3cb-490c-aa51-0284c7db27b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:44 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5f9a471a-55f9-4cdd-b095-123cd44d138d tempest-VolumesListAdminTestJSON-1382528 None] Flow 'volume_create_manager' (69b7ddb6-474e-4614-885d-63f2a432fca1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:36:44 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-5f9a471a-55f9-4cdd-b095-123cd44d138d tempest-VolumesListAdminTestJSON-1382528 None] Created volume successfully. Jul 08 18:36:46 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-452abdf0-c7d6-47ff-91c9-aa7178580385 tempest-VolumesListAdminTestJSON-1382528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:36:46 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-452abdf0-c7d6-47ff-91c9-aa7178580385 tempest-VolumesListAdminTestJSON-1382528 None] Flow 'volume_create_manager' (9d183a49-9cb4-4ca9-b357-b2b527d3c475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:36:46 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-452abdf0-c7d6-47ff-91c9-aa7178580385 tempest-VolumesListAdminTestJSON-1382528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7285bcd-4b67-4cbe-862e-c0e4e6289734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:46 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-452abdf0-c7d6-47ff-91c9-aa7178580385 tempest-VolumesListAdminTestJSON-1382528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7285bcd-4b67-4cbe-862e-c0e4e6289734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:36:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-518006928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a7242e0-33ca-4156-8b80-8ab4073fe1d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='506aadc19d794217bd98762fba02c166',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:36:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:36:46Z,use_quota=True,user_id='a74c286050a5408f92631291aca3b1d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:46 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-452abdf0-c7d6-47ff-91c9-aa7178580385 tempest-VolumesListAdminTestJSON-1382528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db125af5-ef61-4fa6-9e36-f8a9bd9fb25b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:46 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-452abdf0-c7d6-47ff-91c9-aa7178580385 tempest-VolumesListAdminTestJSON-1382528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db125af5-ef61-4fa6-9e36-f8a9bd9fb25b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:46 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-452abdf0-c7d6-47ff-91c9-aa7178580385 tempest-VolumesListAdminTestJSON-1382528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (206edd0e-ebb2-4132-b3e3-78330566a67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:46 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-452abdf0-c7d6-47ff-91c9-aa7178580385 tempest-VolumesListAdminTestJSON-1382528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (206edd0e-ebb2-4132-b3e3-78330566a67e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a7242e0-33ca-4156-8b80-8ab4073fe1d3', 'volume_name': 'volume-8a7242e0-33ca-4156-8b80-8ab4073fe1d3', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:46 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-452abdf0-c7d6-47ff-91c9-aa7178580385 tempest-VolumesListAdminTestJSON-1382528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c7f05a8-5625-4c61-8ce2-2e7e90f3f6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:46 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-452abdf0-c7d6-47ff-91c9-aa7178580385 tempest-VolumesListAdminTestJSON-1382528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c7f05a8-5625-4c61-8ce2-2e7e90f3f6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:46 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-452abdf0-c7d6-47ff-91c9-aa7178580385 tempest-VolumesListAdminTestJSON-1382528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bc03742-8a76-4612-8ee6-6b6857e1d6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:46 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-452abdf0-c7d6-47ff-91c9-aa7178580385 tempest-VolumesListAdminTestJSON-1382528 None] Volume 8a7242e0-33ca-4156-8b80-8ab4073fe1d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a7242e0-33ca-4156-8b80-8ab4073fe1d3', 'volume_size': 1} Jul 08 18:36:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-452abdf0-c7d6-47ff-91c9-aa7178580385 tempest-VolumesListAdminTestJSON-1382528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:36:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-452abdf0-c7d6-47ff-91c9-aa7178580385 tempest-VolumesListAdminTestJSON-1382528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:36:46 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-452abdf0-c7d6-47ff-91c9-aa7178580385 tempest-VolumesListAdminTestJSON-1382528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:36:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-518006928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a7242e0-33ca-4156-8b80-8ab4073fe1d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='506aadc19d794217bd98762fba02c166',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:36:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:36:46Z,use_quota=True,user_id='a74c286050a5408f92631291aca3b1d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:36:46 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-452abdf0-c7d6-47ff-91c9-aa7178580385 tempest-VolumesListAdminTestJSON-1382528 None] Creating volume 8a7242e0-33ca-4156-8b80-8ab4073fe1d3 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:36:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-452abdf0-c7d6-47ff-91c9-aa7178580385 tempest-VolumesListAdminTestJSON-1382528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:36:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-452abdf0-c7d6-47ff-91c9-aa7178580385 tempest-VolumesListAdminTestJSON-1382528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:36:46 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-452abdf0-c7d6-47ff-91c9-aa7178580385 tempest-VolumesListAdminTestJSON-1382528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:36:46 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-452abdf0-c7d6-47ff-91c9-aa7178580385 tempest-VolumesListAdminTestJSON-1382528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:36:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-452abdf0-c7d6-47ff-91c9-aa7178580385 tempest-VolumesListAdminTestJSON-1382528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:36:46 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-452abdf0-c7d6-47ff-91c9-aa7178580385 tempest-VolumesListAdminTestJSON-1382528 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:36:46 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-452abdf0-c7d6-47ff-91c9-aa7178580385 tempest-VolumesListAdminTestJSON-1382528 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:36:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-452abdf0-c7d6-47ff-91c9-aa7178580385 tempest-VolumesListAdminTestJSON-1382528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8a7242e0-33ca-4156-8b80-8ab4073fe1d3 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:46 devstack sudo[91169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8a7242e0-33ca-4156-8b80-8ab4073fe1d3 1073741824 Jul 08 18:36:46 devstack sudo[91169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:47 devstack sudo[91169]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-452abdf0-c7d6-47ff-91c9-aa7178580385 tempest-VolumesListAdminTestJSON-1382528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8a7242e0-33ca-4156-8b80-8ab4073fe1d3 1073741824" returned: 0 in 1.216s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-452abdf0-c7d6-47ff-91c9-aa7178580385 tempest-VolumesListAdminTestJSON-1382528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8a7242e0-33ca-4156-8b80-8ab4073fe1d3 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:47 devstack sudo[91176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8a7242e0-33ca-4156-8b80-8ab4073fe1d3 Jul 08 18:36:47 devstack sudo[91176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:48 devstack cinder-volume[86873]: DEBUG oslo_service.periodic_task [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86873) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:36:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:36:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:36:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:36:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:36:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:36:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:48 devstack sudo[91178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:36:48 devstack sudo[91178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:48 devstack sudo[91176]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-452abdf0-c7d6-47ff-91c9-aa7178580385 tempest-VolumesListAdminTestJSON-1382528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8a7242e0-33ca-4156-8b80-8ab4073fe1d3" returned: 0 in 0.857s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-452abdf0-c7d6-47ff-91c9-aa7178580385 tempest-VolumesListAdminTestJSON-1382528 None] <== create_volume: return (2167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:36:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-452abdf0-c7d6-47ff-91c9-aa7178580385 tempest-VolumesListAdminTestJSON-1382528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.174s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:36:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-452abdf0-c7d6-47ff-91c9-aa7178580385 tempest-VolumesListAdminTestJSON-1382528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bc03742-8a76-4612-8ee6-6b6857e1d6c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a7242e0-33ca-4156-8b80-8ab4073fe1d3', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-452abdf0-c7d6-47ff-91c9-aa7178580385 tempest-VolumesListAdminTestJSON-1382528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54f4b9cf-835a-4c29-8e4a-683e143958d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:48 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-452abdf0-c7d6-47ff-91c9-aa7178580385 tempest-VolumesListAdminTestJSON-1382528 None] Volume volume-8a7242e0-33ca-4156-8b80-8ab4073fe1d3 (8a7242e0-33ca-4156-8b80-8ab4073fe1d3): created successfully Jul 08 18:36:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-452abdf0-c7d6-47ff-91c9-aa7178580385 tempest-VolumesListAdminTestJSON-1382528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54f4b9cf-835a-4c29-8e4a-683e143958d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-452abdf0-c7d6-47ff-91c9-aa7178580385 tempest-VolumesListAdminTestJSON-1382528 None] Flow 'volume_create_manager' (9d183a49-9cb4-4ca9-b357-b2b527d3c475) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:36:48 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-452abdf0-c7d6-47ff-91c9-aa7178580385 tempest-VolumesListAdminTestJSON-1382528 None] Created volume successfully. Jul 08 18:36:49 devstack sudo[91178]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.853s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:49 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:36:49 devstack cinder-volume[86873]: DEBUG oslo_service.periodic_task [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running periodic task VolumeManager._thread_info {{(pid=86873) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:36:49 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] thread count: 9 {{(pid=86873) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:36:49 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] thread info: [<_MainThread(MainThread, started 138577734545536)>, , , , , , , , ] {{(pid=86873) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:36:50 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-f107c68b-af76-4341-a913-bc21a3a6dce6 tempest-VolumesListAdminTestJSON-1382528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:36:50 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f107c68b-af76-4341-a913-bc21a3a6dce6 tempest-VolumesListAdminTestJSON-1382528 None] Flow 'volume_create_manager' (3064acc1-2744-4881-952c-d2d8ee933cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:36:50 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f107c68b-af76-4341-a913-bc21a3a6dce6 tempest-VolumesListAdminTestJSON-1382528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da32633d-173f-41dd-a95b-c129dbd5bd2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:50 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f107c68b-af76-4341-a913-bc21a3a6dce6 tempest-VolumesListAdminTestJSON-1382528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da32633d-173f-41dd-a95b-c129dbd5bd2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:36:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1531607245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b218241b-2d98-4e3f-8da4-1afff29efe3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='506aadc19d794217bd98762fba02c166',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:36:50Z,use_quota=True,user_id='a74c286050a5408f92631291aca3b1d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:50 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f107c68b-af76-4341-a913-bc21a3a6dce6 tempest-VolumesListAdminTestJSON-1382528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02f1f135-effc-4c5f-b754-244a2992174d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:50 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f107c68b-af76-4341-a913-bc21a3a6dce6 tempest-VolumesListAdminTestJSON-1382528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02f1f135-effc-4c5f-b754-244a2992174d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:50 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f107c68b-af76-4341-a913-bc21a3a6dce6 tempest-VolumesListAdminTestJSON-1382528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f27521c-d18f-4d87-b23f-9ec7c78e8b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:50 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f107c68b-af76-4341-a913-bc21a3a6dce6 tempest-VolumesListAdminTestJSON-1382528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f27521c-d18f-4d87-b23f-9ec7c78e8b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b218241b-2d98-4e3f-8da4-1afff29efe3a', 'volume_name': 'volume-b218241b-2d98-4e3f-8da4-1afff29efe3a', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:50 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f107c68b-af76-4341-a913-bc21a3a6dce6 tempest-VolumesListAdminTestJSON-1382528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2380ded5-220e-4198-985c-2527b6030d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:50 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f107c68b-af76-4341-a913-bc21a3a6dce6 tempest-VolumesListAdminTestJSON-1382528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2380ded5-220e-4198-985c-2527b6030d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:50 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f107c68b-af76-4341-a913-bc21a3a6dce6 tempest-VolumesListAdminTestJSON-1382528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89cb0f5d-7784-4b0c-aebb-71c677f07a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:50 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-f107c68b-af76-4341-a913-bc21a3a6dce6 tempest-VolumesListAdminTestJSON-1382528 None] Volume b218241b-2d98-4e3f-8da4-1afff29efe3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b218241b-2d98-4e3f-8da4-1afff29efe3a', 'volume_size': 1} Jul 08 18:36:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f107c68b-af76-4341-a913-bc21a3a6dce6 tempest-VolumesListAdminTestJSON-1382528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:36:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f107c68b-af76-4341-a913-bc21a3a6dce6 tempest-VolumesListAdminTestJSON-1382528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:36:50 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-f107c68b-af76-4341-a913-bc21a3a6dce6 tempest-VolumesListAdminTestJSON-1382528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:36:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1531607245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b218241b-2d98-4e3f-8da4-1afff29efe3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='506aadc19d794217bd98762fba02c166',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:36:50Z,use_quota=True,user_id='a74c286050a5408f92631291aca3b1d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:36:50 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-f107c68b-af76-4341-a913-bc21a3a6dce6 tempest-VolumesListAdminTestJSON-1382528 None] Creating volume b218241b-2d98-4e3f-8da4-1afff29efe3a {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:36:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f107c68b-af76-4341-a913-bc21a3a6dce6 tempest-VolumesListAdminTestJSON-1382528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:36:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f107c68b-af76-4341-a913-bc21a3a6dce6 tempest-VolumesListAdminTestJSON-1382528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:36:50 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-f107c68b-af76-4341-a913-bc21a3a6dce6 tempest-VolumesListAdminTestJSON-1382528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:36:50 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-f107c68b-af76-4341-a913-bc21a3a6dce6 tempest-VolumesListAdminTestJSON-1382528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:36:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f107c68b-af76-4341-a913-bc21a3a6dce6 tempest-VolumesListAdminTestJSON-1382528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:36:50 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-f107c68b-af76-4341-a913-bc21a3a6dce6 tempest-VolumesListAdminTestJSON-1382528 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:36:50 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-f107c68b-af76-4341-a913-bc21a3a6dce6 tempest-VolumesListAdminTestJSON-1382528 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:36:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f107c68b-af76-4341-a913-bc21a3a6dce6 tempest-VolumesListAdminTestJSON-1382528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b218241b-2d98-4e3f-8da4-1afff29efe3a 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:50 devstack sudo[91231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b218241b-2d98-4e3f-8da4-1afff29efe3a 1073741824 Jul 08 18:36:50 devstack sudo[91231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:51 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc165043-9e18-4834-bf2b-6ad5a3babf86 tempest-VolumesTransfersV355Test-890447361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:36:51 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-bc165043-9e18-4834-bf2b-6ad5a3babf86 tempest-VolumesTransfersV355Test-890447361 None] Flow 'volume_create_manager' (02e7b9ad-0f0e-401f-802f-f4230ae85b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:36:51 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-bc165043-9e18-4834-bf2b-6ad5a3babf86 tempest-VolumesTransfersV355Test-890447361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c86df7e1-bb8a-4b22-a3e4-4267ed252bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:51 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-bc165043-9e18-4834-bf2b-6ad5a3babf86 tempest-VolumesTransfersV355Test-890447361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c86df7e1-bb8a-4b22-a3e4-4267ed252bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:36:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-775385190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8908029-c542-41d9-b3f8-53cc573caf3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4be75fb5df3f461eb89060fcb595d3a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:36:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:36:51Z,use_quota=True,user_id='1e6689c1761d4fdbbbb7c98fa93846be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:51 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-bc165043-9e18-4834-bf2b-6ad5a3babf86 tempest-VolumesTransfersV355Test-890447361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fca53b15-b4f6-4493-afe7-bc28900b0837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:51 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-bc165043-9e18-4834-bf2b-6ad5a3babf86 tempest-VolumesTransfersV355Test-890447361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fca53b15-b4f6-4493-afe7-bc28900b0837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:51 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-bc165043-9e18-4834-bf2b-6ad5a3babf86 tempest-VolumesTransfersV355Test-890447361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8502fa4b-e057-41f7-bf27-b42f8f13ab11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:51 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-bc165043-9e18-4834-bf2b-6ad5a3babf86 tempest-VolumesTransfersV355Test-890447361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8502fa4b-e057-41f7-bf27-b42f8f13ab11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8908029-c542-41d9-b3f8-53cc573caf3a', 'volume_name': 'volume-d8908029-c542-41d9-b3f8-53cc573caf3a', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:51 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-bc165043-9e18-4834-bf2b-6ad5a3babf86 tempest-VolumesTransfersV355Test-890447361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8d10e40-851e-41f9-a281-8928e4906c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:51 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-bc165043-9e18-4834-bf2b-6ad5a3babf86 tempest-VolumesTransfersV355Test-890447361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8d10e40-851e-41f9-a281-8928e4906c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:51 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-bc165043-9e18-4834-bf2b-6ad5a3babf86 tempest-VolumesTransfersV355Test-890447361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d969462f-8b8b-4a9d-bdfd-e059b37a6a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:51 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-bc165043-9e18-4834-bf2b-6ad5a3babf86 tempest-VolumesTransfersV355Test-890447361 None] Volume d8908029-c542-41d9-b3f8-53cc573caf3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8908029-c542-41d9-b3f8-53cc573caf3a', 'volume_size': 1} Jul 08 18:36:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-bc165043-9e18-4834-bf2b-6ad5a3babf86 tempest-VolumesTransfersV355Test-890447361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:36:51 devstack sudo[91231]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f107c68b-af76-4341-a913-bc21a3a6dce6 tempest-VolumesListAdminTestJSON-1382528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b218241b-2d98-4e3f-8da4-1afff29efe3a 1073741824" returned: 0 in 1.202s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f107c68b-af76-4341-a913-bc21a3a6dce6 tempest-VolumesListAdminTestJSON-1382528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b218241b-2d98-4e3f-8da4-1afff29efe3a {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:51 devstack sudo[91265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b218241b-2d98-4e3f-8da4-1afff29efe3a Jul 08 18:36:51 devstack sudo[91265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:52 devstack sudo[91265]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f107c68b-af76-4341-a913-bc21a3a6dce6 tempest-VolumesListAdminTestJSON-1382528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b218241b-2d98-4e3f-8da4-1afff29efe3a" returned: 0 in 0.848s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:52 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-f107c68b-af76-4341-a913-bc21a3a6dce6 tempest-VolumesListAdminTestJSON-1382528 None] <== create_volume: return (2106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:36:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f107c68b-af76-4341-a913-bc21a3a6dce6 tempest-VolumesListAdminTestJSON-1382528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.110s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:36:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-bc165043-9e18-4834-bf2b-6ad5a3babf86 tempest-VolumesTransfersV355Test-890447361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.364s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:36:52 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-bc165043-9e18-4834-bf2b-6ad5a3babf86 tempest-VolumesTransfersV355Test-890447361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:36:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-775385190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8908029-c542-41d9-b3f8-53cc573caf3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4be75fb5df3f461eb89060fcb595d3a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:36:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:36:51Z,use_quota=True,user_id='1e6689c1761d4fdbbbb7c98fa93846be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:36:52 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-bc165043-9e18-4834-bf2b-6ad5a3babf86 tempest-VolumesTransfersV355Test-890447361 None] Creating volume d8908029-c542-41d9-b3f8-53cc573caf3a {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:36:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-bc165043-9e18-4834-bf2b-6ad5a3babf86 tempest-VolumesTransfersV355Test-890447361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:36:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-bc165043-9e18-4834-bf2b-6ad5a3babf86 tempest-VolumesTransfersV355Test-890447361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:36:52 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-bc165043-9e18-4834-bf2b-6ad5a3babf86 tempest-VolumesTransfersV355Test-890447361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:36:52 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-bc165043-9e18-4834-bf2b-6ad5a3babf86 tempest-VolumesTransfersV355Test-890447361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:36:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-bc165043-9e18-4834-bf2b-6ad5a3babf86 tempest-VolumesTransfersV355Test-890447361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:36:52 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-bc165043-9e18-4834-bf2b-6ad5a3babf86 tempest-VolumesTransfersV355Test-890447361 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:36:52 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-bc165043-9e18-4834-bf2b-6ad5a3babf86 tempest-VolumesTransfersV355Test-890447361 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:36:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-bc165043-9e18-4834-bf2b-6ad5a3babf86 tempest-VolumesTransfersV355Test-890447361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d8908029-c542-41d9-b3f8-53cc573caf3a 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:52 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f107c68b-af76-4341-a913-bc21a3a6dce6 tempest-VolumesListAdminTestJSON-1382528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89cb0f5d-7784-4b0c-aebb-71c677f07a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b218241b-2d98-4e3f-8da4-1afff29efe3a', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:52 devstack sudo[91272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d8908029-c542-41d9-b3f8-53cc573caf3a 1073741824 Jul 08 18:36:52 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f107c68b-af76-4341-a913-bc21a3a6dce6 tempest-VolumesListAdminTestJSON-1382528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ea778bb-ac24-41f2-b28a-4578719e4507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:52 devstack sudo[91272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:52 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-f107c68b-af76-4341-a913-bc21a3a6dce6 tempest-VolumesListAdminTestJSON-1382528 None] Volume volume-b218241b-2d98-4e3f-8da4-1afff29efe3a (b218241b-2d98-4e3f-8da4-1afff29efe3a): created successfully Jul 08 18:36:52 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f107c68b-af76-4341-a913-bc21a3a6dce6 tempest-VolumesListAdminTestJSON-1382528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ea778bb-ac24-41f2-b28a-4578719e4507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:52 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f107c68b-af76-4341-a913-bc21a3a6dce6 tempest-VolumesListAdminTestJSON-1382528 None] Flow 'volume_create_manager' (3064acc1-2744-4881-952c-d2d8ee933cb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:36:52 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-f107c68b-af76-4341-a913-bc21a3a6dce6 tempest-VolumesListAdminTestJSON-1382528 None] Created volume successfully. Jul 08 18:36:54 devstack sudo[91272]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-bc165043-9e18-4834-bf2b-6ad5a3babf86 tempest-VolumesTransfersV355Test-890447361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d8908029-c542-41d9-b3f8-53cc573caf3a 1073741824" returned: 0 in 1.313s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-bc165043-9e18-4834-bf2b-6ad5a3babf86 tempest-VolumesTransfersV355Test-890447361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d8908029-c542-41d9-b3f8-53cc573caf3a {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:54 devstack sudo[91280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d8908029-c542-41d9-b3f8-53cc573caf3a Jul 08 18:36:54 devstack sudo[91280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:54 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ee520af-0a80-47d8-b66f-e0441b8ac0e9 tempest-VolumesListAdminTestJSON-1166390311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:36:54 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3ee520af-0a80-47d8-b66f-e0441b8ac0e9 tempest-VolumesListAdminTestJSON-1166390311 None] Flow 'volume_create_manager' (8527be27-f285-4838-a2a6-81d3ba285bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:36:54 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3ee520af-0a80-47d8-b66f-e0441b8ac0e9 tempest-VolumesListAdminTestJSON-1166390311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5b39050-dc97-4dff-8f40-64c7ac048769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:54 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3ee520af-0a80-47d8-b66f-e0441b8ac0e9 tempest-VolumesListAdminTestJSON-1166390311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5b39050-dc97-4dff-8f40-64c7ac048769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:36:54Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3af157c9-b716-462d-ac3b-6bf35618abe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69d771347e4f43b383d49b09e251dc6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:36:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:36:55Z,use_quota=True,user_id='30d6b057d1a641cca895cbe6ba165084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:54 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3ee520af-0a80-47d8-b66f-e0441b8ac0e9 tempest-VolumesListAdminTestJSON-1166390311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80ef6c4d-33da-423b-8b03-c8e3ee301d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:54 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3ee520af-0a80-47d8-b66f-e0441b8ac0e9 tempest-VolumesListAdminTestJSON-1166390311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80ef6c4d-33da-423b-8b03-c8e3ee301d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:55 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3ee520af-0a80-47d8-b66f-e0441b8ac0e9 tempest-VolumesListAdminTestJSON-1166390311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16ba7fc9-2188-4ec5-868a-c9f8aeb2d8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:55 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3ee520af-0a80-47d8-b66f-e0441b8ac0e9 tempest-VolumesListAdminTestJSON-1166390311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16ba7fc9-2188-4ec5-868a-c9f8aeb2d8f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3af157c9-b716-462d-ac3b-6bf35618abe8', 'volume_name': 'volume-3af157c9-b716-462d-ac3b-6bf35618abe8', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:55 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3ee520af-0a80-47d8-b66f-e0441b8ac0e9 tempest-VolumesListAdminTestJSON-1166390311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb3389a8-ac49-4977-afa0-0727436ac607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:55 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3ee520af-0a80-47d8-b66f-e0441b8ac0e9 tempest-VolumesListAdminTestJSON-1166390311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb3389a8-ac49-4977-afa0-0727436ac607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:55 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3ee520af-0a80-47d8-b66f-e0441b8ac0e9 tempest-VolumesListAdminTestJSON-1166390311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6763278d-ffd3-451f-ba48-aeebf80c655b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:55 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-3ee520af-0a80-47d8-b66f-e0441b8ac0e9 tempest-VolumesListAdminTestJSON-1166390311 None] Volume 3af157c9-b716-462d-ac3b-6bf35618abe8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3af157c9-b716-462d-ac3b-6bf35618abe8', 'volume_size': 1} Jul 08 18:36:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3ee520af-0a80-47d8-b66f-e0441b8ac0e9 tempest-VolumesListAdminTestJSON-1166390311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:36:55 devstack sudo[91280]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-bc165043-9e18-4834-bf2b-6ad5a3babf86 tempest-VolumesTransfersV355Test-890447361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d8908029-c542-41d9-b3f8-53cc573caf3a" returned: 0 in 1.144s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:55 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-bc165043-9e18-4834-bf2b-6ad5a3babf86 tempest-VolumesTransfersV355Test-890447361 None] <== create_volume: return (2527ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:36:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-bc165043-9e18-4834-bf2b-6ad5a3babf86 tempest-VolumesTransfersV355Test-890447361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.530s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:36:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3ee520af-0a80-47d8-b66f-e0441b8ac0e9 tempest-VolumesListAdminTestJSON-1166390311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.204s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:36:55 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-3ee520af-0a80-47d8-b66f-e0441b8ac0e9 tempest-VolumesListAdminTestJSON-1166390311 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:36:54Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3af157c9-b716-462d-ac3b-6bf35618abe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69d771347e4f43b383d49b09e251dc6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:36:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:36:55Z,use_quota=True,user_id='30d6b057d1a641cca895cbe6ba165084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:36:55 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-3ee520af-0a80-47d8-b66f-e0441b8ac0e9 tempest-VolumesListAdminTestJSON-1166390311 None] Creating volume 3af157c9-b716-462d-ac3b-6bf35618abe8 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:36:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3ee520af-0a80-47d8-b66f-e0441b8ac0e9 tempest-VolumesListAdminTestJSON-1166390311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:36:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3ee520af-0a80-47d8-b66f-e0441b8ac0e9 tempest-VolumesListAdminTestJSON-1166390311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:36:55 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-3ee520af-0a80-47d8-b66f-e0441b8ac0e9 tempest-VolumesListAdminTestJSON-1166390311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:36:55 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-3ee520af-0a80-47d8-b66f-e0441b8ac0e9 tempest-VolumesListAdminTestJSON-1166390311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:36:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3ee520af-0a80-47d8-b66f-e0441b8ac0e9 tempest-VolumesListAdminTestJSON-1166390311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:36:55 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-3ee520af-0a80-47d8-b66f-e0441b8ac0e9 tempest-VolumesListAdminTestJSON-1166390311 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:36:55 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-3ee520af-0a80-47d8-b66f-e0441b8ac0e9 tempest-VolumesListAdminTestJSON-1166390311 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:36:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3ee520af-0a80-47d8-b66f-e0441b8ac0e9 tempest-VolumesListAdminTestJSON-1166390311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3af157c9-b716-462d-ac3b-6bf35618abe8 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:55 devstack sudo[91321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3af157c9-b716-462d-ac3b-6bf35618abe8 1073741824 Jul 08 18:36:55 devstack sudo[91321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:55 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-bc165043-9e18-4834-bf2b-6ad5a3babf86 tempest-VolumesTransfersV355Test-890447361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d969462f-8b8b-4a9d-bdfd-e059b37a6a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8908029-c542-41d9-b3f8-53cc573caf3a', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:55 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-bc165043-9e18-4834-bf2b-6ad5a3babf86 tempest-VolumesTransfersV355Test-890447361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00e09d90-4ad3-4e50-ab20-d2cfd17d6c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:55 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-bc165043-9e18-4834-bf2b-6ad5a3babf86 tempest-VolumesTransfersV355Test-890447361 None] Volume volume-d8908029-c542-41d9-b3f8-53cc573caf3a (d8908029-c542-41d9-b3f8-53cc573caf3a): created successfully Jul 08 18:36:55 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-bc165043-9e18-4834-bf2b-6ad5a3babf86 tempest-VolumesTransfersV355Test-890447361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00e09d90-4ad3-4e50-ab20-d2cfd17d6c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:55 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-bc165043-9e18-4834-bf2b-6ad5a3babf86 tempest-VolumesTransfersV355Test-890447361 None] Flow 'volume_create_manager' (02e7b9ad-0f0e-401f-802f-f4230ae85b71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:36:55 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-bc165043-9e18-4834-bf2b-6ad5a3babf86 tempest-VolumesTransfersV355Test-890447361 None] Created volume successfully. Jul 08 18:36:56 devstack sudo[91321]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3ee520af-0a80-47d8-b66f-e0441b8ac0e9 tempest-VolumesListAdminTestJSON-1166390311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3af157c9-b716-462d-ac3b-6bf35618abe8 1073741824" returned: 0 in 1.271s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3ee520af-0a80-47d8-b66f-e0441b8ac0e9 tempest-VolumesListAdminTestJSON-1166390311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3af157c9-b716-462d-ac3b-6bf35618abe8 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:56 devstack sudo[91328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3af157c9-b716-462d-ac3b-6bf35618abe8 Jul 08 18:36:56 devstack sudo[91328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:56 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-334279d4-862c-46b2-91a7-9ff8db901976 tempest-VolumesTransfersV355Test-2113075480 None] Transfer volume completed successfully. Jul 08 18:36:57 devstack sudo[91328]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3ee520af-0a80-47d8-b66f-e0441b8ac0e9 tempest-VolumesListAdminTestJSON-1166390311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3af157c9-b716-462d-ac3b-6bf35618abe8" returned: 0 in 0.779s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:57 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-3ee520af-0a80-47d8-b66f-e0441b8ac0e9 tempest-VolumesListAdminTestJSON-1166390311 None] <== create_volume: return (2116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:36:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3ee520af-0a80-47d8-b66f-e0441b8ac0e9 tempest-VolumesListAdminTestJSON-1166390311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.119s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:36:57 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3ee520af-0a80-47d8-b66f-e0441b8ac0e9 tempest-VolumesListAdminTestJSON-1166390311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6763278d-ffd3-451f-ba48-aeebf80c655b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3af157c9-b716-462d-ac3b-6bf35618abe8', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:57 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3ee520af-0a80-47d8-b66f-e0441b8ac0e9 tempest-VolumesListAdminTestJSON-1166390311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a59228d-588e-49d6-b5cb-dd9afd65e06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:57 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-3ee520af-0a80-47d8-b66f-e0441b8ac0e9 tempest-VolumesListAdminTestJSON-1166390311 None] Volume volume-3af157c9-b716-462d-ac3b-6bf35618abe8 (3af157c9-b716-462d-ac3b-6bf35618abe8): created successfully Jul 08 18:36:57 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3ee520af-0a80-47d8-b66f-e0441b8ac0e9 tempest-VolumesListAdminTestJSON-1166390311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a59228d-588e-49d6-b5cb-dd9afd65e06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:57 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3ee520af-0a80-47d8-b66f-e0441b8ac0e9 tempest-VolumesListAdminTestJSON-1166390311 None] Flow 'volume_create_manager' (8527be27-f285-4838-a2a6-81d3ba285bfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:36:57 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-3ee520af-0a80-47d8-b66f-e0441b8ac0e9 tempest-VolumesListAdminTestJSON-1166390311 None] Created volume successfully. Jul 08 18:36:57 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-8a815c09-003a-4cb8-b331-eada06f39c87 tempest-VolumesTransfersV355Test-1753392688 None] Acquiring lock "cinder-d8908029-c542-41d9-b3f8-53cc573caf3a-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:36:57 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-8a815c09-003a-4cb8-b331-eada06f39c87 tempest-VolumesTransfersV355Test-1753392688 None] Lock "cinder-d8908029-c542-41d9-b3f8-53cc573caf3a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:36:57 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-8a815c09-003a-4cb8-b331-eada06f39c87 tempest-VolumesTransfersV355Test-1753392688 None] Acquiring lock "cinder-quobyte-d8908029-c542-41d9-b3f8-53cc573caf3a" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:36:57 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-8a815c09-003a-4cb8-b331-eada06f39c87 tempest-VolumesTransfersV355Test-1753392688 None] Lock "cinder-quobyte-d8908029-c542-41d9-b3f8-53cc573caf3a" acquired by "delete_volume" :: waited 0.037s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:36:57 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db89c3b-fe46-444a-af70-d7f9092954b1]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:36:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8a815c09-003a-4cb8-b331-eada06f39c87 tempest-VolumesTransfersV355Test-1753392688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d8908029-c542-41d9-b3f8-53cc573caf3a {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:58 devstack sudo[91333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d8908029-c542-41d9-b3f8-53cc573caf3a Jul 08 18:36:58 devstack sudo[91333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:58 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-73166bd8-e51e-46a8-9dee-8fd10429bbf1 tempest-VolumesListAdminTestJSON-1166390311 None] Acquiring lock "cinder-3af157c9-b716-462d-ac3b-6bf35618abe8-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:36:58 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-73166bd8-e51e-46a8-9dee-8fd10429bbf1 tempest-VolumesListAdminTestJSON-1166390311 None] Lock "cinder-3af157c9-b716-462d-ac3b-6bf35618abe8-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:36:58 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-73166bd8-e51e-46a8-9dee-8fd10429bbf1 tempest-VolumesListAdminTestJSON-1166390311 None] Acquiring lock "cinder-quobyte-3af157c9-b716-462d-ac3b-6bf35618abe8" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:36:58 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-73166bd8-e51e-46a8-9dee-8fd10429bbf1 tempest-VolumesListAdminTestJSON-1166390311 None] Lock "cinder-quobyte-3af157c9-b716-462d-ac3b-6bf35618abe8" acquired by "delete_volume" :: waited 0.049s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:36:58 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-a8cec83c-5555-4788-8720-3ed84279c208 tempest-VolumesListAdminTestJSON-1382528 None] Acquiring lock "cinder-b218241b-2d98-4e3f-8da4-1afff29efe3a-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:36:58 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[475c4b31-dc83-4195-bc03-75a4c7179f2e]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:36:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-73166bd8-e51e-46a8-9dee-8fd10429bbf1 tempest-VolumesListAdminTestJSON-1166390311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3af157c9-b716-462d-ac3b-6bf35618abe8 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:58 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-a8cec83c-5555-4788-8720-3ed84279c208 tempest-VolumesListAdminTestJSON-1382528 None] Lock "cinder-b218241b-2d98-4e3f-8da4-1afff29efe3a-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:36:58 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-a8cec83c-5555-4788-8720-3ed84279c208 tempest-VolumesListAdminTestJSON-1382528 None] Acquiring lock "cinder-quobyte-b218241b-2d98-4e3f-8da4-1afff29efe3a" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:36:58 devstack sudo[91335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3af157c9-b716-462d-ac3b-6bf35618abe8 Jul 08 18:36:58 devstack sudo[91335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:58 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-a8cec83c-5555-4788-8720-3ed84279c208 tempest-VolumesListAdminTestJSON-1382528 None] Lock "cinder-quobyte-b218241b-2d98-4e3f-8da4-1afff29efe3a" acquired by "delete_volume" :: waited 0.039s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:36:58 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4525c0-9264-4e27-9ee3-fc7d085c97ff]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:36:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-a8cec83c-5555-4788-8720-3ed84279c208 tempest-VolumesListAdminTestJSON-1382528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b218241b-2d98-4e3f-8da4-1afff29efe3a {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:59 devstack sudo[91337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b218241b-2d98-4e3f-8da4-1afff29efe3a Jul 08 18:36:59 devstack sudo[91337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:59 devstack sudo[91333]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8a815c09-003a-4cb8-b331-eada06f39c87 tempest-VolumesTransfersV355Test-1753392688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d8908029-c542-41d9-b3f8-53cc573caf3a" returned: 0 in 1.929s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8a815c09-003a-4cb8-b331-eada06f39c87 tempest-VolumesTransfersV355Test-1753392688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d8908029-c542-41d9-b3f8-53cc573caf3a {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:59 devstack sudo[91343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d8908029-c542-41d9-b3f8-53cc573caf3a Jul 08 18:36:59 devstack sudo[91343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:37:00 devstack sudo[91337]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-a8cec83c-5555-4788-8720-3ed84279c208 tempest-VolumesListAdminTestJSON-1382528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b218241b-2d98-4e3f-8da4-1afff29efe3a" returned: 0 in 1.554s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-a8cec83c-5555-4788-8720-3ed84279c208 tempest-VolumesListAdminTestJSON-1382528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b218241b-2d98-4e3f-8da4-1afff29efe3a {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:37:00 devstack sudo[91352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b218241b-2d98-4e3f-8da4-1afff29efe3a Jul 08 18:37:00 devstack sudo[91352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:37:00 devstack sudo[91335]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-73166bd8-e51e-46a8-9dee-8fd10429bbf1 tempest-VolumesListAdminTestJSON-1166390311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3af157c9-b716-462d-ac3b-6bf35618abe8" returned: 0 in 1.831s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-73166bd8-e51e-46a8-9dee-8fd10429bbf1 tempest-VolumesListAdminTestJSON-1166390311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3af157c9-b716-462d-ac3b-6bf35618abe8 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:37:00 devstack sudo[91357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3af157c9-b716-462d-ac3b-6bf35618abe8 Jul 08 18:37:00 devstack sudo[91357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:37:01 devstack sudo[91343]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8a815c09-003a-4cb8-b331-eada06f39c87 tempest-VolumesTransfersV355Test-1753392688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d8908029-c542-41d9-b3f8-53cc573caf3a" returned: 0 in 1.348s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:01 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-8a815c09-003a-4cb8-b331-eada06f39c87 tempest-VolumesTransfersV355Test-1753392688 None] Lock "cinder-quobyte-d8908029-c542-41d9-b3f8-53cc573caf3a" released by "delete_volume" :: held 3.418s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:37:01 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-8a815c09-003a-4cb8-b331-eada06f39c87 tempest-VolumesTransfersV355Test-1753392688 None] Created reservations ['9770298c-5583-48d7-bc41-892f3b268127', '7852df33-e2e5-4f28-a313-74f1bf620bd4', '1d4a7862-8f53-47ab-ae7e-88be04c4aaaf', 'fffc430e-16a2-41b5-ad99-7565923b7b15'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:37:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-8a815c09-003a-4cb8-b331-eada06f39c87 tempest-VolumesTransfersV355Test-1753392688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:37:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-8a815c09-003a-4cb8-b331-eada06f39c87 tempest-VolumesTransfersV355Test-1753392688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:37:01 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-8a815c09-003a-4cb8-b331-eada06f39c87 tempest-VolumesTransfersV355Test-1753392688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:37:01 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-8a815c09-003a-4cb8-b331-eada06f39c87 tempest-VolumesTransfersV355Test-1753392688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:37:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-8a815c09-003a-4cb8-b331-eada06f39c87 tempest-VolumesTransfersV355Test-1753392688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:37:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8a815c09-003a-4cb8-b331-eada06f39c87 tempest-VolumesTransfersV355Test-1753392688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:37:01 devstack sudo[91352]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-a8cec83c-5555-4788-8720-3ed84279c208 tempest-VolumesListAdminTestJSON-1382528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b218241b-2d98-4e3f-8da4-1afff29efe3a" returned: 0 in 1.167s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:01 devstack sudo[91371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:37:01 devstack sudo[91371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:37:01 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-a8cec83c-5555-4788-8720-3ed84279c208 tempest-VolumesListAdminTestJSON-1382528 None] Lock "cinder-quobyte-b218241b-2d98-4e3f-8da4-1afff29efe3a" released by "delete_volume" :: held 2.805s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:37:01 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-a8cec83c-5555-4788-8720-3ed84279c208 tempest-VolumesListAdminTestJSON-1382528 None] Created reservations ['a49ced34-b0d7-4948-bb69-51f07bb9d7c9', '7f1c1732-69f1-4881-b2b0-bc84fc9a4d69', 'a4c65b60-63a2-450c-8d4e-91668af18206', 'aadc2870-f4e2-43ba-bd84-64f3e47b3b30'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:37:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-a8cec83c-5555-4788-8720-3ed84279c208 tempest-VolumesListAdminTestJSON-1382528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:37:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-a8cec83c-5555-4788-8720-3ed84279c208 tempest-VolumesListAdminTestJSON-1382528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:37:01 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-a8cec83c-5555-4788-8720-3ed84279c208 tempest-VolumesListAdminTestJSON-1382528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:37:01 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-a8cec83c-5555-4788-8720-3ed84279c208 tempest-VolumesListAdminTestJSON-1382528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:37:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-a8cec83c-5555-4788-8720-3ed84279c208 tempest-VolumesListAdminTestJSON-1382528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:37:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-a8cec83c-5555-4788-8720-3ed84279c208 tempest-VolumesListAdminTestJSON-1382528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:37:01 devstack sudo[91357]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-73166bd8-e51e-46a8-9dee-8fd10429bbf1 tempest-VolumesListAdminTestJSON-1166390311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3af157c9-b716-462d-ac3b-6bf35618abe8" returned: 0 in 1.468s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:01 devstack sudo[91378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:37:01 devstack sudo[91378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:37:01 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-73166bd8-e51e-46a8-9dee-8fd10429bbf1 tempest-VolumesListAdminTestJSON-1166390311 None] Lock "cinder-quobyte-3af157c9-b716-462d-ac3b-6bf35618abe8" released by "delete_volume" :: held 3.413s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:37:02 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-73166bd8-e51e-46a8-9dee-8fd10429bbf1 tempest-VolumesListAdminTestJSON-1166390311 None] Created reservations ['4f1bdc96-2cc9-4ea3-8d8a-775178c3830e', 'ec6a11e2-cc48-49b8-aade-ae86707c4db0', '96a626e6-694d-485e-a4e7-c1f51c4bee56', '10ba0b45-3003-4144-a281-eaf0b1c7c087'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:37:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-73166bd8-e51e-46a8-9dee-8fd10429bbf1 tempest-VolumesListAdminTestJSON-1166390311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:37:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-73166bd8-e51e-46a8-9dee-8fd10429bbf1 tempest-VolumesListAdminTestJSON-1166390311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:37:02 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-73166bd8-e51e-46a8-9dee-8fd10429bbf1 tempest-VolumesListAdminTestJSON-1166390311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:37:02 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-73166bd8-e51e-46a8-9dee-8fd10429bbf1 tempest-VolumesListAdminTestJSON-1166390311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:37:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-73166bd8-e51e-46a8-9dee-8fd10429bbf1 tempest-VolumesListAdminTestJSON-1166390311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:37:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-73166bd8-e51e-46a8-9dee-8fd10429bbf1 tempest-VolumesListAdminTestJSON-1166390311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:37:02 devstack sudo[91380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:37:02 devstack sudo[91380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:37:02 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-cab8950e-86ed-40cc-a086-9a3c313c921a tempest-VolumesListAdminTestJSON-1382528 None] Acquiring lock "cinder-8a7242e0-33ca-4156-8b80-8ab4073fe1d3-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:37:02 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-cab8950e-86ed-40cc-a086-9a3c313c921a tempest-VolumesListAdminTestJSON-1382528 None] Lock "cinder-8a7242e0-33ca-4156-8b80-8ab4073fe1d3-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:37:02 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-cab8950e-86ed-40cc-a086-9a3c313c921a tempest-VolumesListAdminTestJSON-1382528 None] Acquiring lock "cinder-quobyte-8a7242e0-33ca-4156-8b80-8ab4073fe1d3" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:37:02 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-cab8950e-86ed-40cc-a086-9a3c313c921a tempest-VolumesListAdminTestJSON-1382528 None] Lock "cinder-quobyte-8a7242e0-33ca-4156-8b80-8ab4073fe1d3" acquired by "delete_volume" :: waited 0.045s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:37:02 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[0260c786-e8de-4b96-a4b6-018d14639813]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:37:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-cab8950e-86ed-40cc-a086-9a3c313c921a tempest-VolumesListAdminTestJSON-1382528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8a7242e0-33ca-4156-8b80-8ab4073fe1d3 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:37:02 devstack sudo[91386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8a7242e0-33ca-4156-8b80-8ab4073fe1d3 Jul 08 18:37:02 devstack sudo[91386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:37:02 devstack sudo[91371]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8a815c09-003a-4cb8-b331-eada06f39c87 tempest-VolumesTransfersV355Test-1753392688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 1.510s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:03 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-8a815c09-003a-4cb8-b331-eada06f39c87 tempest-VolumesTransfersV355Test-1753392688 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:37:03 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-8a815c09-003a-4cb8-b331-eada06f39c87 tempest-VolumesTransfersV355Test-1753392688 None] Deleted volume successfully. Jul 08 18:37:03 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-8a815c09-003a-4cb8-b331-eada06f39c87 tempest-VolumesTransfersV355Test-1753392688 None] Lock "cinder-d8908029-c542-41d9-b3f8-53cc573caf3a-delete_volume" released by "delete_volume" :: held 5.304s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:37:03 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c82e8aa-6d8f-481e-9602-9b380b4d6573 tempest-VolumesTransfersV355Test-890447361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:37:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1c82e8aa-6d8f-481e-9602-9b380b4d6573 tempest-VolumesTransfersV355Test-890447361 None] Flow 'volume_create_manager' (3a71ea48-262a-4f0e-b4e7-5650e1d10686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:37:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1c82e8aa-6d8f-481e-9602-9b380b4d6573 tempest-VolumesTransfersV355Test-890447361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31b69dde-60ce-4ca8-9389-38910c4a2765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:37:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1c82e8aa-6d8f-481e-9602-9b380b4d6573 tempest-VolumesTransfersV355Test-890447361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31b69dde-60ce-4ca8-9389-38910c4a2765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-485909551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03d1a4d2-9087-407a-b7ce-803ecda03324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4be75fb5df3f461eb89060fcb595d3a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:37:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:37:03Z,use_quota=True,user_id='1e6689c1761d4fdbbbb7c98fa93846be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:37:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1c82e8aa-6d8f-481e-9602-9b380b4d6573 tempest-VolumesTransfersV355Test-890447361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41794342-f3e4-43c2-96ed-c72825d16e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:37:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1c82e8aa-6d8f-481e-9602-9b380b4d6573 tempest-VolumesTransfersV355Test-890447361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41794342-f3e4-43c2-96ed-c72825d16e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:37:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1c82e8aa-6d8f-481e-9602-9b380b4d6573 tempest-VolumesTransfersV355Test-890447361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a070b017-4906-4152-bddc-755e30abc7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:37:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1c82e8aa-6d8f-481e-9602-9b380b4d6573 tempest-VolumesTransfersV355Test-890447361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a070b017-4906-4152-bddc-755e30abc7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03d1a4d2-9087-407a-b7ce-803ecda03324', 'volume_name': 'volume-03d1a4d2-9087-407a-b7ce-803ecda03324', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:37:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1c82e8aa-6d8f-481e-9602-9b380b4d6573 tempest-VolumesTransfersV355Test-890447361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83d51cd3-f9d1-4537-afb6-638c512c8f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:37:03 devstack sudo[91378]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1c82e8aa-6d8f-481e-9602-9b380b4d6573 tempest-VolumesTransfersV355Test-890447361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83d51cd3-f9d1-4537-afb6-638c512c8f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:37:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1c82e8aa-6d8f-481e-9602-9b380b4d6573 tempest-VolumesTransfersV355Test-890447361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4856c92-598c-47f6-ba7a-6b5bd8aeff42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:37:03 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-1c82e8aa-6d8f-481e-9602-9b380b4d6573 tempest-VolumesTransfersV355Test-890447361 None] Volume 03d1a4d2-9087-407a-b7ce-803ecda03324: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03d1a4d2-9087-407a-b7ce-803ecda03324', 'volume_size': 1} Jul 08 18:37:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1c82e8aa-6d8f-481e-9602-9b380b4d6573 tempest-VolumesTransfersV355Test-890447361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:37:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1c82e8aa-6d8f-481e-9602-9b380b4d6573 tempest-VolumesTransfersV355Test-890447361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:37:03 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-1c82e8aa-6d8f-481e-9602-9b380b4d6573 tempest-VolumesTransfersV355Test-890447361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-485909551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03d1a4d2-9087-407a-b7ce-803ecda03324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4be75fb5df3f461eb89060fcb595d3a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:37:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:37:03Z,use_quota=True,user_id='1e6689c1761d4fdbbbb7c98fa93846be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:37:03 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-1c82e8aa-6d8f-481e-9602-9b380b4d6573 tempest-VolumesTransfersV355Test-890447361 None] Creating volume 03d1a4d2-9087-407a-b7ce-803ecda03324 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:37:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1c82e8aa-6d8f-481e-9602-9b380b4d6573 tempest-VolumesTransfersV355Test-890447361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:37:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1c82e8aa-6d8f-481e-9602-9b380b4d6573 tempest-VolumesTransfersV355Test-890447361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:37:03 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-1c82e8aa-6d8f-481e-9602-9b380b4d6573 tempest-VolumesTransfersV355Test-890447361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:37:03 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-1c82e8aa-6d8f-481e-9602-9b380b4d6573 tempest-VolumesTransfersV355Test-890447361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:37:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1c82e8aa-6d8f-481e-9602-9b380b4d6573 tempest-VolumesTransfersV355Test-890447361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:37:03 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-1c82e8aa-6d8f-481e-9602-9b380b4d6573 tempest-VolumesTransfersV355Test-890447361 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:37:03 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-1c82e8aa-6d8f-481e-9602-9b380b4d6573 tempest-VolumesTransfersV355Test-890447361 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:37:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1c82e8aa-6d8f-481e-9602-9b380b4d6573 tempest-VolumesTransfersV355Test-890447361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-03d1a4d2-9087-407a-b7ce-803ecda03324 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:37:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-a8cec83c-5555-4788-8720-3ed84279c208 tempest-VolumesListAdminTestJSON-1382528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 2.038s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:03 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-a8cec83c-5555-4788-8720-3ed84279c208 tempest-VolumesListAdminTestJSON-1382528 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:37:03 devstack sudo[91380]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:03 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-a8cec83c-5555-4788-8720-3ed84279c208 tempest-VolumesListAdminTestJSON-1382528 None] Deleted volume successfully. Jul 08 18:37:03 devstack sudo[91391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-03d1a4d2-9087-407a-b7ce-803ecda03324 1073741824 Jul 08 18:37:03 devstack sudo[91391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:37:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-73166bd8-e51e-46a8-9dee-8fd10429bbf1 tempest-VolumesListAdminTestJSON-1166390311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 1.689s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:03 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-73166bd8-e51e-46a8-9dee-8fd10429bbf1 tempest-VolumesListAdminTestJSON-1166390311 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:37:03 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-73166bd8-e51e-46a8-9dee-8fd10429bbf1 tempest-VolumesListAdminTestJSON-1166390311 None] Deleted volume successfully. Jul 08 18:37:03 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-a8cec83c-5555-4788-8720-3ed84279c208 tempest-VolumesListAdminTestJSON-1382528 None] Lock "cinder-b218241b-2d98-4e3f-8da4-1afff29efe3a-delete_volume" released by "delete_volume" :: held 5.354s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:37:03 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-73166bd8-e51e-46a8-9dee-8fd10429bbf1 tempest-VolumesListAdminTestJSON-1166390311 None] Lock "cinder-3af157c9-b716-462d-ac3b-6bf35618abe8-delete_volume" released by "delete_volume" :: held 5.624s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:37:04 devstack sudo[91386]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-cab8950e-86ed-40cc-a086-9a3c313c921a tempest-VolumesListAdminTestJSON-1382528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8a7242e0-33ca-4156-8b80-8ab4073fe1d3" returned: 0 in 1.585s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-cab8950e-86ed-40cc-a086-9a3c313c921a tempest-VolumesListAdminTestJSON-1382528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8a7242e0-33ca-4156-8b80-8ab4073fe1d3 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:37:04 devstack sudo[91396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8a7242e0-33ca-4156-8b80-8ab4073fe1d3 Jul 08 18:37:04 devstack sudo[91396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:37:04 devstack sudo[91391]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1c82e8aa-6d8f-481e-9602-9b380b4d6573 tempest-VolumesTransfersV355Test-890447361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-03d1a4d2-9087-407a-b7ce-803ecda03324 1073741824" returned: 0 in 0.969s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1c82e8aa-6d8f-481e-9602-9b380b4d6573 tempest-VolumesTransfersV355Test-890447361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-03d1a4d2-9087-407a-b7ce-803ecda03324 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:37:04 devstack sudo[91403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-03d1a4d2-9087-407a-b7ce-803ecda03324 Jul 08 18:37:04 devstack sudo[91403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:37:05 devstack sudo[91396]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-cab8950e-86ed-40cc-a086-9a3c313c921a tempest-VolumesListAdminTestJSON-1382528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8a7242e0-33ca-4156-8b80-8ab4073fe1d3" returned: 0 in 0.777s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:05 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-cab8950e-86ed-40cc-a086-9a3c313c921a tempest-VolumesListAdminTestJSON-1382528 None] Lock "cinder-quobyte-8a7242e0-33ca-4156-8b80-8ab4073fe1d3" released by "delete_volume" :: held 2.468s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:37:05 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-cab8950e-86ed-40cc-a086-9a3c313c921a tempest-VolumesListAdminTestJSON-1382528 None] Created reservations ['0b91645f-3837-4d67-bdf8-b0f6756de239', 'e36df951-6292-4c56-a500-89349838fc76', '6f483bd1-30b6-43bc-9318-9eebb3b98776', 'f681b0ce-ab07-456e-954c-c1b1cdba12c4'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:37:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-cab8950e-86ed-40cc-a086-9a3c313c921a tempest-VolumesListAdminTestJSON-1382528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:37:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-cab8950e-86ed-40cc-a086-9a3c313c921a tempest-VolumesListAdminTestJSON-1382528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:37:05 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-cab8950e-86ed-40cc-a086-9a3c313c921a tempest-VolumesListAdminTestJSON-1382528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:37:05 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-cab8950e-86ed-40cc-a086-9a3c313c921a tempest-VolumesListAdminTestJSON-1382528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:37:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-cab8950e-86ed-40cc-a086-9a3c313c921a tempest-VolumesListAdminTestJSON-1382528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:37:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-cab8950e-86ed-40cc-a086-9a3c313c921a tempest-VolumesListAdminTestJSON-1382528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:37:05 devstack sudo[91440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:37:05 devstack sudo[91440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:37:05 devstack sudo[91403]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1c82e8aa-6d8f-481e-9602-9b380b4d6573 tempest-VolumesTransfersV355Test-890447361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-03d1a4d2-9087-407a-b7ce-803ecda03324" returned: 0 in 0.864s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:05 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-1c82e8aa-6d8f-481e-9602-9b380b4d6573 tempest-VolumesTransfersV355Test-890447361 None] <== create_volume: return (1899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:37:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1c82e8aa-6d8f-481e-9602-9b380b4d6573 tempest-VolumesTransfersV355Test-890447361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.906s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:37:05 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1c82e8aa-6d8f-481e-9602-9b380b4d6573 tempest-VolumesTransfersV355Test-890447361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4856c92-598c-47f6-ba7a-6b5bd8aeff42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03d1a4d2-9087-407a-b7ce-803ecda03324', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:37:05 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1c82e8aa-6d8f-481e-9602-9b380b4d6573 tempest-VolumesTransfersV355Test-890447361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a6f8487-5005-435a-bf62-a045d224a55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:37:05 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-1c82e8aa-6d8f-481e-9602-9b380b4d6573 tempest-VolumesTransfersV355Test-890447361 None] Volume volume-03d1a4d2-9087-407a-b7ce-803ecda03324 (03d1a4d2-9087-407a-b7ce-803ecda03324): created successfully Jul 08 18:37:05 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1c82e8aa-6d8f-481e-9602-9b380b4d6573 tempest-VolumesTransfersV355Test-890447361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a6f8487-5005-435a-bf62-a045d224a55e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:37:05 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1c82e8aa-6d8f-481e-9602-9b380b4d6573 tempest-VolumesTransfersV355Test-890447361 None] Flow 'volume_create_manager' (3a71ea48-262a-4f0e-b4e7-5650e1d10686) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:37:05 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-1c82e8aa-6d8f-481e-9602-9b380b4d6573 tempest-VolumesTransfersV355Test-890447361 None] Created volume successfully. Jul 08 18:37:05 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-aa6e3e2e-f86e-42ea-888c-9182a37aa5c0 tempest-VolumesListAdminTestJSON-1382528 None] Acquiring lock "cinder-0d00c0da-217a-44d5-af20-da58e1407df4-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:37:05 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-aa6e3e2e-f86e-42ea-888c-9182a37aa5c0 tempest-VolumesListAdminTestJSON-1382528 None] Lock "cinder-0d00c0da-217a-44d5-af20-da58e1407df4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:37:05 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-aa6e3e2e-f86e-42ea-888c-9182a37aa5c0 tempest-VolumesListAdminTestJSON-1382528 None] Acquiring lock "cinder-quobyte-0d00c0da-217a-44d5-af20-da58e1407df4" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:37:05 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-aa6e3e2e-f86e-42ea-888c-9182a37aa5c0 tempest-VolumesListAdminTestJSON-1382528 None] Lock "cinder-quobyte-0d00c0da-217a-44d5-af20-da58e1407df4" acquired by "delete_volume" :: waited 0.018s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:37:06 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23217bf-9088-4226-a9d1-cb8c68d81d3c]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:37:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-aa6e3e2e-f86e-42ea-888c-9182a37aa5c0 tempest-VolumesListAdminTestJSON-1382528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0d00c0da-217a-44d5-af20-da58e1407df4 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:37:06 devstack sudo[91440]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-cab8950e-86ed-40cc-a086-9a3c313c921a tempest-VolumesListAdminTestJSON-1382528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.813s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:06 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-cab8950e-86ed-40cc-a086-9a3c313c921a tempest-VolumesListAdminTestJSON-1382528 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:37:06 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-cab8950e-86ed-40cc-a086-9a3c313c921a tempest-VolumesListAdminTestJSON-1382528 None] Deleted volume successfully. Jul 08 18:37:06 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-cab8950e-86ed-40cc-a086-9a3c313c921a tempest-VolumesListAdminTestJSON-1382528 None] Lock "cinder-8a7242e0-33ca-4156-8b80-8ab4073fe1d3-delete_volume" released by "delete_volume" :: held 3.677s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:37:06 devstack sudo[91444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0d00c0da-217a-44d5-af20-da58e1407df4 Jul 08 18:37:06 devstack sudo[91444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:37:06 devstack sudo[91444]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-aa6e3e2e-f86e-42ea-888c-9182a37aa5c0 tempest-VolumesListAdminTestJSON-1382528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0d00c0da-217a-44d5-af20-da58e1407df4" returned: 0 in 0.847s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-aa6e3e2e-f86e-42ea-888c-9182a37aa5c0 tempest-VolumesListAdminTestJSON-1382528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0d00c0da-217a-44d5-af20-da58e1407df4 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:37:06 devstack sudo[91477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0d00c0da-217a-44d5-af20-da58e1407df4 Jul 08 18:37:06 devstack sudo[91477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:37:07 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-7086b68b-cc40-4952-b87f-b1c63915f54c tempest-VolumesTransfersV355Test-1753392688 None] Acquiring lock "cinder-03d1a4d2-9087-407a-b7ce-803ecda03324-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:37:07 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-7086b68b-cc40-4952-b87f-b1c63915f54c tempest-VolumesTransfersV355Test-1753392688 None] Lock "cinder-03d1a4d2-9087-407a-b7ce-803ecda03324-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:37:07 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-7086b68b-cc40-4952-b87f-b1c63915f54c tempest-VolumesTransfersV355Test-1753392688 None] Acquiring lock "cinder-quobyte-03d1a4d2-9087-407a-b7ce-803ecda03324" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:37:07 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-7086b68b-cc40-4952-b87f-b1c63915f54c tempest-VolumesTransfersV355Test-1753392688 None] Lock "cinder-quobyte-03d1a4d2-9087-407a-b7ce-803ecda03324" acquired by "delete_volume" :: waited 0.022s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:37:07 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d483105-757a-417e-b286-e27f99133150]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:37:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-7086b68b-cc40-4952-b87f-b1c63915f54c tempest-VolumesTransfersV355Test-1753392688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-03d1a4d2-9087-407a-b7ce-803ecda03324 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:37:07 devstack sudo[91477]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-aa6e3e2e-f86e-42ea-888c-9182a37aa5c0 tempest-VolumesListAdminTestJSON-1382528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0d00c0da-217a-44d5-af20-da58e1407df4" returned: 0 in 0.850s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:07 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-aa6e3e2e-f86e-42ea-888c-9182a37aa5c0 tempest-VolumesListAdminTestJSON-1382528 None] Lock "cinder-quobyte-0d00c0da-217a-44d5-af20-da58e1407df4" released by "delete_volume" :: held 1.751s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:37:07 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-aa6e3e2e-f86e-42ea-888c-9182a37aa5c0 tempest-VolumesListAdminTestJSON-1382528 None] Created reservations ['69ae8318-297c-439e-b63a-65404de2a4b5', '59f9ab28-58de-446a-ab65-0fb00167c4c0', '4db084d3-6bff-41f4-aa95-39d6b3fab2a4', 'a55d7545-f1d3-4cd0-b653-83784deae618'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:37:07 devstack sudo[91498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-03d1a4d2-9087-407a-b7ce-803ecda03324 Jul 08 18:37:07 devstack sudo[91498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:37:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-aa6e3e2e-f86e-42ea-888c-9182a37aa5c0 tempest-VolumesListAdminTestJSON-1382528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:37:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-aa6e3e2e-f86e-42ea-888c-9182a37aa5c0 tempest-VolumesListAdminTestJSON-1382528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:37:07 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-aa6e3e2e-f86e-42ea-888c-9182a37aa5c0 tempest-VolumesListAdminTestJSON-1382528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:37:07 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-aa6e3e2e-f86e-42ea-888c-9182a37aa5c0 tempest-VolumesListAdminTestJSON-1382528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:37:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-aa6e3e2e-f86e-42ea-888c-9182a37aa5c0 tempest-VolumesListAdminTestJSON-1382528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:37:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-aa6e3e2e-f86e-42ea-888c-9182a37aa5c0 tempest-VolumesListAdminTestJSON-1382528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:37:07 devstack sudo[91502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:37:07 devstack sudo[91502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:37:08 devstack sudo[91498]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-7086b68b-cc40-4952-b87f-b1c63915f54c tempest-VolumesTransfersV355Test-1753392688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-03d1a4d2-9087-407a-b7ce-803ecda03324" returned: 0 in 0.890s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-7086b68b-cc40-4952-b87f-b1c63915f54c tempest-VolumesTransfersV355Test-1753392688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-03d1a4d2-9087-407a-b7ce-803ecda03324 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:37:08 devstack sudo[91528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-03d1a4d2-9087-407a-b7ce-803ecda03324 Jul 08 18:37:08 devstack sudo[91528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:37:08 devstack sudo[91502]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-aa6e3e2e-f86e-42ea-888c-9182a37aa5c0 tempest-VolumesListAdminTestJSON-1382528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.856s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:08 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-aa6e3e2e-f86e-42ea-888c-9182a37aa5c0 tempest-VolumesListAdminTestJSON-1382528 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:37:08 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-aa6e3e2e-f86e-42ea-888c-9182a37aa5c0 tempest-VolumesListAdminTestJSON-1382528 None] Deleted volume successfully. Jul 08 18:37:08 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-aa6e3e2e-f86e-42ea-888c-9182a37aa5c0 tempest-VolumesListAdminTestJSON-1382528 None] Lock "cinder-0d00c0da-217a-44d5-af20-da58e1407df4-delete_volume" released by "delete_volume" :: held 2.872s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:37:09 devstack sudo[91528]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-7086b68b-cc40-4952-b87f-b1c63915f54c tempest-VolumesTransfersV355Test-1753392688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-03d1a4d2-9087-407a-b7ce-803ecda03324" returned: 0 in 0.836s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:09 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-7086b68b-cc40-4952-b87f-b1c63915f54c tempest-VolumesTransfersV355Test-1753392688 None] Lock "cinder-quobyte-03d1a4d2-9087-407a-b7ce-803ecda03324" released by "delete_volume" :: held 1.797s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:37:09 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-7086b68b-cc40-4952-b87f-b1c63915f54c tempest-VolumesTransfersV355Test-1753392688 None] Created reservations ['1c5f2590-d16b-4300-90c8-676094447df1', '42a41d5d-6488-44f7-9a6e-39eedd439e2f', '15698297-9380-472a-8909-da1da7f85b82', '8e611304-4d10-4537-a71e-c45f14e3af1a'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:37:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-7086b68b-cc40-4952-b87f-b1c63915f54c tempest-VolumesTransfersV355Test-1753392688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:37:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-7086b68b-cc40-4952-b87f-b1c63915f54c tempest-VolumesTransfersV355Test-1753392688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:37:09 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-7086b68b-cc40-4952-b87f-b1c63915f54c tempest-VolumesTransfersV355Test-1753392688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:37:09 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-7086b68b-cc40-4952-b87f-b1c63915f54c tempest-VolumesTransfersV355Test-1753392688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:37:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-7086b68b-cc40-4952-b87f-b1c63915f54c tempest-VolumesTransfersV355Test-1753392688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:37:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-7086b68b-cc40-4952-b87f-b1c63915f54c tempest-VolumesTransfersV355Test-1753392688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:37:09 devstack sudo[91534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:37:09 devstack sudo[91534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:37:10 devstack sudo[91534]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-7086b68b-cc40-4952-b87f-b1c63915f54c tempest-VolumesTransfersV355Test-1753392688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 1.119s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:10 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-7086b68b-cc40-4952-b87f-b1c63915f54c tempest-VolumesTransfersV355Test-1753392688 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:37:10 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-7086b68b-cc40-4952-b87f-b1c63915f54c tempest-VolumesTransfersV355Test-1753392688 None] Deleted volume successfully. Jul 08 18:37:10 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-7086b68b-cc40-4952-b87f-b1c63915f54c tempest-VolumesTransfersV355Test-1753392688 None] Lock "cinder-03d1a4d2-9087-407a-b7ce-803ecda03324-delete_volume" released by "delete_volume" :: held 3.220s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:37:17 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-9490182f-8006-4b4a-9c65-67195b1d7231 tempest-ServerActionsTestOtherA-1985324233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:37:17 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-9490182f-8006-4b4a-9c65-67195b1d7231 tempest-ServerActionsTestOtherA-1985324233 None] Flow 'volume_create_manager' (e311b51a-2385-4ff7-b6a6-ebe6eedb5750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:37:17 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-9490182f-8006-4b4a-9c65-67195b1d7231 tempest-ServerActionsTestOtherA-1985324233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (024d5dae-dda5-412a-a3bc-1426a40975c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:37:17 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-9490182f-8006-4b4a-9c65-67195b1d7231 tempest-ServerActionsTestOtherA-1985324233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (024d5dae-dda5-412a-a3bc-1426a40975c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:37:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1550336336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5202c4a-e705-4e51-9327-2d2a50c54237,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9df4e68e7744b379dea793292a2d095',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:37:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:37:18Z,use_quota=True,user_id='9b37fbdbdcd14173b380974e6f980407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:37:17 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-9490182f-8006-4b4a-9c65-67195b1d7231 tempest-ServerActionsTestOtherA-1985324233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f736f55-54bc-4d94-85f8-fde9c6854818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:37:17 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-9490182f-8006-4b4a-9c65-67195b1d7231 tempest-ServerActionsTestOtherA-1985324233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f736f55-54bc-4d94-85f8-fde9c6854818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:37:17 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-9490182f-8006-4b4a-9c65-67195b1d7231 tempest-ServerActionsTestOtherA-1985324233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcfb168b-390d-45ee-a952-3c7ffeb65331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:37:17 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-9490182f-8006-4b4a-9c65-67195b1d7231 tempest-ServerActionsTestOtherA-1985324233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcfb168b-390d-45ee-a952-3c7ffeb65331) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5202c4a-e705-4e51-9327-2d2a50c54237', 'volume_name': 'volume-a5202c4a-e705-4e51-9327-2d2a50c54237', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:37:17 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-9490182f-8006-4b4a-9c65-67195b1d7231 tempest-ServerActionsTestOtherA-1985324233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ce8122f-67cb-452b-874a-0c1a01eb0dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:37:17 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-9490182f-8006-4b4a-9c65-67195b1d7231 tempest-ServerActionsTestOtherA-1985324233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ce8122f-67cb-452b-874a-0c1a01eb0dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:37:17 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-9490182f-8006-4b4a-9c65-67195b1d7231 tempest-ServerActionsTestOtherA-1985324233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcaca0c3-b431-493e-9250-0452afda3129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:37:17 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-9490182f-8006-4b4a-9c65-67195b1d7231 tempest-ServerActionsTestOtherA-1985324233 None] Volume a5202c4a-e705-4e51-9327-2d2a50c54237: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5202c4a-e705-4e51-9327-2d2a50c54237', 'volume_size': 1} Jul 08 18:37:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-9490182f-8006-4b4a-9c65-67195b1d7231 tempest-ServerActionsTestOtherA-1985324233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:37:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-9490182f-8006-4b4a-9c65-67195b1d7231 tempest-ServerActionsTestOtherA-1985324233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:37:17 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-9490182f-8006-4b4a-9c65-67195b1d7231 tempest-ServerActionsTestOtherA-1985324233 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:37:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1550336336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5202c4a-e705-4e51-9327-2d2a50c54237,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9df4e68e7744b379dea793292a2d095',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:37:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:37:18Z,use_quota=True,user_id='9b37fbdbdcd14173b380974e6f980407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:37:17 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-9490182f-8006-4b4a-9c65-67195b1d7231 tempest-ServerActionsTestOtherA-1985324233 None] Creating volume a5202c4a-e705-4e51-9327-2d2a50c54237 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:37:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-9490182f-8006-4b4a-9c65-67195b1d7231 tempest-ServerActionsTestOtherA-1985324233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:37:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-9490182f-8006-4b4a-9c65-67195b1d7231 tempest-ServerActionsTestOtherA-1985324233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:37:17 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-9490182f-8006-4b4a-9c65-67195b1d7231 tempest-ServerActionsTestOtherA-1985324233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:37:17 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-9490182f-8006-4b4a-9c65-67195b1d7231 tempest-ServerActionsTestOtherA-1985324233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:37:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-9490182f-8006-4b4a-9c65-67195b1d7231 tempest-ServerActionsTestOtherA-1985324233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:37:17 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-9490182f-8006-4b4a-9c65-67195b1d7231 tempest-ServerActionsTestOtherA-1985324233 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:37:17 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-9490182f-8006-4b4a-9c65-67195b1d7231 tempest-ServerActionsTestOtherA-1985324233 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:37:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9490182f-8006-4b4a-9c65-67195b1d7231 tempest-ServerActionsTestOtherA-1985324233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-a5202c4a-e705-4e51-9327-2d2a50c54237 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:37:17 devstack sudo[91550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-a5202c4a-e705-4e51-9327-2d2a50c54237 1073741824 Jul 08 18:37:17 devstack sudo[91550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:37:19 devstack sudo[91550]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:19 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9490182f-8006-4b4a-9c65-67195b1d7231 tempest-ServerActionsTestOtherA-1985324233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-a5202c4a-e705-4e51-9327-2d2a50c54237 1073741824" returned: 0 in 1.342s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:19 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:UPDATE=98,cinder:SELECT=73,cinder:INSERT=21,cinder:DELETE=7 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:37:19 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9490182f-8006-4b4a-9c65-67195b1d7231 tempest-ServerActionsTestOtherA-1985324233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-a5202c4a-e705-4e51-9327-2d2a50c54237 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:37:19 devstack sudo[91555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-a5202c4a-e705-4e51-9327-2d2a50c54237 Jul 08 18:37:19 devstack sudo[91555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:37:19 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a2de404-1b12-4a40-8fa1-555557a00871 tempest-VolumesCloneTest-1639426647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:37:19 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3a2de404-1b12-4a40-8fa1-555557a00871 tempest-VolumesCloneTest-1639426647 None] Flow 'volume_create_manager' (16e88d6f-dc20-41a2-9889-7b6c8d0391c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:37:19 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3a2de404-1b12-4a40-8fa1-555557a00871 tempest-VolumesCloneTest-1639426647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20dfdda0-a76b-42ed-8fb9-8b129ed152e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:37:19 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3a2de404-1b12-4a40-8fa1-555557a00871 tempest-VolumesCloneTest-1639426647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20dfdda0-a76b-42ed-8fb9-8b129ed152e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:37:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1663606909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70c338c2-475e-4a3c-b3aa-227e02c2954e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d2bd29b65864e2a99a726dca796c029',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:37:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:37:19Z,use_quota=True,user_id='23f01031b48d4b978a7175774081532a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:37:19 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3a2de404-1b12-4a40-8fa1-555557a00871 tempest-VolumesCloneTest-1639426647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (861a4549-e9df-406c-a279-097529324234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:37:19 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3a2de404-1b12-4a40-8fa1-555557a00871 tempest-VolumesCloneTest-1639426647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (861a4549-e9df-406c-a279-097529324234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:37:19 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3a2de404-1b12-4a40-8fa1-555557a00871 tempest-VolumesCloneTest-1639426647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93b06181-a6b4-4cde-9e7b-f1608f18aae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:37:19 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3a2de404-1b12-4a40-8fa1-555557a00871 tempest-VolumesCloneTest-1639426647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93b06181-a6b4-4cde-9e7b-f1608f18aae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70c338c2-475e-4a3c-b3aa-227e02c2954e', 'volume_name': 'volume-70c338c2-475e-4a3c-b3aa-227e02c2954e', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:37:19 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3a2de404-1b12-4a40-8fa1-555557a00871 tempest-VolumesCloneTest-1639426647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (768d6aae-33f8-4b88-b970-91e739a1db09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:37:19 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3a2de404-1b12-4a40-8fa1-555557a00871 tempest-VolumesCloneTest-1639426647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (768d6aae-33f8-4b88-b970-91e739a1db09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:37:19 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3a2de404-1b12-4a40-8fa1-555557a00871 tempest-VolumesCloneTest-1639426647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dae26d7-1af7-4d71-9891-4b6616c80776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:37:19 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-3a2de404-1b12-4a40-8fa1-555557a00871 tempest-VolumesCloneTest-1639426647 None] Volume 70c338c2-475e-4a3c-b3aa-227e02c2954e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70c338c2-475e-4a3c-b3aa-227e02c2954e', 'volume_size': 1} Jul 08 18:37:19 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3a2de404-1b12-4a40-8fa1-555557a00871 tempest-VolumesCloneTest-1639426647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:37:20 devstack sudo[91555]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9490182f-8006-4b4a-9c65-67195b1d7231 tempest-ServerActionsTestOtherA-1985324233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-a5202c4a-e705-4e51-9327-2d2a50c54237" returned: 0 in 1.192s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:20 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-9490182f-8006-4b4a-9c65-67195b1d7231 tempest-ServerActionsTestOtherA-1985324233 None] <== create_volume: return (2638ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:37:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-9490182f-8006-4b4a-9c65-67195b1d7231 tempest-ServerActionsTestOtherA-1985324233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.652s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:37:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3a2de404-1b12-4a40-8fa1-555557a00871 tempest-VolumesCloneTest-1639426647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.896s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:37:20 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-3a2de404-1b12-4a40-8fa1-555557a00871 tempest-VolumesCloneTest-1639426647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:37:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1663606909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70c338c2-475e-4a3c-b3aa-227e02c2954e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d2bd29b65864e2a99a726dca796c029',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:37:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:37:19Z,use_quota=True,user_id='23f01031b48d4b978a7175774081532a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:37:20 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-3a2de404-1b12-4a40-8fa1-555557a00871 tempest-VolumesCloneTest-1639426647 None] Creating volume 70c338c2-475e-4a3c-b3aa-227e02c2954e {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:37:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3a2de404-1b12-4a40-8fa1-555557a00871 tempest-VolumesCloneTest-1639426647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:37:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3a2de404-1b12-4a40-8fa1-555557a00871 tempest-VolumesCloneTest-1639426647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:37:20 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-3a2de404-1b12-4a40-8fa1-555557a00871 tempest-VolumesCloneTest-1639426647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:37:20 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-3a2de404-1b12-4a40-8fa1-555557a00871 tempest-VolumesCloneTest-1639426647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:37:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3a2de404-1b12-4a40-8fa1-555557a00871 tempest-VolumesCloneTest-1639426647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:37:20 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-3a2de404-1b12-4a40-8fa1-555557a00871 tempest-VolumesCloneTest-1639426647 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:37:20 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-3a2de404-1b12-4a40-8fa1-555557a00871 tempest-VolumesCloneTest-1639426647 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:37:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3a2de404-1b12-4a40-8fa1-555557a00871 tempest-VolumesCloneTest-1639426647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-70c338c2-475e-4a3c-b3aa-227e02c2954e 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:37:20 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-9490182f-8006-4b4a-9c65-67195b1d7231 tempest-ServerActionsTestOtherA-1985324233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcaca0c3-b431-493e-9250-0452afda3129) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5202c4a-e705-4e51-9327-2d2a50c54237', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:37:20 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-9490182f-8006-4b4a-9c65-67195b1d7231 tempest-ServerActionsTestOtherA-1985324233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86985336-b255-48e4-b0ba-b74e1fbd9691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:37:20 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:UPDATE=104,cinder:DELETE=11,cinder:SELECT=58,cinder:INSERT=25 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:37:20 devstack sudo[91558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-70c338c2-475e-4a3c-b3aa-227e02c2954e 1073741824 Jul 08 18:37:20 devstack sudo[91558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:37:20 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-9490182f-8006-4b4a-9c65-67195b1d7231 tempest-ServerActionsTestOtherA-1985324233 None] Volume volume-a5202c4a-e705-4e51-9327-2d2a50c54237 (a5202c4a-e705-4e51-9327-2d2a50c54237): created successfully Jul 08 18:37:20 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-9490182f-8006-4b4a-9c65-67195b1d7231 tempest-ServerActionsTestOtherA-1985324233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86985336-b255-48e4-b0ba-b74e1fbd9691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:37:20 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-9490182f-8006-4b4a-9c65-67195b1d7231 tempest-ServerActionsTestOtherA-1985324233 None] Flow 'volume_create_manager' (e311b51a-2385-4ff7-b6a6-ebe6eedb5750) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:37:20 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-9490182f-8006-4b4a-9c65-67195b1d7231 tempest-ServerActionsTestOtherA-1985324233 None] Created volume successfully. Jul 08 18:37:21 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d8bf0a6-63d7-4d0b-afc8-fa4eb1692264 tempest-VolumesTransfersV357Test-1240360343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:37:21 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3d8bf0a6-63d7-4d0b-afc8-fa4eb1692264 tempest-VolumesTransfersV357Test-1240360343 None] Flow 'volume_create_manager' (0327624a-c558-4261-973c-e9883974e1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:37:21 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3d8bf0a6-63d7-4d0b-afc8-fa4eb1692264 tempest-VolumesTransfersV357Test-1240360343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6128f7c-b7a4-437a-91e5-6e20af9a9fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:37:21 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3d8bf0a6-63d7-4d0b-afc8-fa4eb1692264 tempest-VolumesTransfersV357Test-1240360343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6128f7c-b7a4-437a-91e5-6e20af9a9fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:37:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-676066352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e95d2e0-4542-4a0f-84bd-9d9918efa30c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='452dfdff34df4532b081c76360a1b6c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:37:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:37:21Z,use_quota=True,user_id='e97d38e3ca5d4c28b02918529c05f0d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:37:21 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3d8bf0a6-63d7-4d0b-afc8-fa4eb1692264 tempest-VolumesTransfersV357Test-1240360343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbed9db6-0c25-44af-a529-d8e24973b8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:37:21 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3d8bf0a6-63d7-4d0b-afc8-fa4eb1692264 tempest-VolumesTransfersV357Test-1240360343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbed9db6-0c25-44af-a529-d8e24973b8fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:37:21 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3d8bf0a6-63d7-4d0b-afc8-fa4eb1692264 tempest-VolumesTransfersV357Test-1240360343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (091794ff-405b-4ede-b235-d365c6282e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:37:21 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3d8bf0a6-63d7-4d0b-afc8-fa4eb1692264 tempest-VolumesTransfersV357Test-1240360343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (091794ff-405b-4ede-b235-d365c6282e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e95d2e0-4542-4a0f-84bd-9d9918efa30c', 'volume_name': 'volume-0e95d2e0-4542-4a0f-84bd-9d9918efa30c', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:37:21 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3d8bf0a6-63d7-4d0b-afc8-fa4eb1692264 tempest-VolumesTransfersV357Test-1240360343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd5bec15-2af0-457a-94d0-c4f0121d42c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:37:21 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3d8bf0a6-63d7-4d0b-afc8-fa4eb1692264 tempest-VolumesTransfersV357Test-1240360343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd5bec15-2af0-457a-94d0-c4f0121d42c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:37:21 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3d8bf0a6-63d7-4d0b-afc8-fa4eb1692264 tempest-VolumesTransfersV357Test-1240360343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed386b76-7a77-4341-95d4-11829b7e91ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:37:21 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-3d8bf0a6-63d7-4d0b-afc8-fa4eb1692264 tempest-VolumesTransfersV357Test-1240360343 None] Volume 0e95d2e0-4542-4a0f-84bd-9d9918efa30c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e95d2e0-4542-4a0f-84bd-9d9918efa30c', 'volume_size': 1} Jul 08 18:37:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3d8bf0a6-63d7-4d0b-afc8-fa4eb1692264 tempest-VolumesTransfersV357Test-1240360343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:37:21 devstack sudo[91558]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3a2de404-1b12-4a40-8fa1-555557a00871 tempest-VolumesCloneTest-1639426647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-70c338c2-475e-4a3c-b3aa-227e02c2954e 1073741824" returned: 0 in 1.164s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3a2de404-1b12-4a40-8fa1-555557a00871 tempest-VolumesCloneTest-1639426647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-70c338c2-475e-4a3c-b3aa-227e02c2954e {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:37:21 devstack sudo[91565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-70c338c2-475e-4a3c-b3aa-227e02c2954e Jul 08 18:37:21 devstack sudo[91565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:37:22 devstack sudo[91565]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3a2de404-1b12-4a40-8fa1-555557a00871 tempest-VolumesCloneTest-1639426647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-70c338c2-475e-4a3c-b3aa-227e02c2954e" returned: 0 in 0.969s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:22 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-3a2de404-1b12-4a40-8fa1-555557a00871 tempest-VolumesCloneTest-1639426647 None] <== create_volume: return (2191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:37:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3a2de404-1b12-4a40-8fa1-555557a00871 tempest-VolumesCloneTest-1639426647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.199s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:37:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3d8bf0a6-63d7-4d0b-afc8-fa4eb1692264 tempest-VolumesTransfersV357Test-1240360343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.589s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:37:22 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-3d8bf0a6-63d7-4d0b-afc8-fa4eb1692264 tempest-VolumesTransfersV357Test-1240360343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:37:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-676066352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e95d2e0-4542-4a0f-84bd-9d9918efa30c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='452dfdff34df4532b081c76360a1b6c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:37:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:37:21Z,use_quota=True,user_id='e97d38e3ca5d4c28b02918529c05f0d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:37:22 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-3d8bf0a6-63d7-4d0b-afc8-fa4eb1692264 tempest-VolumesTransfersV357Test-1240360343 None] Creating volume 0e95d2e0-4542-4a0f-84bd-9d9918efa30c {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:37:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3d8bf0a6-63d7-4d0b-afc8-fa4eb1692264 tempest-VolumesTransfersV357Test-1240360343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:37:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3d8bf0a6-63d7-4d0b-afc8-fa4eb1692264 tempest-VolumesTransfersV357Test-1240360343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:37:22 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-3d8bf0a6-63d7-4d0b-afc8-fa4eb1692264 tempest-VolumesTransfersV357Test-1240360343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:37:22 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-3d8bf0a6-63d7-4d0b-afc8-fa4eb1692264 tempest-VolumesTransfersV357Test-1240360343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:37:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3d8bf0a6-63d7-4d0b-afc8-fa4eb1692264 tempest-VolumesTransfersV357Test-1240360343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:37:22 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-3d8bf0a6-63d7-4d0b-afc8-fa4eb1692264 tempest-VolumesTransfersV357Test-1240360343 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:37:22 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-3d8bf0a6-63d7-4d0b-afc8-fa4eb1692264 tempest-VolumesTransfersV357Test-1240360343 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:37:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3d8bf0a6-63d7-4d0b-afc8-fa4eb1692264 tempest-VolumesTransfersV357Test-1240360343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0e95d2e0-4542-4a0f-84bd-9d9918efa30c 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:37:22 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3a2de404-1b12-4a40-8fa1-555557a00871 tempest-VolumesCloneTest-1639426647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dae26d7-1af7-4d71-9891-4b6616c80776) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70c338c2-475e-4a3c-b3aa-227e02c2954e', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:37:22 devstack sudo[91596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0e95d2e0-4542-4a0f-84bd-9d9918efa30c 1073741824 Jul 08 18:37:22 devstack sudo[91596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:37:22 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3a2de404-1b12-4a40-8fa1-555557a00871 tempest-VolumesCloneTest-1639426647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5033cf3-3c15-45a6-8e22-94325f586433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:37:22 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-3a2de404-1b12-4a40-8fa1-555557a00871 tempest-VolumesCloneTest-1639426647 None] Volume volume-70c338c2-475e-4a3c-b3aa-227e02c2954e (70c338c2-475e-4a3c-b3aa-227e02c2954e): created successfully Jul 08 18:37:22 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3a2de404-1b12-4a40-8fa1-555557a00871 tempest-VolumesCloneTest-1639426647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5033cf3-3c15-45a6-8e22-94325f586433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:37:22 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3a2de404-1b12-4a40-8fa1-555557a00871 tempest-VolumesCloneTest-1639426647 None] Flow 'volume_create_manager' (16e88d6f-dc20-41a2-9889-7b6c8d0391c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:37:22 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-3a2de404-1b12-4a40-8fa1-555557a00871 tempest-VolumesCloneTest-1639426647 None] Created volume successfully. Jul 08 18:37:23 devstack sudo[91596]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3d8bf0a6-63d7-4d0b-afc8-fa4eb1692264 tempest-VolumesTransfersV357Test-1240360343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0e95d2e0-4542-4a0f-84bd-9d9918efa30c 1073741824" returned: 0 in 0.892s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3d8bf0a6-63d7-4d0b-afc8-fa4eb1692264 tempest-VolumesTransfersV357Test-1240360343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0e95d2e0-4542-4a0f-84bd-9d9918efa30c {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:37:23 devstack sudo[91602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0e95d2e0-4542-4a0f-84bd-9d9918efa30c Jul 08 18:37:23 devstack sudo[91602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:37:24 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:37:24 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] Flow 'volume_create_manager' (752cc050-9520-4120-a0f5-6a3bdfa7316b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:37:24 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f4d58ff-78e4-421f-a912-41d7e5e4a5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:37:24 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f4d58ff-78e4-421f-a912-41d7e5e4a5dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-465118728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34e4e5bc-5a4c-4712-be94-0bd9a3de21a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d2bd29b65864e2a99a726dca796c029',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:37:24Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=70c338c2-475e-4a3c-b3aa-227e02c2954e,status='creating',terminated_at=None,updated_at=2026-07-08T16:37:24Z,use_quota=True,user_id='23f01031b48d4b978a7175774081532a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:37:24 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (733db70b-0bbf-4470-8aed-93600eb1f42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:37:24 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (733db70b-0bbf-4470-8aed-93600eb1f42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:37:24 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aae507bd-e35a-43bb-b7fb-833ec837c5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:37:24 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aae507bd-e35a-43bb-b7fb-833ec837c5dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '34e4e5bc-5a4c-4712-be94-0bd9a3de21a0', 'volume_name': 'volume-34e4e5bc-5a4c-4712-be94-0bd9a3de21a0', 'volume_size': 2, 'source_volid': '70c338c2-475e-4a3c-b3aa-227e02c2954e', 'source_volstatus': 'available'}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:37:24 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73bcc5e9-cb4d-47ac-ab24-a0651dc62fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:37:24 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73bcc5e9-cb4d-47ac-ab24-a0651dc62fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:37:24 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6faadf1-6070-45e7-9f68-5cb50dd30bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:37:24 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] Volume 34e4e5bc-5a4c-4712-be94-0bd9a3de21a0: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-34e4e5bc-5a4c-4712-be94-0bd9a3de21a0', 'volume_size': 2, 'source_volid': '70c338c2-475e-4a3c-b3aa-227e02c2954e', 'source_volstatus': 'available'} Jul 08 18:37:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:37:24 devstack sudo[91602]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3d8bf0a6-63d7-4d0b-afc8-fa4eb1692264 tempest-VolumesTransfersV357Test-1240360343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0e95d2e0-4542-4a0f-84bd-9d9918efa30c" returned: 0 in 0.688s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:24 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-3d8bf0a6-63d7-4d0b-afc8-fa4eb1692264 tempest-VolumesTransfersV357Test-1240360343 None] <== create_volume: return (1623ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:37:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3d8bf0a6-63d7-4d0b-afc8-fa4eb1692264 tempest-VolumesTransfersV357Test-1240360343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.626s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:37:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.131s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:37:24 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] Cloning volume 70c338c2-475e-4a3c-b3aa-227e02c2954e to volume 34e4e5bc-5a4c-4712-be94-0bd9a3de21a0 Jul 08 18:37:24 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3d8bf0a6-63d7-4d0b-afc8-fa4eb1692264 tempest-VolumesTransfersV357Test-1240360343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed386b76-7a77-4341-95d4-11829b7e91ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e95d2e0-4542-4a0f-84bd-9d9918efa30c', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:37:24 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3d8bf0a6-63d7-4d0b-afc8-fa4eb1692264 tempest-VolumesTransfersV357Test-1240360343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d780c44-5af7-417f-bf8c-50ac03031f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:37:24 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-3d8bf0a6-63d7-4d0b-afc8-fa4eb1692264 tempest-VolumesTransfersV357Test-1240360343 None] Volume volume-0e95d2e0-4542-4a0f-84bd-9d9918efa30c (0e95d2e0-4542-4a0f-84bd-9d9918efa30c): created successfully Jul 08 18:37:24 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3d8bf0a6-63d7-4d0b-afc8-fa4eb1692264 tempest-VolumesTransfersV357Test-1240360343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d780c44-5af7-417f-bf8c-50ac03031f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:37:24 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3d8bf0a6-63d7-4d0b-afc8-fa4eb1692264 tempest-VolumesTransfersV357Test-1240360343 None] Flow 'volume_create_manager' (0327624a-c558-4261-973c-e9883974e1bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:37:24 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] Creating offline snapshot c51c9e10-50e3-404e-94e7-5eb621d0e667 of volume 70c338c2-475e-4a3c-b3aa-227e02c2954e {{(pid=86873) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:37:24 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-3d8bf0a6-63d7-4d0b-afc8-fa4eb1692264 tempest-VolumesTransfersV357Test-1240360343 None] Created volume successfully. Jul 08 18:37:24 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0bcb7d-7887-472f-81a6-03f5facaec18]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:37:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-70c338c2-475e-4a3c-b3aa-227e02c2954e {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:37:24 devstack sudo[91605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-70c338c2-475e-4a3c-b3aa-227e02c2954e Jul 08 18:37:24 devstack sudo[91605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:37:25 devstack sudo[91605]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-70c338c2-475e-4a3c-b3aa-227e02c2954e" returned: 0 in 0.775s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-70c338c2-475e-4a3c-b3aa-227e02c2954e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-70c338c2-475e-4a3c-b3aa-227e02c2954e.c51c9e10-50e3-404e-94e7-5eb621d0e667 1G {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:37:25 devstack sudo[91610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-70c338c2-475e-4a3c-b3aa-227e02c2954e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-70c338c2-475e-4a3c-b3aa-227e02c2954e.c51c9e10-50e3-404e-94e7-5eb621d0e667 1G Jul 08 18:37:25 devstack sudo[91610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:37:25 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-f445fd32-b93f-4eea-a7b4-1e2809ae0d38 tempest-VolumesTransfersV357Test-698258852 None] Transfer volume completed successfully. Jul 08 18:37:26 devstack sudo[91610]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-70c338c2-475e-4a3c-b3aa-227e02c2954e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-70c338c2-475e-4a3c-b3aa-227e02c2954e.c51c9e10-50e3-404e-94e7-5eb621d0e667 1G" returned: 0 in 0.872s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70c338c2-475e-4a3c-b3aa-227e02c2954e -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-70c338c2-475e-4a3c-b3aa-227e02c2954e.c51c9e10-50e3-404e-94e7-5eb621d0e667 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:37:26 devstack sudo[91616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70c338c2-475e-4a3c-b3aa-227e02c2954e -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-70c338c2-475e-4a3c-b3aa-227e02c2954e.c51c9e10-50e3-404e-94e7-5eb621d0e667 Jul 08 18:37:26 devstack sudo[91616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:37:26 devstack sudo[91616]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70c338c2-475e-4a3c-b3aa-227e02c2954e -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-70c338c2-475e-4a3c-b3aa-227e02c2954e.c51c9e10-50e3-404e-94e7-5eb621d0e667" returned: 0 in 0.790s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:26 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-70c338c2-475e-4a3c-b3aa-227e02c2954e.c51c9e10-50e3-404e-94e7-5eb621d0e667 is being set with open permissions: ugo+rw Jul 08 18:37:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-70c338c2-475e-4a3c-b3aa-227e02c2954e.c51c9e10-50e3-404e-94e7-5eb621d0e667 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:37:26 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-1684c237-3240-4b51-9fa4-7ca347e99b4e tempest-VolumesTransfersV357Test-556688021 None] Acquiring lock "cinder-0e95d2e0-4542-4a0f-84bd-9d9918efa30c-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:37:26 devstack sudo[91622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-70c338c2-475e-4a3c-b3aa-227e02c2954e.c51c9e10-50e3-404e-94e7-5eb621d0e667 Jul 08 18:37:26 devstack sudo[91622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:37:26 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-1684c237-3240-4b51-9fa4-7ca347e99b4e tempest-VolumesTransfersV357Test-556688021 None] Lock "cinder-0e95d2e0-4542-4a0f-84bd-9d9918efa30c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:37:27 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-1684c237-3240-4b51-9fa4-7ca347e99b4e tempest-VolumesTransfersV357Test-556688021 None] Acquiring lock "cinder-quobyte-0e95d2e0-4542-4a0f-84bd-9d9918efa30c" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:37:27 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-1684c237-3240-4b51-9fa4-7ca347e99b4e tempest-VolumesTransfersV357Test-556688021 None] Lock "cinder-quobyte-0e95d2e0-4542-4a0f-84bd-9d9918efa30c" acquired by "delete_volume" :: waited 0.017s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:37:27 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fea047e-3146-4012-b5a2-28cacd33bc28]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:37:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1684c237-3240-4b51-9fa4-7ca347e99b4e tempest-VolumesTransfersV357Test-556688021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0e95d2e0-4542-4a0f-84bd-9d9918efa30c {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:37:27 devstack sudo[91624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0e95d2e0-4542-4a0f-84bd-9d9918efa30c Jul 08 18:37:27 devstack sudo[91624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:37:27 devstack sudo[91622]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-70c338c2-475e-4a3c-b3aa-227e02c2954e.c51c9e10-50e3-404e-94e7-5eb621d0e667" returned: 0 in 0.823s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-70c338c2-475e-4a3c-b3aa-227e02c2954e.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:37:27 devstack sudo[91627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-70c338c2-475e-4a3c-b3aa-227e02c2954e.info Jul 08 18:37:27 devstack sudo[91627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:37:28 devstack sudo[91624]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1684c237-3240-4b51-9fa4-7ca347e99b4e tempest-VolumesTransfersV357Test-556688021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0e95d2e0-4542-4a0f-84bd-9d9918efa30c" returned: 0 in 0.973s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1684c237-3240-4b51-9fa4-7ca347e99b4e tempest-VolumesTransfersV357Test-556688021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0e95d2e0-4542-4a0f-84bd-9d9918efa30c {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:37:28 devstack sudo[91632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0e95d2e0-4542-4a0f-84bd-9d9918efa30c Jul 08 18:37:28 devstack sudo[91632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:37:28 devstack sudo[91627]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-70c338c2-475e-4a3c-b3aa-227e02c2954e.info" returned: 0 in 1.056s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:28 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-70c338c2-475e-4a3c-b3aa-227e02c2954e.info is being set with open permissions: ugo+rw Jul 08 18:37:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-70c338c2-475e-4a3c-b3aa-227e02c2954e.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:37:28 devstack sudo[91637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-70c338c2-475e-4a3c-b3aa-227e02c2954e.info Jul 08 18:37:28 devstack sudo[91637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:37:28 devstack sudo[91632]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1684c237-3240-4b51-9fa4-7ca347e99b4e tempest-VolumesTransfersV357Test-556688021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0e95d2e0-4542-4a0f-84bd-9d9918efa30c" returned: 0 in 0.881s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:28 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-1684c237-3240-4b51-9fa4-7ca347e99b4e tempest-VolumesTransfersV357Test-556688021 None] Lock "cinder-quobyte-0e95d2e0-4542-4a0f-84bd-9d9918efa30c" released by "delete_volume" :: held 1.897s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:37:29 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-1684c237-3240-4b51-9fa4-7ca347e99b4e tempest-VolumesTransfersV357Test-556688021 None] Created reservations ['a410adb1-4fcb-4b66-8246-15d3f178e1d3', '1e4acde3-b87c-40dd-ab3a-949b16590f4c', 'b64945e8-2f1d-45e9-8500-8848d4528041', 'ac68c5a6-06ce-48c9-8998-2338c0b5f88d'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:37:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1684c237-3240-4b51-9fa4-7ca347e99b4e tempest-VolumesTransfersV357Test-556688021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:37:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1684c237-3240-4b51-9fa4-7ca347e99b4e tempest-VolumesTransfersV357Test-556688021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:37:29 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-1684c237-3240-4b51-9fa4-7ca347e99b4e tempest-VolumesTransfersV357Test-556688021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:37:29 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-1684c237-3240-4b51-9fa4-7ca347e99b4e tempest-VolumesTransfersV357Test-556688021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:37:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1684c237-3240-4b51-9fa4-7ca347e99b4e tempest-VolumesTransfersV357Test-556688021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:37:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1684c237-3240-4b51-9fa4-7ca347e99b4e tempest-VolumesTransfersV357Test-556688021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:37:29 devstack sudo[91642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:37:29 devstack sudo[91642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:37:30 devstack sudo[91637]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-70c338c2-475e-4a3c-b3aa-227e02c2954e.info" returned: 0 in 1.176s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:30 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] Acquiring lock "cinder-quobyte-34e4e5bc-5a4c-4712-be94-0bd9a3de21a0" by "_copy_volume_from_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:37:30 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] Lock "cinder-quobyte-34e4e5bc-5a4c-4712-be94-0bd9a3de21a0" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:37:30 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] snapshot: c51c9e10-50e3-404e-94e7-5eb621d0e667, volume: 34e4e5bc-5a4c-4712-be94-0bd9a3de21a0, {{(pid=86873) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 18:37:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:37:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:37:30 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:37:30 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:37:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:37:30 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c68dc1-b996-43fe-9930-02f43a95f4a6]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:37:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-70c338c2-475e-4a3c-b3aa-227e02c2954e.c51c9e10-50e3-404e-94e7-5eb621d0e667 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:37:30 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd9ecbce-364c-495f-800d-e3047e864397 tempest-VolumesTransfersV357Test-1240360343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:37:30 devstack sudo[91642]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:30 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-dd9ecbce-364c-495f-800d-e3047e864397 tempest-VolumesTransfersV357Test-1240360343 None] Flow 'volume_create_manager' (7141d3ec-9193-4755-96c9-5d6fff2695c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:37:30 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-dd9ecbce-364c-495f-800d-e3047e864397 tempest-VolumesTransfersV357Test-1240360343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (740c7444-351a-4571-8e8f-1b1f858cc0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:37:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1684c237-3240-4b51-9fa4-7ca347e99b4e tempest-VolumesTransfersV357Test-556688021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 1.093s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:30 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-1684c237-3240-4b51-9fa4-7ca347e99b4e tempest-VolumesTransfersV357Test-556688021 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:37:30 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-dd9ecbce-364c-495f-800d-e3047e864397 tempest-VolumesTransfersV357Test-1240360343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (740c7444-351a-4571-8e8f-1b1f858cc0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:37:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1869125621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea777581-f06b-4508-ad08-2230532340dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='452dfdff34df4532b081c76360a1b6c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:37:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:37:30Z,use_quota=True,user_id='e97d38e3ca5d4c28b02918529c05f0d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:37:30 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-dd9ecbce-364c-495f-800d-e3047e864397 tempest-VolumesTransfersV357Test-1240360343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36068f96-95c5-45c4-8701-0ca5bc105268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:37:30 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-dd9ecbce-364c-495f-800d-e3047e864397 tempest-VolumesTransfersV357Test-1240360343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36068f96-95c5-45c4-8701-0ca5bc105268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:37:30 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-dd9ecbce-364c-495f-800d-e3047e864397 tempest-VolumesTransfersV357Test-1240360343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e5eb77a-5fef-459f-bfea-3267c7b84a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:37:30 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-dd9ecbce-364c-495f-800d-e3047e864397 tempest-VolumesTransfersV357Test-1240360343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e5eb77a-5fef-459f-bfea-3267c7b84a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea777581-f06b-4508-ad08-2230532340dc', 'volume_name': 'volume-ea777581-f06b-4508-ad08-2230532340dc', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:37:30 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-dd9ecbce-364c-495f-800d-e3047e864397 tempest-VolumesTransfersV357Test-1240360343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c7c0928-6172-4f15-90c1-cce9a87e1f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:37:30 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-dd9ecbce-364c-495f-800d-e3047e864397 tempest-VolumesTransfersV357Test-1240360343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c7c0928-6172-4f15-90c1-cce9a87e1f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:37:30 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-dd9ecbce-364c-495f-800d-e3047e864397 tempest-VolumesTransfersV357Test-1240360343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95cb1fd1-9d9a-4ac1-a268-f9fb1f5f7d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:37:30 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-dd9ecbce-364c-495f-800d-e3047e864397 tempest-VolumesTransfersV357Test-1240360343 None] Volume ea777581-f06b-4508-ad08-2230532340dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea777581-f06b-4508-ad08-2230532340dc', 'volume_size': 1} Jul 08 18:37:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-dd9ecbce-364c-495f-800d-e3047e864397 tempest-VolumesTransfersV357Test-1240360343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:37:30 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-1684c237-3240-4b51-9fa4-7ca347e99b4e tempest-VolumesTransfersV357Test-556688021 None] Deleted volume successfully. Jul 08 18:37:30 devstack sudo[91659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-70c338c2-475e-4a3c-b3aa-227e02c2954e.c51c9e10-50e3-404e-94e7-5eb621d0e667 Jul 08 18:37:30 devstack sudo[91659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:37:30 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-1684c237-3240-4b51-9fa4-7ca347e99b4e tempest-VolumesTransfersV357Test-556688021 None] Lock "cinder-0e95d2e0-4542-4a0f-84bd-9d9918efa30c-delete_volume" released by "delete_volume" :: held 3.329s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:37:30 devstack sudo[91659]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-70c338c2-475e-4a3c-b3aa-227e02c2954e.c51c9e10-50e3-404e-94e7-5eb621d0e667" returned: 0 in 0.880s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:31 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70c338c2-475e-4a3c-b3aa-227e02c2954e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:37:31 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-70c338c2-475e-4a3c-b3aa-227e02c2954e {{(pid=86873) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 18:37:31 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] Creating direct copy from snapshot {{(pid=86873) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 18:37:31 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f13f203-5dad-4e43-8f71-49cdf0794c33]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:37:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-70c338c2-475e-4a3c-b3aa-227e02c2954e {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:37:31 devstack sudo[91664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-70c338c2-475e-4a3c-b3aa-227e02c2954e Jul 08 18:37:31 devstack sudo[91664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:37:31 devstack sudo[91664]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-70c338c2-475e-4a3c-b3aa-227e02c2954e" returned: 0 in 0.834s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:31 devstack cinder-volume[86873]: DEBUG cinder.utils [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] Path /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-34e4e5bc-5a4c-4712-be94-0bd9a3de21a0 not found in is_blk_device check {{(pid=86873) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 18:37:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-70c338c2-475e-4a3c-b3aa-227e02c2954e /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-34e4e5bc-5a4c-4712-be94-0bd9a3de21a0 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:37:31 devstack sudo[91670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-70c338c2-475e-4a3c-b3aa-227e02c2954e /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-34e4e5bc-5a4c-4712-be94-0bd9a3de21a0 Jul 08 18:37:31 devstack sudo[91670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:37:36 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-e36cf57e-c54e-4663-b48f-88acb599ae65 tempest-AttachVolumeNegativeTest-1161175669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:37:36 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e36cf57e-c54e-4663-b48f-88acb599ae65 tempest-AttachVolumeNegativeTest-1161175669 None] Flow 'volume_create_manager' (838950fa-8ffa-4b9b-88ed-9002a9720b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:37:36 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e36cf57e-c54e-4663-b48f-88acb599ae65 tempest-AttachVolumeNegativeTest-1161175669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a47685b7-cbcb-4be9-8b03-4fd1ad483156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:37:36 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e36cf57e-c54e-4663-b48f-88acb599ae65 tempest-AttachVolumeNegativeTest-1161175669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a47685b7-cbcb-4be9-8b03-4fd1ad483156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1436068065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e7d819f-f030-4ae1-87e0-2be22e91a9a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='035c4dfd607044478d3458ed4f58e3a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:37:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:37:36Z,use_quota=True,user_id='543e2e6506b348a1a7caf34ac9ee1346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:37:36 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e36cf57e-c54e-4663-b48f-88acb599ae65 tempest-AttachVolumeNegativeTest-1161175669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e01d5bf-3655-4fb4-a882-d7656c6944e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:37:36 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e36cf57e-c54e-4663-b48f-88acb599ae65 tempest-AttachVolumeNegativeTest-1161175669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e01d5bf-3655-4fb4-a882-d7656c6944e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:37:36 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e36cf57e-c54e-4663-b48f-88acb599ae65 tempest-AttachVolumeNegativeTest-1161175669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd66a861-4212-45fa-bcf1-f9f26554f697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:37:36 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e36cf57e-c54e-4663-b48f-88acb599ae65 tempest-AttachVolumeNegativeTest-1161175669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd66a861-4212-45fa-bcf1-f9f26554f697) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e7d819f-f030-4ae1-87e0-2be22e91a9a4', 'volume_name': 'volume-2e7d819f-f030-4ae1-87e0-2be22e91a9a4', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:37:36 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e36cf57e-c54e-4663-b48f-88acb599ae65 tempest-AttachVolumeNegativeTest-1161175669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdb902bc-6823-4351-902c-73b4b690aa85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:37:36 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e36cf57e-c54e-4663-b48f-88acb599ae65 tempest-AttachVolumeNegativeTest-1161175669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdb902bc-6823-4351-902c-73b4b690aa85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:37:36 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e36cf57e-c54e-4663-b48f-88acb599ae65 tempest-AttachVolumeNegativeTest-1161175669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da770fa1-7efb-4898-acb4-a9a2420a4883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:37:36 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-e36cf57e-c54e-4663-b48f-88acb599ae65 tempest-AttachVolumeNegativeTest-1161175669 None] Volume 2e7d819f-f030-4ae1-87e0-2be22e91a9a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e7d819f-f030-4ae1-87e0-2be22e91a9a4', 'volume_size': 1} Jul 08 18:37:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-e36cf57e-c54e-4663-b48f-88acb599ae65 tempest-AttachVolumeNegativeTest-1161175669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:37:38 devstack sudo[91670]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:38 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-70c338c2-475e-4a3c-b3aa-227e02c2954e /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-34e4e5bc-5a4c-4712-be94-0bd9a3de21a0" returned: 0 in 6.897s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:38 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9a7253-4573-48f4-815b-8b869a406cf1]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:37:38 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-70c338c2-475e-4a3c-b3aa-227e02c2954e {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:37:38 devstack sudo[91742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-70c338c2-475e-4a3c-b3aa-227e02c2954e Jul 08 18:37:38 devstack sudo[91742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:37:39 devstack sudo[91742]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:39 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-70c338c2-475e-4a3c-b3aa-227e02c2954e" returned: 0 in 1.065s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:39 devstack cinder-volume[86873]: DEBUG cinder.image.image_utils [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] Image conversion details: src /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-70c338c2-475e-4a3c-b3aa-227e02c2954e, size 1024.00 MB, duration 6.90 sec, destination /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-34e4e5bc-5a4c-4712-be94-0bd9a3de21a0 {{(pid=86873) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:37:39 devstack cinder-volume[86873]: INFO cinder.image.image_utils [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] Converted 1024.00 MB image at 148.45 MB/s Jul 08 18:37:39 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-34e4e5bc-5a4c-4712-be94-0bd9a3de21a0 is being set with open permissions: ugo+rw Jul 08 18:37:39 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-34e4e5bc-5a4c-4712-be94-0bd9a3de21a0 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:37:39 devstack sudo[91748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-34e4e5bc-5a4c-4712-be94-0bd9a3de21a0 Jul 08 18:37:39 devstack sudo[91748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:37:40 devstack sudo[91748]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-34e4e5bc-5a4c-4712-be94-0bd9a3de21a0" returned: 0 in 0.881s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:40 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] Lock "cinder-quobyte-34e4e5bc-5a4c-4712-be94-0bd9a3de21a0" released by "_copy_volume_from_snapshot" :: held 10.666s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:37:40 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] Acquiring lock "cinder-quobyte-c51c9e10-50e3-404e-94e7-5eb621d0e667" by "_delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:37:40 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] Lock "cinder-quobyte-c51c9e10-50e3-404e-94e7-5eb621d0e667" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:37:40 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] Deleting offline snapshot c51c9e10-50e3-404e-94e7-5eb621d0e667 of volume 70c338c2-475e-4a3c-b3aa-227e02c2954e {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:37:40 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] snapshot_file for this snap is: volume-70c338c2-475e-4a3c-b3aa-227e02c2954e.c51c9e10-50e3-404e-94e7-5eb621d0e667 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:37:40 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3ed637-2090-4b0c-a6b7-47a244a6f3a5]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:37:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-70c338c2-475e-4a3c-b3aa-227e02c2954e.c51c9e10-50e3-404e-94e7-5eb621d0e667 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:37:40 devstack sudo[91752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-70c338c2-475e-4a3c-b3aa-227e02c2954e.c51c9e10-50e3-404e-94e7-5eb621d0e667 Jul 08 18:37:40 devstack sudo[91752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:37:41 devstack sudo[91752]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-70c338c2-475e-4a3c-b3aa-227e02c2954e.c51c9e10-50e3-404e-94e7-5eb621d0e667" returned: 0 in 0.779s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:41 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70c338c2-475e-4a3c-b3aa-227e02c2954e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:37:41 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[959e1ded-2d7a-486e-a787-df2a9a54ee57]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:37:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-70c338c2-475e-4a3c-b3aa-227e02c2954e {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:37:41 devstack sudo[91759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-70c338c2-475e-4a3c-b3aa-227e02c2954e Jul 08 18:37:41 devstack sudo[91759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:37:42 devstack sudo[91759]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-70c338c2-475e-4a3c-b3aa-227e02c2954e" returned: 0 in 0.776s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-70c338c2-475e-4a3c-b3aa-227e02c2954e.c51c9e10-50e3-404e-94e7-5eb621d0e667 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:37:42 devstack sudo[91764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-70c338c2-475e-4a3c-b3aa-227e02c2954e.c51c9e10-50e3-404e-94e7-5eb621d0e667 Jul 08 18:37:42 devstack sudo[91764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:37:43 devstack sudo[91764]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-70c338c2-475e-4a3c-b3aa-227e02c2954e.c51c9e10-50e3-404e-94e7-5eb621d0e667" returned: 0 in 0.728s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-70c338c2-475e-4a3c-b3aa-227e02c2954e.c51c9e10-50e3-404e-94e7-5eb621d0e667 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:37:43 devstack sudo[91769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-70c338c2-475e-4a3c-b3aa-227e02c2954e.c51c9e10-50e3-404e-94e7-5eb621d0e667 Jul 08 18:37:43 devstack sudo[91769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:37:43 devstack sudo[91769]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-70c338c2-475e-4a3c-b3aa-227e02c2954e.c51c9e10-50e3-404e-94e7-5eb621d0e667" returned: 0 in 0.667s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:43 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] Lock "cinder-quobyte-c51c9e10-50e3-404e-94e7-5eb621d0e667" released by "_delete_snapshot" :: held 3.064s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:37:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.505s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:37:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-dd9ecbce-364c-495f-800d-e3047e864397 tempest-VolumesTransfersV357Test-1240360343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.640s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:37:43 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-dd9ecbce-364c-495f-800d-e3047e864397 tempest-VolumesTransfersV357Test-1240360343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:37:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1869125621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea777581-f06b-4508-ad08-2230532340dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='452dfdff34df4532b081c76360a1b6c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:37:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:37:30Z,use_quota=True,user_id='e97d38e3ca5d4c28b02918529c05f0d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:37:43 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-dd9ecbce-364c-495f-800d-e3047e864397 tempest-VolumesTransfersV357Test-1240360343 None] Creating volume ea777581-f06b-4508-ad08-2230532340dc {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:37:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-dd9ecbce-364c-495f-800d-e3047e864397 tempest-VolumesTransfersV357Test-1240360343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:37:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-dd9ecbce-364c-495f-800d-e3047e864397 tempest-VolumesTransfersV357Test-1240360343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:37:43 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-dd9ecbce-364c-495f-800d-e3047e864397 tempest-VolumesTransfersV357Test-1240360343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:37:43 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-dd9ecbce-364c-495f-800d-e3047e864397 tempest-VolumesTransfersV357Test-1240360343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:37:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-dd9ecbce-364c-495f-800d-e3047e864397 tempest-VolumesTransfersV357Test-1240360343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:37:43 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-dd9ecbce-364c-495f-800d-e3047e864397 tempest-VolumesTransfersV357Test-1240360343 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:37:43 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-dd9ecbce-364c-495f-800d-e3047e864397 tempest-VolumesTransfersV357Test-1240360343 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:37:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dd9ecbce-364c-495f-800d-e3047e864397 tempest-VolumesTransfersV357Test-1240360343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ea777581-f06b-4508-ad08-2230532340dc 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:37:43 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6faadf1-6070-45e7-9f68-5cb50dd30bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34e4e5bc-5a4c-4712-be94-0bd9a3de21a0', 'volume_size': 2, 'source_volid': '70c338c2-475e-4a3c-b3aa-227e02c2954e', 'source_volstatus': 'available'}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:37:43 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (443f73c9-4eb0-4cd3-97e0-0e5e4c4963c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:37:43 devstack sudo[91772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ea777581-f06b-4508-ad08-2230532340dc 1073741824 Jul 08 18:37:43 devstack sudo[91772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:37:43 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] Volume volume-34e4e5bc-5a4c-4712-be94-0bd9a3de21a0 (34e4e5bc-5a4c-4712-be94-0bd9a3de21a0): created successfully Jul 08 18:37:43 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (443f73c9-4eb0-4cd3-97e0-0e5e4c4963c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:37:43 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] Flow 'volume_create_manager' (752cc050-9520-4120-a0f5-6a3bdfa7316b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:37:44 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-dd99d3b7-0344-4d14-a695-e4ad5440bf8b tempest-VolumesCloneTest-1639426647 None] Created volume successfully. Jul 08 18:37:44 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-dea3e405-e34f-4a7e-b02c-5d808cab9efd tempest-VolumesCloneTest-1639426647 None] Acquiring lock "cinder-34e4e5bc-5a4c-4712-be94-0bd9a3de21a0-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:37:44 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-dea3e405-e34f-4a7e-b02c-5d808cab9efd tempest-VolumesCloneTest-1639426647 None] Lock "cinder-34e4e5bc-5a4c-4712-be94-0bd9a3de21a0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:37:44 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-dea3e405-e34f-4a7e-b02c-5d808cab9efd tempest-VolumesCloneTest-1639426647 None] Acquiring lock "cinder-quobyte-34e4e5bc-5a4c-4712-be94-0bd9a3de21a0" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:37:44 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-dea3e405-e34f-4a7e-b02c-5d808cab9efd tempest-VolumesCloneTest-1639426647 None] Lock "cinder-quobyte-34e4e5bc-5a4c-4712-be94-0bd9a3de21a0" acquired by "delete_volume" :: waited 0.027s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:37:44 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8fa0a0c-fb93-49b4-b597-def215abb509]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:37:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dea3e405-e34f-4a7e-b02c-5d808cab9efd tempest-VolumesCloneTest-1639426647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-34e4e5bc-5a4c-4712-be94-0bd9a3de21a0 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:37:44 devstack sudo[91774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-34e4e5bc-5a4c-4712-be94-0bd9a3de21a0 Jul 08 18:37:44 devstack sudo[91774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:37:44 devstack sudo[91772]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dd9ecbce-364c-495f-800d-e3047e864397 tempest-VolumesTransfersV357Test-1240360343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ea777581-f06b-4508-ad08-2230532340dc 1073741824" returned: 0 in 0.976s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dd9ecbce-364c-495f-800d-e3047e864397 tempest-VolumesTransfersV357Test-1240360343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ea777581-f06b-4508-ad08-2230532340dc {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:37:44 devstack sudo[91780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ea777581-f06b-4508-ad08-2230532340dc Jul 08 18:37:44 devstack sudo[91780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:37:45 devstack sudo[91774]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dea3e405-e34f-4a7e-b02c-5d808cab9efd tempest-VolumesCloneTest-1639426647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-34e4e5bc-5a4c-4712-be94-0bd9a3de21a0" returned: 0 in 0.937s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dea3e405-e34f-4a7e-b02c-5d808cab9efd tempest-VolumesCloneTest-1639426647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-34e4e5bc-5a4c-4712-be94-0bd9a3de21a0 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:37:45 devstack sudo[91785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-34e4e5bc-5a4c-4712-be94-0bd9a3de21a0 Jul 08 18:37:45 devstack sudo[91785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:37:45 devstack sudo[91780]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dd9ecbce-364c-495f-800d-e3047e864397 tempest-VolumesTransfersV357Test-1240360343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ea777581-f06b-4508-ad08-2230532340dc" returned: 0 in 0.715s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:45 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-dd9ecbce-364c-495f-800d-e3047e864397 tempest-VolumesTransfersV357Test-1240360343 None] <== create_volume: return (1738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:37:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-dd9ecbce-364c-495f-800d-e3047e864397 tempest-VolumesTransfersV357Test-1240360343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.742s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:37:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-e36cf57e-c54e-4663-b48f-88acb599ae65 tempest-AttachVolumeNegativeTest-1161175669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.210s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:37:45 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-e36cf57e-c54e-4663-b48f-88acb599ae65 tempest-AttachVolumeNegativeTest-1161175669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1436068065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e7d819f-f030-4ae1-87e0-2be22e91a9a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='035c4dfd607044478d3458ed4f58e3a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:37:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:37:36Z,use_quota=True,user_id='543e2e6506b348a1a7caf34ac9ee1346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:37:45 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-e36cf57e-c54e-4663-b48f-88acb599ae65 tempest-AttachVolumeNegativeTest-1161175669 None] Creating volume 2e7d819f-f030-4ae1-87e0-2be22e91a9a4 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:37:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-e36cf57e-c54e-4663-b48f-88acb599ae65 tempest-AttachVolumeNegativeTest-1161175669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:37:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-e36cf57e-c54e-4663-b48f-88acb599ae65 tempest-AttachVolumeNegativeTest-1161175669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:37:45 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-e36cf57e-c54e-4663-b48f-88acb599ae65 tempest-AttachVolumeNegativeTest-1161175669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:37:45 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-e36cf57e-c54e-4663-b48f-88acb599ae65 tempest-AttachVolumeNegativeTest-1161175669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:37:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-e36cf57e-c54e-4663-b48f-88acb599ae65 tempest-AttachVolumeNegativeTest-1161175669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:37:45 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-e36cf57e-c54e-4663-b48f-88acb599ae65 tempest-AttachVolumeNegativeTest-1161175669 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:37:45 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-e36cf57e-c54e-4663-b48f-88acb599ae65 tempest-AttachVolumeNegativeTest-1161175669 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:37:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e36cf57e-c54e-4663-b48f-88acb599ae65 tempest-AttachVolumeNegativeTest-1161175669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2e7d819f-f030-4ae1-87e0-2be22e91a9a4 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:37:45 devstack sudo[91788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2e7d819f-f030-4ae1-87e0-2be22e91a9a4 1073741824 Jul 08 18:37:45 devstack sudo[91788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:37:45 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-dd9ecbce-364c-495f-800d-e3047e864397 tempest-VolumesTransfersV357Test-1240360343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95cb1fd1-9d9a-4ac1-a268-f9fb1f5f7d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea777581-f06b-4508-ad08-2230532340dc', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:37:45 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-dd9ecbce-364c-495f-800d-e3047e864397 tempest-VolumesTransfersV357Test-1240360343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d01f7e75-bd8a-47da-9c74-61be991c3a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:37:45 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-dd9ecbce-364c-495f-800d-e3047e864397 tempest-VolumesTransfersV357Test-1240360343 None] Volume volume-ea777581-f06b-4508-ad08-2230532340dc (ea777581-f06b-4508-ad08-2230532340dc): created successfully Jul 08 18:37:45 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-dd9ecbce-364c-495f-800d-e3047e864397 tempest-VolumesTransfersV357Test-1240360343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d01f7e75-bd8a-47da-9c74-61be991c3a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:37:45 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-dd9ecbce-364c-495f-800d-e3047e864397 tempest-VolumesTransfersV357Test-1240360343 None] Flow 'volume_create_manager' (7141d3ec-9193-4755-96c9-5d6fff2695c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:37:45 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-dd9ecbce-364c-495f-800d-e3047e864397 tempest-VolumesTransfersV357Test-1240360343 None] Created volume successfully. Jul 08 18:37:46 devstack sudo[91785]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dea3e405-e34f-4a7e-b02c-5d808cab9efd tempest-VolumesCloneTest-1639426647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-34e4e5bc-5a4c-4712-be94-0bd9a3de21a0" returned: 0 in 0.778s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:46 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-dea3e405-e34f-4a7e-b02c-5d808cab9efd tempest-VolumesCloneTest-1639426647 None] Lock "cinder-quobyte-34e4e5bc-5a4c-4712-be94-0bd9a3de21a0" released by "delete_volume" :: held 1.765s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:37:46 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-dea3e405-e34f-4a7e-b02c-5d808cab9efd tempest-VolumesCloneTest-1639426647 None] Created reservations ['752ae011-a9f1-47f5-8951-8a63a7a33441', '7ed35261-2515-4ca2-a4b1-145f08eadacf', '01d329d6-8e0c-4ded-aed3-957ec45f775e', 'b0a79561-309a-44bc-9bb5-f383b6a580ac'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:37:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-dea3e405-e34f-4a7e-b02c-5d808cab9efd tempest-VolumesCloneTest-1639426647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:37:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-dea3e405-e34f-4a7e-b02c-5d808cab9efd tempest-VolumesCloneTest-1639426647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:37:46 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-dea3e405-e34f-4a7e-b02c-5d808cab9efd tempest-VolumesCloneTest-1639426647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:37:46 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-dea3e405-e34f-4a7e-b02c-5d808cab9efd tempest-VolumesCloneTest-1639426647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:37:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-dea3e405-e34f-4a7e-b02c-5d808cab9efd tempest-VolumesCloneTest-1639426647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:37:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dea3e405-e34f-4a7e-b02c-5d808cab9efd tempest-VolumesCloneTest-1639426647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:37:46 devstack sudo[91794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:37:46 devstack sudo[91794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:37:46 devstack sudo[91788]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e36cf57e-c54e-4663-b48f-88acb599ae65 tempest-AttachVolumeNegativeTest-1161175669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2e7d819f-f030-4ae1-87e0-2be22e91a9a4 1073741824" returned: 0 in 1.033s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:46 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-835a9f12-cd0d-4841-aefe-826c3ee95f04 tempest-VolumesCloneTest-1639426647 None] Acquiring lock "cinder-70c338c2-475e-4a3c-b3aa-227e02c2954e-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:37:46 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-835a9f12-cd0d-4841-aefe-826c3ee95f04 tempest-VolumesCloneTest-1639426647 None] Lock "cinder-70c338c2-475e-4a3c-b3aa-227e02c2954e-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:37:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e36cf57e-c54e-4663-b48f-88acb599ae65 tempest-AttachVolumeNegativeTest-1161175669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2e7d819f-f030-4ae1-87e0-2be22e91a9a4 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:37:46 devstack sudo[91797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2e7d819f-f030-4ae1-87e0-2be22e91a9a4 Jul 08 18:37:46 devstack sudo[91797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:37:46 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-835a9f12-cd0d-4841-aefe-826c3ee95f04 tempest-VolumesCloneTest-1639426647 None] Acquiring lock "cinder-quobyte-70c338c2-475e-4a3c-b3aa-227e02c2954e" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:37:46 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-835a9f12-cd0d-4841-aefe-826c3ee95f04 tempest-VolumesCloneTest-1639426647 None] Lock "cinder-quobyte-70c338c2-475e-4a3c-b3aa-227e02c2954e" acquired by "delete_volume" :: waited 0.029s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:37:46 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f13ac02-f322-47bc-9d2c-4e7f8e97a036]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:37:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-835a9f12-cd0d-4841-aefe-826c3ee95f04 tempest-VolumesCloneTest-1639426647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-70c338c2-475e-4a3c-b3aa-227e02c2954e {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:37:47 devstack sudo[91799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-70c338c2-475e-4a3c-b3aa-227e02c2954e Jul 08 18:37:47 devstack sudo[91799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:37:47 devstack sudo[91794]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dea3e405-e34f-4a7e-b02c-5d808cab9efd tempest-VolumesCloneTest-1639426647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.994s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:47 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-dea3e405-e34f-4a7e-b02c-5d808cab9efd tempest-VolumesCloneTest-1639426647 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:37:47 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-dea3e405-e34f-4a7e-b02c-5d808cab9efd tempest-VolumesCloneTest-1639426647 None] Deleted volume successfully. Jul 08 18:37:47 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-dea3e405-e34f-4a7e-b02c-5d808cab9efd tempest-VolumesCloneTest-1639426647 None] Lock "cinder-34e4e5bc-5a4c-4712-be94-0bd9a3de21a0-delete_volume" released by "delete_volume" :: held 3.123s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:37:47 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-14ca24e0-96b7-4f3e-bcad-32a4e1f97ef4 tempest-VolumesTransfersV357Test-556688021 None] Acquiring lock "cinder-ea777581-f06b-4508-ad08-2230532340dc-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:37:47 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-14ca24e0-96b7-4f3e-bcad-32a4e1f97ef4 tempest-VolumesTransfersV357Test-556688021 None] Lock "cinder-ea777581-f06b-4508-ad08-2230532340dc-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:37:47 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-14ca24e0-96b7-4f3e-bcad-32a4e1f97ef4 tempest-VolumesTransfersV357Test-556688021 None] Acquiring lock "cinder-quobyte-ea777581-f06b-4508-ad08-2230532340dc" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:37:47 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-14ca24e0-96b7-4f3e-bcad-32a4e1f97ef4 tempest-VolumesTransfersV357Test-556688021 None] Lock "cinder-quobyte-ea777581-f06b-4508-ad08-2230532340dc" acquired by "delete_volume" :: waited 0.032s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:37:47 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d2af35-e8d5-4be1-bc20-be3ce408a7d8]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:37:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-14ca24e0-96b7-4f3e-bcad-32a4e1f97ef4 tempest-VolumesTransfersV357Test-556688021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ea777581-f06b-4508-ad08-2230532340dc {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:37:47 devstack sudo[91797]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e36cf57e-c54e-4663-b48f-88acb599ae65 tempest-AttachVolumeNegativeTest-1161175669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2e7d819f-f030-4ae1-87e0-2be22e91a9a4" returned: 0 in 1.039s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:47 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-e36cf57e-c54e-4663-b48f-88acb599ae65 tempest-AttachVolumeNegativeTest-1161175669 None] <== create_volume: return (2164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:37:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-e36cf57e-c54e-4663-b48f-88acb599ae65 tempest-AttachVolumeNegativeTest-1161175669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.169s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:37:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e36cf57e-c54e-4663-b48f-88acb599ae65 tempest-AttachVolumeNegativeTest-1161175669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da770fa1-7efb-4898-acb4-a9a2420a4883) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e7d819f-f030-4ae1-87e0-2be22e91a9a4', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:37:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e36cf57e-c54e-4663-b48f-88acb599ae65 tempest-AttachVolumeNegativeTest-1161175669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de62d21c-e996-4313-8d23-88d12fe7aa87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:37:47 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-e36cf57e-c54e-4663-b48f-88acb599ae65 tempest-AttachVolumeNegativeTest-1161175669 None] Volume volume-2e7d819f-f030-4ae1-87e0-2be22e91a9a4 (2e7d819f-f030-4ae1-87e0-2be22e91a9a4): created successfully Jul 08 18:37:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e36cf57e-c54e-4663-b48f-88acb599ae65 tempest-AttachVolumeNegativeTest-1161175669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de62d21c-e996-4313-8d23-88d12fe7aa87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:37:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e36cf57e-c54e-4663-b48f-88acb599ae65 tempest-AttachVolumeNegativeTest-1161175669 None] Flow 'volume_create_manager' (838950fa-8ffa-4b9b-88ed-9002a9720b3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:37:47 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-e36cf57e-c54e-4663-b48f-88acb599ae65 tempest-AttachVolumeNegativeTest-1161175669 None] Created volume successfully. Jul 08 18:37:47 devstack sudo[91803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ea777581-f06b-4508-ad08-2230532340dc Jul 08 18:37:47 devstack sudo[91803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:37:48 devstack cinder-volume[86873]: DEBUG oslo_service.periodic_task [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86873) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:37:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:37:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:37:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:37:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:37:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:37:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:37:48 devstack sudo[91809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:37:48 devstack sudo[91809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:37:48 devstack sudo[91799]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-835a9f12-cd0d-4841-aefe-826c3ee95f04 tempest-VolumesCloneTest-1639426647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-70c338c2-475e-4a3c-b3aa-227e02c2954e" returned: 0 in 1.403s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-835a9f12-cd0d-4841-aefe-826c3ee95f04 tempest-VolumesCloneTest-1639426647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-70c338c2-475e-4a3c-b3aa-227e02c2954e {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:37:48 devstack sudo[91814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-70c338c2-475e-4a3c-b3aa-227e02c2954e Jul 08 18:37:48 devstack sudo[91814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:37:48 devstack sudo[91803]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-14ca24e0-96b7-4f3e-bcad-32a4e1f97ef4 tempest-VolumesTransfersV357Test-556688021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ea777581-f06b-4508-ad08-2230532340dc" returned: 0 in 1.102s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-14ca24e0-96b7-4f3e-bcad-32a4e1f97ef4 tempest-VolumesTransfersV357Test-556688021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ea777581-f06b-4508-ad08-2230532340dc {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:37:48 devstack sudo[91822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ea777581-f06b-4508-ad08-2230532340dc Jul 08 18:37:48 devstack sudo[91822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:37:49 devstack sudo[91809]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.958s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:49 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:37:49 devstack cinder-volume[86873]: DEBUG oslo_service.periodic_task [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running periodic task VolumeManager._thread_info {{(pid=86873) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:37:49 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] thread count: 9 {{(pid=86873) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:37:49 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] thread info: [<_MainThread(MainThread, started 138577734545536)>, , , , , , , , ] {{(pid=86873) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:37:49 devstack sudo[91814]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-835a9f12-cd0d-4841-aefe-826c3ee95f04 tempest-VolumesCloneTest-1639426647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-70c338c2-475e-4a3c-b3aa-227e02c2954e" returned: 0 in 1.001s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:49 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-835a9f12-cd0d-4841-aefe-826c3ee95f04 tempest-VolumesCloneTest-1639426647 None] Lock "cinder-quobyte-70c338c2-475e-4a3c-b3aa-227e02c2954e" released by "delete_volume" :: held 2.534s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:37:49 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-835a9f12-cd0d-4841-aefe-826c3ee95f04 tempest-VolumesCloneTest-1639426647 None] Created reservations ['5fd19504-a650-41d7-93d0-d7ecca4dc06d', '890da6b8-8da5-4af2-9b2d-f7d807f3fb5f', '4a9f7fed-2f57-4a42-bb46-947a8725a135', '5111f8d5-004d-46ab-ab1a-b9bf454b1c2f'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:37:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-835a9f12-cd0d-4841-aefe-826c3ee95f04 tempest-VolumesCloneTest-1639426647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:37:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-835a9f12-cd0d-4841-aefe-826c3ee95f04 tempest-VolumesCloneTest-1639426647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:37:49 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-835a9f12-cd0d-4841-aefe-826c3ee95f04 tempest-VolumesCloneTest-1639426647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:37:49 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-835a9f12-cd0d-4841-aefe-826c3ee95f04 tempest-VolumesCloneTest-1639426647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:37:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-835a9f12-cd0d-4841-aefe-826c3ee95f04 tempest-VolumesCloneTest-1639426647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:37:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-835a9f12-cd0d-4841-aefe-826c3ee95f04 tempest-VolumesCloneTest-1639426647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:37:49 devstack sudo[91851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:37:49 devstack sudo[91851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:37:49 devstack sudo[91822]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-14ca24e0-96b7-4f3e-bcad-32a4e1f97ef4 tempest-VolumesTransfersV357Test-556688021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ea777581-f06b-4508-ad08-2230532340dc" returned: 0 in 0.832s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:49 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-14ca24e0-96b7-4f3e-bcad-32a4e1f97ef4 tempest-VolumesTransfersV357Test-556688021 None] Lock "cinder-quobyte-ea777581-f06b-4508-ad08-2230532340dc" released by "delete_volume" :: held 2.006s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:37:49 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-14ca24e0-96b7-4f3e-bcad-32a4e1f97ef4 tempest-VolumesTransfersV357Test-556688021 None] Created reservations ['7e8b15df-f8dd-406a-93ca-a4e9c9ebe58b', '0063fee8-468d-487c-9313-ea3555b8a780', 'e788bc23-2abd-4807-a433-3fa79580def7', '869e7cce-e0df-49ae-9e7d-072f67a2950c'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:37:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-14ca24e0-96b7-4f3e-bcad-32a4e1f97ef4 tempest-VolumesTransfersV357Test-556688021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:37:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-14ca24e0-96b7-4f3e-bcad-32a4e1f97ef4 tempest-VolumesTransfersV357Test-556688021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:37:49 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-14ca24e0-96b7-4f3e-bcad-32a4e1f97ef4 tempest-VolumesTransfersV357Test-556688021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:37:49 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-14ca24e0-96b7-4f3e-bcad-32a4e1f97ef4 tempest-VolumesTransfersV357Test-556688021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:37:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-14ca24e0-96b7-4f3e-bcad-32a4e1f97ef4 tempest-VolumesTransfersV357Test-556688021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:37:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-14ca24e0-96b7-4f3e-bcad-32a4e1f97ef4 tempest-VolumesTransfersV357Test-556688021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:37:49 devstack sudo[91853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:37:49 devstack sudo[91853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:37:50 devstack sudo[91851]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-835a9f12-cd0d-4841-aefe-826c3ee95f04 tempest-VolumesCloneTest-1639426647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.777s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:50 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-835a9f12-cd0d-4841-aefe-826c3ee95f04 tempest-VolumesCloneTest-1639426647 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:37:50 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-835a9f12-cd0d-4841-aefe-826c3ee95f04 tempest-VolumesCloneTest-1639426647 None] Deleted volume successfully. Jul 08 18:37:50 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-835a9f12-cd0d-4841-aefe-826c3ee95f04 tempest-VolumesCloneTest-1639426647 None] Lock "cinder-70c338c2-475e-4a3c-b3aa-227e02c2954e-delete_volume" released by "delete_volume" :: held 3.579s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:37:50 devstack sudo[91853]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-14ca24e0-96b7-4f3e-bcad-32a4e1f97ef4 tempest-VolumesTransfersV357Test-556688021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.717s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:50 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-14ca24e0-96b7-4f3e-bcad-32a4e1f97ef4 tempest-VolumesTransfersV357Test-556688021 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:37:50 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-14ca24e0-96b7-4f3e-bcad-32a4e1f97ef4 tempest-VolumesTransfersV357Test-556688021 None] Deleted volume successfully. Jul 08 18:37:50 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-14ca24e0-96b7-4f3e-bcad-32a4e1f97ef4 tempest-VolumesTransfersV357Test-556688021 None] Lock "cinder-ea777581-f06b-4508-ad08-2230532340dc-delete_volume" released by "delete_volume" :: held 2.981s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:37:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-077a4254-8b0c-4fd7-9da8-a4ae902a2b94 req-73464fe0-3a67-4818-8550-1d3aa930ca88 tempest-AttachVolumeNegativeTest-1161175669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:37:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-077a4254-8b0c-4fd7-9da8-a4ae902a2b94 req-73464fe0-3a67-4818-8550-1d3aa930ca88 tempest-AttachVolumeNegativeTest-1161175669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:37:51 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7aa1c6e-93de-4e90-b166-ebe8a2592c09]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:37:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-077a4254-8b0c-4fd7-9da8-a4ae902a2b94 req-73464fe0-3a67-4818-8550-1d3aa930ca88 tempest-AttachVolumeNegativeTest-1161175669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2e7d819f-f030-4ae1-87e0-2be22e91a9a4 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:37:52 devstack sudo[91884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2e7d819f-f030-4ae1-87e0-2be22e91a9a4 Jul 08 18:37:52 devstack sudo[91884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:37:52 devstack sudo[91884]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-077a4254-8b0c-4fd7-9da8-a4ae902a2b94 req-73464fe0-3a67-4818-8550-1d3aa930ca88 tempest-AttachVolumeNegativeTest-1161175669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2e7d819f-f030-4ae1-87e0-2be22e91a9a4" returned: 0 in 0.902s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-077a4254-8b0c-4fd7-9da8-a4ae902a2b94 req-73464fe0-3a67-4818-8550-1d3aa930ca88 tempest-AttachVolumeNegativeTest-1161175669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.935s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:37:52 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-077a4254-8b0c-4fd7-9da8-a4ae902a2b94 req-73464fe0-3a67-4818-8550-1d3aa930ca88 tempest-AttachVolumeNegativeTest-1161175669 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2', 'name': 'volume-2e7d819f-f030-4ae1-87e0-2be22e91a9a4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '74b1ca33-77fd-41c7-9cd7-422a57980c4d', 'enforce_multipath': True} {{(pid=86873) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 18:37:52 devstack cinder-volume[86873]: INFO cinder.volume.manager [req-077a4254-8b0c-4fd7-9da8-a4ae902a2b94 req-73464fe0-3a67-4818-8550-1d3aa930ca88 tempest-AttachVolumeNegativeTest-1161175669 None] attachment_update completed successfully. Jul 08 18:37:57 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-e057e947-5322-47df-b75f-88202d890d7e tempest-VolumesCloneNegativeTest-1568394144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:37:57 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e057e947-5322-47df-b75f-88202d890d7e tempest-VolumesCloneNegativeTest-1568394144 None] Flow 'volume_create_manager' (14cf8cf4-f5fb-4aa8-9cf4-b641e4010cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:37:57 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e057e947-5322-47df-b75f-88202d890d7e tempest-VolumesCloneNegativeTest-1568394144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36315e71-3e16-456d-9239-cc9ab985e3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:37:57 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e057e947-5322-47df-b75f-88202d890d7e tempest-VolumesCloneNegativeTest-1568394144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36315e71-3e16-456d-9239-cc9ab985e3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:37:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-681850242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=412cf68c-f2cc-40f4-926e-3700929c0357,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b1254143e341e49cd0c389860fc71b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:37:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:37:58Z,use_quota=True,user_id='b47b974896d94081a9dc1e3ce124b7c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:37:57 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e057e947-5322-47df-b75f-88202d890d7e tempest-VolumesCloneNegativeTest-1568394144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb4f9a0a-aa04-4cb0-b82b-f1ec3b458d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:37:57 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e057e947-5322-47df-b75f-88202d890d7e tempest-VolumesCloneNegativeTest-1568394144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb4f9a0a-aa04-4cb0-b82b-f1ec3b458d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:37:58 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e057e947-5322-47df-b75f-88202d890d7e tempest-VolumesCloneNegativeTest-1568394144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (652e7e66-4342-40c0-aa5b-cbcc965ddcdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:37:58 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e057e947-5322-47df-b75f-88202d890d7e tempest-VolumesCloneNegativeTest-1568394144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (652e7e66-4342-40c0-aa5b-cbcc965ddcdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '412cf68c-f2cc-40f4-926e-3700929c0357', 'volume_name': 'volume-412cf68c-f2cc-40f4-926e-3700929c0357', 'volume_size': 2}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:37:58 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e057e947-5322-47df-b75f-88202d890d7e tempest-VolumesCloneNegativeTest-1568394144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (733ab160-ec5f-456a-bdf2-b97af7ffeb44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:37:58 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e057e947-5322-47df-b75f-88202d890d7e tempest-VolumesCloneNegativeTest-1568394144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (733ab160-ec5f-456a-bdf2-b97af7ffeb44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:37:58 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e057e947-5322-47df-b75f-88202d890d7e tempest-VolumesCloneNegativeTest-1568394144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76cbf7a2-39bd-4a96-8b73-ef0f492bdd9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:37:58 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-e057e947-5322-47df-b75f-88202d890d7e tempest-VolumesCloneNegativeTest-1568394144 None] Volume 412cf68c-f2cc-40f4-926e-3700929c0357: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-412cf68c-f2cc-40f4-926e-3700929c0357', 'volume_size': 2} Jul 08 18:37:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-e057e947-5322-47df-b75f-88202d890d7e tempest-VolumesCloneNegativeTest-1568394144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:37:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-e057e947-5322-47df-b75f-88202d890d7e tempest-VolumesCloneNegativeTest-1568394144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:37:58 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-e057e947-5322-47df-b75f-88202d890d7e tempest-VolumesCloneNegativeTest-1568394144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:37:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-681850242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=412cf68c-f2cc-40f4-926e-3700929c0357,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b1254143e341e49cd0c389860fc71b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:37:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:37:58Z,use_quota=True,user_id='b47b974896d94081a9dc1e3ce124b7c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:37:58 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-e057e947-5322-47df-b75f-88202d890d7e tempest-VolumesCloneNegativeTest-1568394144 None] Creating volume 412cf68c-f2cc-40f4-926e-3700929c0357 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:37:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-e057e947-5322-47df-b75f-88202d890d7e tempest-VolumesCloneNegativeTest-1568394144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:37:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-e057e947-5322-47df-b75f-88202d890d7e tempest-VolumesCloneNegativeTest-1568394144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:37:58 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-e057e947-5322-47df-b75f-88202d890d7e tempest-VolumesCloneNegativeTest-1568394144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:37:58 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-e057e947-5322-47df-b75f-88202d890d7e tempest-VolumesCloneNegativeTest-1568394144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:37:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-e057e947-5322-47df-b75f-88202d890d7e tempest-VolumesCloneNegativeTest-1568394144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:37:58 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-e057e947-5322-47df-b75f-88202d890d7e tempest-VolumesCloneNegativeTest-1568394144 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:37:58 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-e057e947-5322-47df-b75f-88202d890d7e tempest-VolumesCloneNegativeTest-1568394144 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:37:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e057e947-5322-47df-b75f-88202d890d7e tempest-VolumesCloneNegativeTest-1568394144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-412cf68c-f2cc-40f4-926e-3700929c0357 2147483648 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:37:58 devstack sudo[92315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-412cf68c-f2cc-40f4-926e-3700929c0357 2147483648 Jul 08 18:37:58 devstack sudo[92315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:37:59 devstack sudo[92315]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e057e947-5322-47df-b75f-88202d890d7e tempest-VolumesCloneNegativeTest-1568394144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-412cf68c-f2cc-40f4-926e-3700929c0357 2147483648" returned: 0 in 1.034s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e057e947-5322-47df-b75f-88202d890d7e tempest-VolumesCloneNegativeTest-1568394144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-412cf68c-f2cc-40f4-926e-3700929c0357 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:37:59 devstack sudo[92321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-412cf68c-f2cc-40f4-926e-3700929c0357 Jul 08 18:37:59 devstack sudo[92321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:37:59 devstack sudo[92321]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e057e947-5322-47df-b75f-88202d890d7e tempest-VolumesCloneNegativeTest-1568394144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-412cf68c-f2cc-40f4-926e-3700929c0357" returned: 0 in 0.685s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:59 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-e057e947-5322-47df-b75f-88202d890d7e tempest-VolumesCloneNegativeTest-1568394144 None] <== create_volume: return (1781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:37:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-e057e947-5322-47df-b75f-88202d890d7e tempest-VolumesCloneNegativeTest-1568394144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.787s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:37:59 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e057e947-5322-47df-b75f-88202d890d7e tempest-VolumesCloneNegativeTest-1568394144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76cbf7a2-39bd-4a96-8b73-ef0f492bdd9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-412cf68c-f2cc-40f4-926e-3700929c0357', 'volume_size': 2}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:37:59 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e057e947-5322-47df-b75f-88202d890d7e tempest-VolumesCloneNegativeTest-1568394144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70a60650-81ed-46b9-8fc4-04cb5e3e2c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:37:59 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-e057e947-5322-47df-b75f-88202d890d7e tempest-VolumesCloneNegativeTest-1568394144 None] Volume volume-412cf68c-f2cc-40f4-926e-3700929c0357 (412cf68c-f2cc-40f4-926e-3700929c0357): created successfully Jul 08 18:37:59 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e057e947-5322-47df-b75f-88202d890d7e tempest-VolumesCloneNegativeTest-1568394144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70a60650-81ed-46b9-8fc4-04cb5e3e2c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:37:59 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e057e947-5322-47df-b75f-88202d890d7e tempest-VolumesCloneNegativeTest-1568394144 None] Flow 'volume_create_manager' (14cf8cf4-f5fb-4aa8-9cf4-b641e4010cda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:37:59 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-e057e947-5322-47df-b75f-88202d890d7e tempest-VolumesCloneNegativeTest-1568394144 None] Created volume successfully. Jul 08 18:38:00 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-5b259b37-caf0-4c45-82f7-5e8bdf247ba9 tempest-VolumesCloneNegativeTest-1568394144 None] Acquiring lock "cinder-412cf68c-f2cc-40f4-926e-3700929c0357-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:38:00 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-5b259b37-caf0-4c45-82f7-5e8bdf247ba9 tempest-VolumesCloneNegativeTest-1568394144 None] Lock "cinder-412cf68c-f2cc-40f4-926e-3700929c0357-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:38:00 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-5b259b37-caf0-4c45-82f7-5e8bdf247ba9 tempest-VolumesCloneNegativeTest-1568394144 None] Acquiring lock "cinder-quobyte-412cf68c-f2cc-40f4-926e-3700929c0357" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:38:00 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-5b259b37-caf0-4c45-82f7-5e8bdf247ba9 tempest-VolumesCloneNegativeTest-1568394144 None] Lock "cinder-quobyte-412cf68c-f2cc-40f4-926e-3700929c0357" acquired by "delete_volume" :: waited 0.022s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:38:00 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[9946eabd-cc8c-4316-9572-4ef04a00f4b1]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:38:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5b259b37-caf0-4c45-82f7-5e8bdf247ba9 tempest-VolumesCloneNegativeTest-1568394144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-412cf68c-f2cc-40f4-926e-3700929c0357 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:00 devstack sudo[92325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-412cf68c-f2cc-40f4-926e-3700929c0357 Jul 08 18:38:00 devstack sudo[92325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:01 devstack sudo[92325]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5b259b37-caf0-4c45-82f7-5e8bdf247ba9 tempest-VolumesCloneNegativeTest-1568394144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-412cf68c-f2cc-40f4-926e-3700929c0357" returned: 0 in 0.929s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5b259b37-caf0-4c45-82f7-5e8bdf247ba9 tempest-VolumesCloneNegativeTest-1568394144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-412cf68c-f2cc-40f4-926e-3700929c0357 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:01 devstack sudo[92332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-412cf68c-f2cc-40f4-926e-3700929c0357 Jul 08 18:38:01 devstack sudo[92332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:02 devstack sudo[92332]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5b259b37-caf0-4c45-82f7-5e8bdf247ba9 tempest-VolumesCloneNegativeTest-1568394144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-412cf68c-f2cc-40f4-926e-3700929c0357" returned: 0 in 0.933s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:02 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-5b259b37-caf0-4c45-82f7-5e8bdf247ba9 tempest-VolumesCloneNegativeTest-1568394144 None] Lock "cinder-quobyte-412cf68c-f2cc-40f4-926e-3700929c0357" released by "delete_volume" :: held 1.918s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:38:02 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-5b259b37-caf0-4c45-82f7-5e8bdf247ba9 tempest-VolumesCloneNegativeTest-1568394144 None] Created reservations ['2a085a26-a4a4-4854-b6b0-de8d48a2a946', '2e982368-d2c0-4058-9d58-37a12d722cb2', 'f609eee0-7468-478c-b384-8f4fe7ace1f1', '8b9b7d42-a933-4f81-91cb-e2735ad63faf'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:38:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5b259b37-caf0-4c45-82f7-5e8bdf247ba9 tempest-VolumesCloneNegativeTest-1568394144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:38:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5b259b37-caf0-4c45-82f7-5e8bdf247ba9 tempest-VolumesCloneNegativeTest-1568394144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:38:02 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-5b259b37-caf0-4c45-82f7-5e8bdf247ba9 tempest-VolumesCloneNegativeTest-1568394144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:38:02 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-5b259b37-caf0-4c45-82f7-5e8bdf247ba9 tempest-VolumesCloneNegativeTest-1568394144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:38:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5b259b37-caf0-4c45-82f7-5e8bdf247ba9 tempest-VolumesCloneNegativeTest-1568394144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:38:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5b259b37-caf0-4c45-82f7-5e8bdf247ba9 tempest-VolumesCloneNegativeTest-1568394144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:02 devstack sudo[92345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:38:02 devstack sudo[92345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:03 devstack sudo[92345]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5b259b37-caf0-4c45-82f7-5e8bdf247ba9 tempest-VolumesCloneNegativeTest-1568394144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.945s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:03 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-5b259b37-caf0-4c45-82f7-5e8bdf247ba9 tempest-VolumesCloneNegativeTest-1568394144 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:38:03 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-5b259b37-caf0-4c45-82f7-5e8bdf247ba9 tempest-VolumesCloneNegativeTest-1568394144 None] Deleted volume successfully. Jul 08 18:38:03 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-5b259b37-caf0-4c45-82f7-5e8bdf247ba9 tempest-VolumesCloneNegativeTest-1568394144 None] Lock "cinder-412cf68c-f2cc-40f4-926e-3700929c0357-delete_volume" released by "delete_volume" :: held 3.133s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:38:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-bf2c5f77-d498-4be3-8fe2-621cc8889b00 req-0c37ae3f-8706-4438-a17c-4de988ee4972 tempest-ServerActionsTestOtherA-1985324233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:38:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-bf2c5f77-d498-4be3-8fe2-621cc8889b00 req-0c37ae3f-8706-4438-a17c-4de988ee4972 tempest-ServerActionsTestOtherA-1985324233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:38:05 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0a3f43-30b3-4e36-b19b-5d3d1feed715]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:38:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-bf2c5f77-d498-4be3-8fe2-621cc8889b00 req-0c37ae3f-8706-4438-a17c-4de988ee4972 tempest-ServerActionsTestOtherA-1985324233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-a5202c4a-e705-4e51-9327-2d2a50c54237 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:05 devstack sudo[92359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-a5202c4a-e705-4e51-9327-2d2a50c54237 Jul 08 18:38:05 devstack sudo[92359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:06 devstack sudo[92359]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-bf2c5f77-d498-4be3-8fe2-621cc8889b00 req-0c37ae3f-8706-4438-a17c-4de988ee4972 tempest-ServerActionsTestOtherA-1985324233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-a5202c4a-e705-4e51-9327-2d2a50c54237" returned: 0 in 1.199s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-bf2c5f77-d498-4be3-8fe2-621cc8889b00 req-0c37ae3f-8706-4438-a17c-4de988ee4972 tempest-ServerActionsTestOtherA-1985324233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.227s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:38:06 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-bf2c5f77-d498-4be3-8fe2-621cc8889b00 req-0c37ae3f-8706-4438-a17c-4de988ee4972 tempest-ServerActionsTestOtherA-1985324233 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2', 'name': 'volume-a5202c4a-e705-4e51-9327-2d2a50c54237', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '11cf21ea-3ae6-431c-9907-79daae7c4412', 'enforce_multipath': True} {{(pid=86873) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 18:38:06 devstack cinder-volume[86873]: INFO cinder.volume.manager [req-bf2c5f77-d498-4be3-8fe2-621cc8889b00 req-0c37ae3f-8706-4438-a17c-4de988ee4972 tempest-ServerActionsTestOtherA-1985324233 None] attachment_update completed successfully. Jul 08 18:38:07 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-936c00ef-3e32-43e9-9626-4d75880eb93e tempest-VolumesListTestJSON-767900108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:38:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-936c00ef-3e32-43e9-9626-4d75880eb93e tempest-VolumesListTestJSON-767900108 None] Flow 'volume_create_manager' (1caf7df9-351f-4209-b6ef-e3f33204716f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:38:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-936c00ef-3e32-43e9-9626-4d75880eb93e tempest-VolumesListTestJSON-767900108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e280e311-34f4-4d15-ba34-44827fb4ef62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:38:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-936c00ef-3e32-43e9-9626-4d75880eb93e tempest-VolumesListTestJSON-767900108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e280e311-34f4-4d15-ba34-44827fb4ef62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1807786912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dbea0e6-c5c1-4039-95a9-74851bdb6090,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e9ce1afea77d4bddb4a2f1fe9744d6e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:38:07Z,use_quota=True,user_id='c118c28fc2d642cd8bcea6718376ad39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:38:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-936c00ef-3e32-43e9-9626-4d75880eb93e tempest-VolumesListTestJSON-767900108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fe00d61-d280-4cbc-bce9-febc8ece1fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:38:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-936c00ef-3e32-43e9-9626-4d75880eb93e tempest-VolumesListTestJSON-767900108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fe00d61-d280-4cbc-bce9-febc8ece1fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:38:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-936c00ef-3e32-43e9-9626-4d75880eb93e tempest-VolumesListTestJSON-767900108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4d772b8-8fac-42b4-9450-f0b4b6ed960c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:38:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-936c00ef-3e32-43e9-9626-4d75880eb93e tempest-VolumesListTestJSON-767900108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4d772b8-8fac-42b4-9450-f0b4b6ed960c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dbea0e6-c5c1-4039-95a9-74851bdb6090', 'volume_name': 'volume-3dbea0e6-c5c1-4039-95a9-74851bdb6090', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:38:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-936c00ef-3e32-43e9-9626-4d75880eb93e tempest-VolumesListTestJSON-767900108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6071a339-37fa-4dee-a3a3-05b8f33ef44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:38:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-936c00ef-3e32-43e9-9626-4d75880eb93e tempest-VolumesListTestJSON-767900108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6071a339-37fa-4dee-a3a3-05b8f33ef44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:38:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-936c00ef-3e32-43e9-9626-4d75880eb93e tempest-VolumesListTestJSON-767900108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1da17238-48b0-45e5-a812-a382d599c452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:38:07 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-936c00ef-3e32-43e9-9626-4d75880eb93e tempest-VolumesListTestJSON-767900108 None] Volume 3dbea0e6-c5c1-4039-95a9-74851bdb6090: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dbea0e6-c5c1-4039-95a9-74851bdb6090', 'volume_size': 1} Jul 08 18:38:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-936c00ef-3e32-43e9-9626-4d75880eb93e tempest-VolumesListTestJSON-767900108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:38:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-936c00ef-3e32-43e9-9626-4d75880eb93e tempest-VolumesListTestJSON-767900108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:38:07 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-936c00ef-3e32-43e9-9626-4d75880eb93e tempest-VolumesListTestJSON-767900108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1807786912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dbea0e6-c5c1-4039-95a9-74851bdb6090,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e9ce1afea77d4bddb4a2f1fe9744d6e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:38:07Z,use_quota=True,user_id='c118c28fc2d642cd8bcea6718376ad39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:38:07 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-936c00ef-3e32-43e9-9626-4d75880eb93e tempest-VolumesListTestJSON-767900108 None] Creating volume 3dbea0e6-c5c1-4039-95a9-74851bdb6090 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:38:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-936c00ef-3e32-43e9-9626-4d75880eb93e tempest-VolumesListTestJSON-767900108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:38:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-936c00ef-3e32-43e9-9626-4d75880eb93e tempest-VolumesListTestJSON-767900108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:38:07 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-936c00ef-3e32-43e9-9626-4d75880eb93e tempest-VolumesListTestJSON-767900108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:38:07 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-936c00ef-3e32-43e9-9626-4d75880eb93e tempest-VolumesListTestJSON-767900108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:38:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-936c00ef-3e32-43e9-9626-4d75880eb93e tempest-VolumesListTestJSON-767900108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:38:07 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-936c00ef-3e32-43e9-9626-4d75880eb93e tempest-VolumesListTestJSON-767900108 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:38:07 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-936c00ef-3e32-43e9-9626-4d75880eb93e tempest-VolumesListTestJSON-767900108 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:38:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-936c00ef-3e32-43e9-9626-4d75880eb93e tempest-VolumesListTestJSON-767900108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3dbea0e6-c5c1-4039-95a9-74851bdb6090 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:07 devstack sudo[92366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3dbea0e6-c5c1-4039-95a9-74851bdb6090 1073741824 Jul 08 18:38:07 devstack sudo[92366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:08 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-58772779-d84b-4551-bc72-524940ea15a1 tempest-VolumesSnapshotTestJSON-1399133399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:38:08 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-58772779-d84b-4551-bc72-524940ea15a1 tempest-VolumesSnapshotTestJSON-1399133399 None] Flow 'volume_create_manager' (99692623-7213-43bc-b13a-cc4a1fe1a7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:38:08 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-58772779-d84b-4551-bc72-524940ea15a1 tempest-VolumesSnapshotTestJSON-1399133399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6298ab22-e4eb-482b-b237-28f74708f48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:38:08 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-58772779-d84b-4551-bc72-524940ea15a1 tempest-VolumesSnapshotTestJSON-1399133399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6298ab22-e4eb-482b-b237-28f74708f48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:38:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-383238006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46de2cf2-f2e9-41d8-8708-feeeeaf85c67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfae85ad945e4d2585d3823b7b4ef62e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:38:08Z,use_quota=True,user_id='6a6b7648c1c2476ab78c03983697ff4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:38:08 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-58772779-d84b-4551-bc72-524940ea15a1 tempest-VolumesSnapshotTestJSON-1399133399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c8d0b67-fdac-46a6-a530-5d7c05f360d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:38:08 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-58772779-d84b-4551-bc72-524940ea15a1 tempest-VolumesSnapshotTestJSON-1399133399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c8d0b67-fdac-46a6-a530-5d7c05f360d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:38:08 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-58772779-d84b-4551-bc72-524940ea15a1 tempest-VolumesSnapshotTestJSON-1399133399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0657423a-b9a8-4fbc-bf31-eacefc358553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:38:08 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-58772779-d84b-4551-bc72-524940ea15a1 tempest-VolumesSnapshotTestJSON-1399133399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0657423a-b9a8-4fbc-bf31-eacefc358553) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46de2cf2-f2e9-41d8-8708-feeeeaf85c67', 'volume_name': 'volume-46de2cf2-f2e9-41d8-8708-feeeeaf85c67', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:38:08 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-58772779-d84b-4551-bc72-524940ea15a1 tempest-VolumesSnapshotTestJSON-1399133399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c23badf4-ddd4-47d6-84c7-36591a947dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:38:08 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-58772779-d84b-4551-bc72-524940ea15a1 tempest-VolumesSnapshotTestJSON-1399133399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c23badf4-ddd4-47d6-84c7-36591a947dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:38:08 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-58772779-d84b-4551-bc72-524940ea15a1 tempest-VolumesSnapshotTestJSON-1399133399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f0e1a00-dd8a-4481-b520-1e01a220e818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:38:08 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-58772779-d84b-4551-bc72-524940ea15a1 tempest-VolumesSnapshotTestJSON-1399133399 None] Volume 46de2cf2-f2e9-41d8-8708-feeeeaf85c67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46de2cf2-f2e9-41d8-8708-feeeeaf85c67', 'volume_size': 1} Jul 08 18:38:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-58772779-d84b-4551-bc72-524940ea15a1 tempest-VolumesSnapshotTestJSON-1399133399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:38:08 devstack sudo[92366]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-936c00ef-3e32-43e9-9626-4d75880eb93e tempest-VolumesListTestJSON-767900108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3dbea0e6-c5c1-4039-95a9-74851bdb6090 1073741824" returned: 0 in 1.094s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-936c00ef-3e32-43e9-9626-4d75880eb93e tempest-VolumesListTestJSON-767900108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3dbea0e6-c5c1-4039-95a9-74851bdb6090 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:08 devstack sudo[92373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3dbea0e6-c5c1-4039-95a9-74851bdb6090 Jul 08 18:38:08 devstack sudo[92373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:09 devstack sudo[92373]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-936c00ef-3e32-43e9-9626-4d75880eb93e tempest-VolumesListTestJSON-767900108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3dbea0e6-c5c1-4039-95a9-74851bdb6090" returned: 0 in 0.693s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:09 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-936c00ef-3e32-43e9-9626-4d75880eb93e tempest-VolumesListTestJSON-767900108 None] <== create_volume: return (1836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:38:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-936c00ef-3e32-43e9-9626-4d75880eb93e tempest-VolumesListTestJSON-767900108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.838s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:38:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-58772779-d84b-4551-bc72-524940ea15a1 tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.751s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:38:09 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-58772779-d84b-4551-bc72-524940ea15a1 tempest-VolumesSnapshotTestJSON-1399133399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:38:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-383238006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46de2cf2-f2e9-41d8-8708-feeeeaf85c67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfae85ad945e4d2585d3823b7b4ef62e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:38:08Z,use_quota=True,user_id='6a6b7648c1c2476ab78c03983697ff4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:38:09 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-58772779-d84b-4551-bc72-524940ea15a1 tempest-VolumesSnapshotTestJSON-1399133399 None] Creating volume 46de2cf2-f2e9-41d8-8708-feeeeaf85c67 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:38:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-58772779-d84b-4551-bc72-524940ea15a1 tempest-VolumesSnapshotTestJSON-1399133399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:38:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-58772779-d84b-4551-bc72-524940ea15a1 tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:38:09 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-58772779-d84b-4551-bc72-524940ea15a1 tempest-VolumesSnapshotTestJSON-1399133399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:38:09 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-58772779-d84b-4551-bc72-524940ea15a1 tempest-VolumesSnapshotTestJSON-1399133399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:38:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-58772779-d84b-4551-bc72-524940ea15a1 tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:38:09 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-58772779-d84b-4551-bc72-524940ea15a1 tempest-VolumesSnapshotTestJSON-1399133399 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:38:09 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-58772779-d84b-4551-bc72-524940ea15a1 tempest-VolumesSnapshotTestJSON-1399133399 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:38:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-58772779-d84b-4551-bc72-524940ea15a1 tempest-VolumesSnapshotTestJSON-1399133399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-46de2cf2-f2e9-41d8-8708-feeeeaf85c67 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:09 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-936c00ef-3e32-43e9-9626-4d75880eb93e tempest-VolumesListTestJSON-767900108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1da17238-48b0-45e5-a812-a382d599c452) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dbea0e6-c5c1-4039-95a9-74851bdb6090', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:38:09 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-936c00ef-3e32-43e9-9626-4d75880eb93e tempest-VolumesListTestJSON-767900108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee311280-4885-47bf-8e17-35325b7985a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:38:09 devstack sudo[92376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-46de2cf2-f2e9-41d8-8708-feeeeaf85c67 1073741824 Jul 08 18:38:09 devstack sudo[92376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:09 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-936c00ef-3e32-43e9-9626-4d75880eb93e tempest-VolumesListTestJSON-767900108 None] Volume volume-3dbea0e6-c5c1-4039-95a9-74851bdb6090 (3dbea0e6-c5c1-4039-95a9-74851bdb6090): created successfully Jul 08 18:38:09 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-936c00ef-3e32-43e9-9626-4d75880eb93e tempest-VolumesListTestJSON-767900108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee311280-4885-47bf-8e17-35325b7985a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:38:09 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-936c00ef-3e32-43e9-9626-4d75880eb93e tempest-VolumesListTestJSON-767900108 None] Flow 'volume_create_manager' (1caf7df9-351f-4209-b6ef-e3f33204716f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:38:09 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-936c00ef-3e32-43e9-9626-4d75880eb93e tempest-VolumesListTestJSON-767900108 None] Created volume successfully. Jul 08 18:38:10 devstack sudo[92376]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-58772779-d84b-4551-bc72-524940ea15a1 tempest-VolumesSnapshotTestJSON-1399133399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-46de2cf2-f2e9-41d8-8708-feeeeaf85c67 1073741824" returned: 0 in 1.021s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-58772779-d84b-4551-bc72-524940ea15a1 tempest-VolumesSnapshotTestJSON-1399133399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-46de2cf2-f2e9-41d8-8708-feeeeaf85c67 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:10 devstack sudo[92398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-46de2cf2-f2e9-41d8-8708-feeeeaf85c67 Jul 08 18:38:10 devstack sudo[92398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:11 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba20c308-6850-4d45-8a03-078951730837 tempest-VolumesListTestJSON-767900108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:38:11 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ba20c308-6850-4d45-8a03-078951730837 tempest-VolumesListTestJSON-767900108 None] Flow 'volume_create_manager' (f0275d51-3b29-4fb9-870d-ce7c50f4877f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:38:11 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ba20c308-6850-4d45-8a03-078951730837 tempest-VolumesListTestJSON-767900108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bd02d4b-c065-4c5e-8a6d-a8697f6eca93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:38:11 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ba20c308-6850-4d45-8a03-078951730837 tempest-VolumesListTestJSON-767900108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bd02d4b-c065-4c5e-8a6d-a8697f6eca93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:38:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-749424884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4e6a7ed-e5c1-4d7b-b9ea-e3da94ab71e8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e9ce1afea77d4bddb4a2f1fe9744d6e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:38:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:38:11Z,use_quota=True,user_id='c118c28fc2d642cd8bcea6718376ad39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:38:11 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ba20c308-6850-4d45-8a03-078951730837 tempest-VolumesListTestJSON-767900108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f5d200e-be20-400f-9508-df802b60a489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:38:11 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ba20c308-6850-4d45-8a03-078951730837 tempest-VolumesListTestJSON-767900108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f5d200e-be20-400f-9508-df802b60a489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:38:11 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ba20c308-6850-4d45-8a03-078951730837 tempest-VolumesListTestJSON-767900108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aa904ef-66d4-415d-9fdb-6a29fd3fbfb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:38:11 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ba20c308-6850-4d45-8a03-078951730837 tempest-VolumesListTestJSON-767900108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aa904ef-66d4-415d-9fdb-6a29fd3fbfb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4e6a7ed-e5c1-4d7b-b9ea-e3da94ab71e8', 'volume_name': 'volume-e4e6a7ed-e5c1-4d7b-b9ea-e3da94ab71e8', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:38:11 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ba20c308-6850-4d45-8a03-078951730837 tempest-VolumesListTestJSON-767900108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c355546-333f-4daa-b2cc-771b4f85e1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:38:11 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ba20c308-6850-4d45-8a03-078951730837 tempest-VolumesListTestJSON-767900108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c355546-333f-4daa-b2cc-771b4f85e1ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:38:11 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ba20c308-6850-4d45-8a03-078951730837 tempest-VolumesListTestJSON-767900108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f7dc388-480d-425d-b033-d0477b4b0f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:38:11 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-ba20c308-6850-4d45-8a03-078951730837 tempest-VolumesListTestJSON-767900108 None] Volume e4e6a7ed-e5c1-4d7b-b9ea-e3da94ab71e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4e6a7ed-e5c1-4d7b-b9ea-e3da94ab71e8', 'volume_size': 1} Jul 08 18:38:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-ba20c308-6850-4d45-8a03-078951730837 tempest-VolumesListTestJSON-767900108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:38:11 devstack sudo[92398]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-58772779-d84b-4551-bc72-524940ea15a1 tempest-VolumesSnapshotTestJSON-1399133399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-46de2cf2-f2e9-41d8-8708-feeeeaf85c67" returned: 0 in 0.759s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:11 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-58772779-d84b-4551-bc72-524940ea15a1 tempest-VolumesSnapshotTestJSON-1399133399 None] <== create_volume: return (1841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:38:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-58772779-d84b-4551-bc72-524940ea15a1 tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.844s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:38:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-ba20c308-6850-4d45-8a03-078951730837 tempest-VolumesListTestJSON-767900108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.016s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:38:11 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-ba20c308-6850-4d45-8a03-078951730837 tempest-VolumesListTestJSON-767900108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:38:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-749424884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4e6a7ed-e5c1-4d7b-b9ea-e3da94ab71e8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e9ce1afea77d4bddb4a2f1fe9744d6e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:38:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:38:11Z,use_quota=True,user_id='c118c28fc2d642cd8bcea6718376ad39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:38:11 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-ba20c308-6850-4d45-8a03-078951730837 tempest-VolumesListTestJSON-767900108 None] Creating volume e4e6a7ed-e5c1-4d7b-b9ea-e3da94ab71e8 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:38:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-ba20c308-6850-4d45-8a03-078951730837 tempest-VolumesListTestJSON-767900108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:38:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-ba20c308-6850-4d45-8a03-078951730837 tempest-VolumesListTestJSON-767900108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:38:11 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-ba20c308-6850-4d45-8a03-078951730837 tempest-VolumesListTestJSON-767900108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:38:11 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-ba20c308-6850-4d45-8a03-078951730837 tempest-VolumesListTestJSON-767900108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:38:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-ba20c308-6850-4d45-8a03-078951730837 tempest-VolumesListTestJSON-767900108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:38:11 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-ba20c308-6850-4d45-8a03-078951730837 tempest-VolumesListTestJSON-767900108 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:38:11 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-ba20c308-6850-4d45-8a03-078951730837 tempest-VolumesListTestJSON-767900108 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:38:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ba20c308-6850-4d45-8a03-078951730837 tempest-VolumesListTestJSON-767900108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e4e6a7ed-e5c1-4d7b-b9ea-e3da94ab71e8 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:11 devstack sudo[92402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e4e6a7ed-e5c1-4d7b-b9ea-e3da94ab71e8 1073741824 Jul 08 18:38:11 devstack sudo[92402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:11 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-58772779-d84b-4551-bc72-524940ea15a1 tempest-VolumesSnapshotTestJSON-1399133399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f0e1a00-dd8a-4481-b520-1e01a220e818) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46de2cf2-f2e9-41d8-8708-feeeeaf85c67', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:38:11 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-58772779-d84b-4551-bc72-524940ea15a1 tempest-VolumesSnapshotTestJSON-1399133399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6cff886-1469-412c-888e-209b258168b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:38:11 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-58772779-d84b-4551-bc72-524940ea15a1 tempest-VolumesSnapshotTestJSON-1399133399 None] Volume volume-46de2cf2-f2e9-41d8-8708-feeeeaf85c67 (46de2cf2-f2e9-41d8-8708-feeeeaf85c67): created successfully Jul 08 18:38:11 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-58772779-d84b-4551-bc72-524940ea15a1 tempest-VolumesSnapshotTestJSON-1399133399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6cff886-1469-412c-888e-209b258168b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:38:11 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-58772779-d84b-4551-bc72-524940ea15a1 tempest-VolumesSnapshotTestJSON-1399133399 None] Flow 'volume_create_manager' (99692623-7213-43bc-b13a-cc4a1fe1a7f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:38:11 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-58772779-d84b-4551-bc72-524940ea15a1 tempest-VolumesSnapshotTestJSON-1399133399 None] Created volume successfully. Jul 08 18:38:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-067198d8-f14f-41a6-802c-16cca601298e tempest-VolumesSnapshotTestJSON-1399133399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:38:12 devstack sudo[92402]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ba20c308-6850-4d45-8a03-078951730837 tempest-VolumesListTestJSON-767900108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e4e6a7ed-e5c1-4d7b-b9ea-e3da94ab71e8 1073741824" returned: 0 in 1.197s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ba20c308-6850-4d45-8a03-078951730837 tempest-VolumesListTestJSON-767900108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e4e6a7ed-e5c1-4d7b-b9ea-e3da94ab71e8 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:12 devstack sudo[92412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e4e6a7ed-e5c1-4d7b-b9ea-e3da94ab71e8 Jul 08 18:38:12 devstack sudo[92412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:13 devstack sudo[92412]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ba20c308-6850-4d45-8a03-078951730837 tempest-VolumesListTestJSON-767900108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e4e6a7ed-e5c1-4d7b-b9ea-e3da94ab71e8" returned: 0 in 0.721s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:13 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-ba20c308-6850-4d45-8a03-078951730837 tempest-VolumesListTestJSON-767900108 None] <== create_volume: return (1980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:38:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-ba20c308-6850-4d45-8a03-078951730837 tempest-VolumesListTestJSON-767900108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.983s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:38:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-067198d8-f14f-41a6-802c-16cca601298e tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.107s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:38:13 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ba20c308-6850-4d45-8a03-078951730837 tempest-VolumesListTestJSON-767900108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f7dc388-480d-425d-b033-d0477b4b0f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4e6a7ed-e5c1-4d7b-b9ea-e3da94ab71e8', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:38:13 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ba20c308-6850-4d45-8a03-078951730837 tempest-VolumesListTestJSON-767900108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f45ee38-ed41-4108-bb07-31042256c06f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:38:13 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-067198d8-f14f-41a6-802c-16cca601298e tempest-VolumesSnapshotTestJSON-1399133399 None] Creating offline snapshot 719f1e67-6595-4a0d-89e3-bbb10a32031e of volume 46de2cf2-f2e9-41d8-8708-feeeeaf85c67 {{(pid=86873) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:38:13 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-ba20c308-6850-4d45-8a03-078951730837 tempest-VolumesListTestJSON-767900108 None] Volume volume-e4e6a7ed-e5c1-4d7b-b9ea-e3da94ab71e8 (e4e6a7ed-e5c1-4d7b-b9ea-e3da94ab71e8): created successfully Jul 08 18:38:13 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ba20c308-6850-4d45-8a03-078951730837 tempest-VolumesListTestJSON-767900108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f45ee38-ed41-4108-bb07-31042256c06f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:38:13 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ba20c308-6850-4d45-8a03-078951730837 tempest-VolumesListTestJSON-767900108 None] Flow 'volume_create_manager' (f0275d51-3b29-4fb9-870d-ce7c50f4877f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:38:13 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc76f206-22ac-4d4d-b990-e0493ec12f47]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:38:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-067198d8-f14f-41a6-802c-16cca601298e tempest-VolumesSnapshotTestJSON-1399133399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-46de2cf2-f2e9-41d8-8708-feeeeaf85c67 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:13 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-ba20c308-6850-4d45-8a03-078951730837 tempest-VolumesListTestJSON-767900108 None] Created volume successfully. Jul 08 18:38:13 devstack sudo[92416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-46de2cf2-f2e9-41d8-8708-feeeeaf85c67 Jul 08 18:38:13 devstack sudo[92416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:14 devstack sudo[92416]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-067198d8-f14f-41a6-802c-16cca601298e tempest-VolumesSnapshotTestJSON-1399133399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-46de2cf2-f2e9-41d8-8708-feeeeaf85c67" returned: 0 in 0.967s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-067198d8-f14f-41a6-802c-16cca601298e tempest-VolumesSnapshotTestJSON-1399133399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-46de2cf2-f2e9-41d8-8708-feeeeaf85c67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-46de2cf2-f2e9-41d8-8708-feeeeaf85c67.719f1e67-6595-4a0d-89e3-bbb10a32031e 1G {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:14 devstack sudo[92468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-46de2cf2-f2e9-41d8-8708-feeeeaf85c67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-46de2cf2-f2e9-41d8-8708-feeeeaf85c67.719f1e67-6595-4a0d-89e3-bbb10a32031e 1G Jul 08 18:38:14 devstack sudo[92468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:14 devstack cinder-volume[86873]: INFO cinder.volume.manager [req-39c95147-2916-4b4f-a53b-b6ced9d2eaf0 req-393275c7-25e6-4fe2-8966-b9835b22a77b tempest-ServerActionsTestOtherA-1985324233 None] Terminate volume connection completed successfully. Jul 08 18:38:14 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-39c95147-2916-4b4f-a53b-b6ced9d2eaf0 req-393275c7-25e6-4fe2-8966-b9835b22a77b tempest-ServerActionsTestOtherA-1985324233 None] Deleting attachment 11cf21ea-3ae6-431c-9907-79daae7c4412. {{(pid=86873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 18:38:14 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-faaeab7d-96c2-4c33-afed-c5a59491500b tempest-VolumesListTestJSON-767900108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:38:14 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-faaeab7d-96c2-4c33-afed-c5a59491500b tempest-VolumesListTestJSON-767900108 None] Flow 'volume_create_manager' (ccc5724a-814c-48bf-96ea-8daf09230d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:38:14 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-faaeab7d-96c2-4c33-afed-c5a59491500b tempest-VolumesListTestJSON-767900108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b310f751-7534-4d8c-9c37-e2d315547e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:38:14 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-faaeab7d-96c2-4c33-afed-c5a59491500b tempest-VolumesListTestJSON-767900108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b310f751-7534-4d8c-9c37-e2d315547e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-511053190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ae7ecd4-61f8-476b-8104-0b96953cdf02,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e9ce1afea77d4bddb4a2f1fe9744d6e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:38:15Z,use_quota=True,user_id='c118c28fc2d642cd8bcea6718376ad39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:38:14 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-faaeab7d-96c2-4c33-afed-c5a59491500b tempest-VolumesListTestJSON-767900108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ca1abd1-b814-43b3-9b7a-567e9e27a73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:38:14 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-faaeab7d-96c2-4c33-afed-c5a59491500b tempest-VolumesListTestJSON-767900108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ca1abd1-b814-43b3-9b7a-567e9e27a73f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:38:14 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-faaeab7d-96c2-4c33-afed-c5a59491500b tempest-VolumesListTestJSON-767900108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eb4bc14-9366-4b8d-a49b-25e61e13cf7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:38:14 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-faaeab7d-96c2-4c33-afed-c5a59491500b tempest-VolumesListTestJSON-767900108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eb4bc14-9366-4b8d-a49b-25e61e13cf7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ae7ecd4-61f8-476b-8104-0b96953cdf02', 'volume_name': 'volume-7ae7ecd4-61f8-476b-8104-0b96953cdf02', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:38:14 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-faaeab7d-96c2-4c33-afed-c5a59491500b tempest-VolumesListTestJSON-767900108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (778b918c-e183-4f28-bc78-4b195c828052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:38:14 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-faaeab7d-96c2-4c33-afed-c5a59491500b tempest-VolumesListTestJSON-767900108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (778b918c-e183-4f28-bc78-4b195c828052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:38:14 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-faaeab7d-96c2-4c33-afed-c5a59491500b tempest-VolumesListTestJSON-767900108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad67405c-9fb6-49b9-876c-77a83084c171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:38:14 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-faaeab7d-96c2-4c33-afed-c5a59491500b tempest-VolumesListTestJSON-767900108 None] Volume 7ae7ecd4-61f8-476b-8104-0b96953cdf02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ae7ecd4-61f8-476b-8104-0b96953cdf02', 'volume_size': 1} Jul 08 18:38:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-faaeab7d-96c2-4c33-afed-c5a59491500b tempest-VolumesListTestJSON-767900108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:38:15 devstack sudo[92468]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-067198d8-f14f-41a6-802c-16cca601298e tempest-VolumesSnapshotTestJSON-1399133399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-46de2cf2-f2e9-41d8-8708-feeeeaf85c67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-46de2cf2-f2e9-41d8-8708-feeeeaf85c67.719f1e67-6595-4a0d-89e3-bbb10a32031e 1G" returned: 0 in 0.898s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-067198d8-f14f-41a6-802c-16cca601298e tempest-VolumesSnapshotTestJSON-1399133399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46de2cf2-f2e9-41d8-8708-feeeeaf85c67 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-46de2cf2-f2e9-41d8-8708-feeeeaf85c67.719f1e67-6595-4a0d-89e3-bbb10a32031e {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:15 devstack sudo[92496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46de2cf2-f2e9-41d8-8708-feeeeaf85c67 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-46de2cf2-f2e9-41d8-8708-feeeeaf85c67.719f1e67-6595-4a0d-89e3-bbb10a32031e Jul 08 18:38:15 devstack sudo[92496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:16 devstack sudo[92496]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-067198d8-f14f-41a6-802c-16cca601298e tempest-VolumesSnapshotTestJSON-1399133399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46de2cf2-f2e9-41d8-8708-feeeeaf85c67 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-46de2cf2-f2e9-41d8-8708-feeeeaf85c67.719f1e67-6595-4a0d-89e3-bbb10a32031e" returned: 0 in 1.032s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:16 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-067198d8-f14f-41a6-802c-16cca601298e tempest-VolumesSnapshotTestJSON-1399133399 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-46de2cf2-f2e9-41d8-8708-feeeeaf85c67.719f1e67-6595-4a0d-89e3-bbb10a32031e is being set with open permissions: ugo+rw Jul 08 18:38:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-067198d8-f14f-41a6-802c-16cca601298e tempest-VolumesSnapshotTestJSON-1399133399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-46de2cf2-f2e9-41d8-8708-feeeeaf85c67.719f1e67-6595-4a0d-89e3-bbb10a32031e {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:16 devstack sudo[92537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-46de2cf2-f2e9-41d8-8708-feeeeaf85c67.719f1e67-6595-4a0d-89e3-bbb10a32031e Jul 08 18:38:16 devstack sudo[92537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:17 devstack sudo[92537]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-067198d8-f14f-41a6-802c-16cca601298e tempest-VolumesSnapshotTestJSON-1399133399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-46de2cf2-f2e9-41d8-8708-feeeeaf85c67.719f1e67-6595-4a0d-89e3-bbb10a32031e" returned: 0 in 1.089s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-067198d8-f14f-41a6-802c-16cca601298e tempest-VolumesSnapshotTestJSON-1399133399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-46de2cf2-f2e9-41d8-8708-feeeeaf85c67.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:17 devstack sudo[92556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-46de2cf2-f2e9-41d8-8708-feeeeaf85c67.info Jul 08 18:38:17 devstack sudo[92556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-39c95147-2916-4b4f-a53b-b6ced9d2eaf0 req-2ed9a7b1-0006-4d46-a5f3-e128baa3be83 tempest-ServerActionsTestOtherA-1985324233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:38:18 devstack sudo[92556]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-067198d8-f14f-41a6-802c-16cca601298e tempest-VolumesSnapshotTestJSON-1399133399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-46de2cf2-f2e9-41d8-8708-feeeeaf85c67.info" returned: 0 in 0.936s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:18 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-067198d8-f14f-41a6-802c-16cca601298e tempest-VolumesSnapshotTestJSON-1399133399 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-46de2cf2-f2e9-41d8-8708-feeeeaf85c67.info is being set with open permissions: ugo+rw Jul 08 18:38:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-067198d8-f14f-41a6-802c-16cca601298e tempest-VolumesSnapshotTestJSON-1399133399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-46de2cf2-f2e9-41d8-8708-feeeeaf85c67.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:18 devstack sudo[92559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-46de2cf2-f2e9-41d8-8708-feeeeaf85c67.info Jul 08 18:38:18 devstack sudo[92559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:18 devstack sudo[92559]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-067198d8-f14f-41a6-802c-16cca601298e tempest-VolumesSnapshotTestJSON-1399133399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-46de2cf2-f2e9-41d8-8708-feeeeaf85c67.info" returned: 0 in 0.722s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-067198d8-f14f-41a6-802c-16cca601298e tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.789s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:38:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-faaeab7d-96c2-4c33-afed-c5a59491500b tempest-VolumesListTestJSON-767900108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.990s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:38:18 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-faaeab7d-96c2-4c33-afed-c5a59491500b tempest-VolumesListTestJSON-767900108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-511053190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ae7ecd4-61f8-476b-8104-0b96953cdf02,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e9ce1afea77d4bddb4a2f1fe9744d6e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:38:15Z,use_quota=True,user_id='c118c28fc2d642cd8bcea6718376ad39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:38:18 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-faaeab7d-96c2-4c33-afed-c5a59491500b tempest-VolumesListTestJSON-767900108 None] Creating volume 7ae7ecd4-61f8-476b-8104-0b96953cdf02 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:38:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-faaeab7d-96c2-4c33-afed-c5a59491500b tempest-VolumesListTestJSON-767900108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:38:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-faaeab7d-96c2-4c33-afed-c5a59491500b tempest-VolumesListTestJSON-767900108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:38:18 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-faaeab7d-96c2-4c33-afed-c5a59491500b tempest-VolumesListTestJSON-767900108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:38:18 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-faaeab7d-96c2-4c33-afed-c5a59491500b tempest-VolumesListTestJSON-767900108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:38:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-faaeab7d-96c2-4c33-afed-c5a59491500b tempest-VolumesListTestJSON-767900108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:38:18 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-faaeab7d-96c2-4c33-afed-c5a59491500b tempest-VolumesListTestJSON-767900108 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:38:18 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-faaeab7d-96c2-4c33-afed-c5a59491500b tempest-VolumesListTestJSON-767900108 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:38:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-faaeab7d-96c2-4c33-afed-c5a59491500b tempest-VolumesListTestJSON-767900108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7ae7ecd4-61f8-476b-8104-0b96953cdf02 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:19 devstack sudo[92562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7ae7ecd4-61f8-476b-8104-0b96953cdf02 1073741824 Jul 08 18:38:19 devstack sudo[92562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:19 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-067198d8-f14f-41a6-802c-16cca601298e tempest-VolumesSnapshotTestJSON-1399133399 None] Create snapshot completed successfully Jul 08 18:38:19 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-19bf2333-1105-438e-929e-cb4db2c11eeb tempest-VolumesSnapshotTestJSON-1399133399 None] Acquiring lock "cinder-719f1e67-6595-4a0d-89e3-bbb10a32031e-delete_snapshot" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:38:19 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-19bf2333-1105-438e-929e-cb4db2c11eeb tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "cinder-719f1e67-6595-4a0d-89e3-bbb10a32031e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:38:19 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:UPDATE=83,cinder:DELETE=5,cinder:SELECT=73,cinder:INSERT=12 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:38:19 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-19bf2333-1105-438e-929e-cb4db2c11eeb tempest-VolumesSnapshotTestJSON-1399133399 None] Acquiring lock "cinder-quobyte-46de2cf2-f2e9-41d8-8708-feeeeaf85c67" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:38:19 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-19bf2333-1105-438e-929e-cb4db2c11eeb tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "cinder-quobyte-46de2cf2-f2e9-41d8-8708-feeeeaf85c67" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:38:19 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-19bf2333-1105-438e-929e-cb4db2c11eeb tempest-VolumesSnapshotTestJSON-1399133399 None] Acquiring lock "cinder-quobyte-719f1e67-6595-4a0d-89e3-bbb10a32031e" by "_delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:38:19 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-19bf2333-1105-438e-929e-cb4db2c11eeb tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "cinder-quobyte-719f1e67-6595-4a0d-89e3-bbb10a32031e" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:38:19 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-19bf2333-1105-438e-929e-cb4db2c11eeb tempest-VolumesSnapshotTestJSON-1399133399 None] Deleting offline snapshot 719f1e67-6595-4a0d-89e3-bbb10a32031e of volume 46de2cf2-f2e9-41d8-8708-feeeeaf85c67 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:38:20 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-19bf2333-1105-438e-929e-cb4db2c11eeb tempest-VolumesSnapshotTestJSON-1399133399 None] snapshot_file for this snap is: volume-46de2cf2-f2e9-41d8-8708-feeeeaf85c67.719f1e67-6595-4a0d-89e3-bbb10a32031e {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:38:20 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1861ea-593f-4cc5-915e-d5908a840cb4]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:38:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-19bf2333-1105-438e-929e-cb4db2c11eeb tempest-VolumesSnapshotTestJSON-1399133399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-46de2cf2-f2e9-41d8-8708-feeeeaf85c67.719f1e67-6595-4a0d-89e3-bbb10a32031e {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:20 devstack sudo[92569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-46de2cf2-f2e9-41d8-8708-feeeeaf85c67.719f1e67-6595-4a0d-89e3-bbb10a32031e Jul 08 18:38:20 devstack sudo[92569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:20 devstack sudo[92562]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-faaeab7d-96c2-4c33-afed-c5a59491500b tempest-VolumesListTestJSON-767900108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7ae7ecd4-61f8-476b-8104-0b96953cdf02 1073741824" returned: 0 in 1.363s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-faaeab7d-96c2-4c33-afed-c5a59491500b tempest-VolumesListTestJSON-767900108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7ae7ecd4-61f8-476b-8104-0b96953cdf02 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:20 devstack sudo[92571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7ae7ecd4-61f8-476b-8104-0b96953cdf02 Jul 08 18:38:20 devstack sudo[92571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:20 devstack sudo[92569]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-19bf2333-1105-438e-929e-cb4db2c11eeb tempest-VolumesSnapshotTestJSON-1399133399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-46de2cf2-f2e9-41d8-8708-feeeeaf85c67.719f1e67-6595-4a0d-89e3-bbb10a32031e" returned: 0 in 0.957s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:20 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-19bf2333-1105-438e-929e-cb4db2c11eeb tempest-VolumesSnapshotTestJSON-1399133399 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46de2cf2-f2e9-41d8-8708-feeeeaf85c67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:38:21 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3594a9-b971-4f6b-8d21-0026507992e8]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:38:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-19bf2333-1105-438e-929e-cb4db2c11eeb tempest-VolumesSnapshotTestJSON-1399133399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-46de2cf2-f2e9-41d8-8708-feeeeaf85c67 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:21 devstack sudo[92571]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-faaeab7d-96c2-4c33-afed-c5a59491500b tempest-VolumesListTestJSON-767900108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7ae7ecd4-61f8-476b-8104-0b96953cdf02" returned: 0 in 0.743s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:21 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-faaeab7d-96c2-4c33-afed-c5a59491500b tempest-VolumesListTestJSON-767900108 None] <== create_volume: return (2154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:38:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-faaeab7d-96c2-4c33-afed-c5a59491500b tempest-VolumesListTestJSON-767900108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.158s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:38:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-39c95147-2916-4b4f-a53b-b6ced9d2eaf0 req-2ed9a7b1-0006-4d46-a5f3-e128baa3be83 tempest-ServerActionsTestOtherA-1985324233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.692s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:38:21 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:UPDATE=69,cinder:SELECT=66,cinder:INSERT=20,cinder:DELETE=11 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:38:21 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-faaeab7d-96c2-4c33-afed-c5a59491500b tempest-VolumesListTestJSON-767900108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad67405c-9fb6-49b9-876c-77a83084c171) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ae7ecd4-61f8-476b-8104-0b96953cdf02', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:38:21 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-faaeab7d-96c2-4c33-afed-c5a59491500b tempest-VolumesListTestJSON-767900108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e43a55b-d274-41d7-acef-38192d709ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:38:21 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b50d9c4-575d-45de-a989-30fc84efb062]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:38:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-39c95147-2916-4b4f-a53b-b6ced9d2eaf0 req-2ed9a7b1-0006-4d46-a5f3-e128baa3be83 tempest-ServerActionsTestOtherA-1985324233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-a5202c4a-e705-4e51-9327-2d2a50c54237 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:21 devstack sudo[92578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-46de2cf2-f2e9-41d8-8708-feeeeaf85c67 Jul 08 18:38:21 devstack sudo[92578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:21 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-faaeab7d-96c2-4c33-afed-c5a59491500b tempest-VolumesListTestJSON-767900108 None] Volume volume-7ae7ecd4-61f8-476b-8104-0b96953cdf02 (7ae7ecd4-61f8-476b-8104-0b96953cdf02): created successfully Jul 08 18:38:21 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-faaeab7d-96c2-4c33-afed-c5a59491500b tempest-VolumesListTestJSON-767900108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e43a55b-d274-41d7-acef-38192d709ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:38:21 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-faaeab7d-96c2-4c33-afed-c5a59491500b tempest-VolumesListTestJSON-767900108 None] Flow 'volume_create_manager' (ccc5724a-814c-48bf-96ea-8daf09230d0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:38:21 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-faaeab7d-96c2-4c33-afed-c5a59491500b tempest-VolumesListTestJSON-767900108 None] Created volume successfully. Jul 08 18:38:21 devstack sudo[92579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-a5202c4a-e705-4e51-9327-2d2a50c54237 Jul 08 18:38:21 devstack sudo[92579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:22 devstack sudo[92579]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-39c95147-2916-4b4f-a53b-b6ced9d2eaf0 req-2ed9a7b1-0006-4d46-a5f3-e128baa3be83 tempest-ServerActionsTestOtherA-1985324233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-a5202c4a-e705-4e51-9327-2d2a50c54237" returned: 0 in 1.186s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-39c95147-2916-4b4f-a53b-b6ced9d2eaf0 req-2ed9a7b1-0006-4d46-a5f3-e128baa3be83 tempest-ServerActionsTestOtherA-1985324233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.233s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:38:22 devstack sudo[92578]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-19bf2333-1105-438e-929e-cb4db2c11eeb tempest-VolumesSnapshotTestJSON-1399133399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-46de2cf2-f2e9-41d8-8708-feeeeaf85c67" returned: 0 in 1.334s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-19bf2333-1105-438e-929e-cb4db2c11eeb tempest-VolumesSnapshotTestJSON-1399133399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-46de2cf2-f2e9-41d8-8708-feeeeaf85c67.719f1e67-6595-4a0d-89e3-bbb10a32031e {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:22 devstack sudo[92591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-46de2cf2-f2e9-41d8-8708-feeeeaf85c67.719f1e67-6595-4a0d-89e3-bbb10a32031e Jul 08 18:38:22 devstack sudo[92591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:22 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-39c95147-2916-4b4f-a53b-b6ced9d2eaf0 req-2ed9a7b1-0006-4d46-a5f3-e128baa3be83 tempest-ServerActionsTestOtherA-1985324233 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2', 'name': 'volume-a5202c4a-e705-4e51-9327-2d2a50c54237', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '40a15851-b6bd-4ecf-abd2-c07b39741d72', 'enforce_multipath': True} {{(pid=86873) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 18:38:22 devstack cinder-volume[86873]: INFO cinder.volume.manager [req-39c95147-2916-4b4f-a53b-b6ced9d2eaf0 req-2ed9a7b1-0006-4d46-a5f3-e128baa3be83 tempest-ServerActionsTestOtherA-1985324233 None] attachment_update completed successfully. Jul 08 18:38:23 devstack sudo[92591]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-19bf2333-1105-438e-929e-cb4db2c11eeb tempest-VolumesSnapshotTestJSON-1399133399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-46de2cf2-f2e9-41d8-8708-feeeeaf85c67.719f1e67-6595-4a0d-89e3-bbb10a32031e" returned: 0 in 0.993s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-19bf2333-1105-438e-929e-cb4db2c11eeb tempest-VolumesSnapshotTestJSON-1399133399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-46de2cf2-f2e9-41d8-8708-feeeeaf85c67.719f1e67-6595-4a0d-89e3-bbb10a32031e {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:23 devstack sudo[92596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-46de2cf2-f2e9-41d8-8708-feeeeaf85c67.719f1e67-6595-4a0d-89e3-bbb10a32031e Jul 08 18:38:23 devstack sudo[92596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:24 devstack sudo[92596]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-19bf2333-1105-438e-929e-cb4db2c11eeb tempest-VolumesSnapshotTestJSON-1399133399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-46de2cf2-f2e9-41d8-8708-feeeeaf85c67.719f1e67-6595-4a0d-89e3-bbb10a32031e" returned: 0 in 0.894s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:24 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-19bf2333-1105-438e-929e-cb4db2c11eeb tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "cinder-quobyte-719f1e67-6595-4a0d-89e3-bbb10a32031e" released by "_delete_snapshot" :: held 4.338s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:38:24 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-19bf2333-1105-438e-929e-cb4db2c11eeb tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "cinder-quobyte-46de2cf2-f2e9-41d8-8708-feeeeaf85c67" released by "delete_snapshot" :: held 4.371s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:38:24 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-3251240c-5133-451f-bd94-ab8874a16241 tempest-VolumesListTestJSON-767900108 None] Acquiring lock "cinder-7ae7ecd4-61f8-476b-8104-0b96953cdf02-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:38:24 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-3251240c-5133-451f-bd94-ab8874a16241 tempest-VolumesListTestJSON-767900108 None] Lock "cinder-7ae7ecd4-61f8-476b-8104-0b96953cdf02-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:38:24 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-3251240c-5133-451f-bd94-ab8874a16241 tempest-VolumesListTestJSON-767900108 None] Acquiring lock "cinder-quobyte-7ae7ecd4-61f8-476b-8104-0b96953cdf02" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:38:24 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-19bf2333-1105-438e-929e-cb4db2c11eeb tempest-VolumesSnapshotTestJSON-1399133399 None] Created reservations ['92aba635-48ce-4b0e-95ce-e94fa1599aaa', '5184032e-bd86-4d9d-a039-173ec768808c', 'c8eaa3b6-aed3-4542-9c4d-e6c923efecf7', '6661a168-f74f-421e-89ba-589792232ea2'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:38:24 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-3251240c-5133-451f-bd94-ab8874a16241 tempest-VolumesListTestJSON-767900108 None] Lock "cinder-quobyte-7ae7ecd4-61f8-476b-8104-0b96953cdf02" acquired by "delete_volume" :: waited 0.028s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:38:24 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae4a41a-f192-4c1a-9672-c43111120ea7]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:38:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3251240c-5133-451f-bd94-ab8874a16241 tempest-VolumesListTestJSON-767900108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7ae7ecd4-61f8-476b-8104-0b96953cdf02 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:24 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-19bf2333-1105-438e-929e-cb4db2c11eeb tempest-VolumesSnapshotTestJSON-1399133399 None] Delete snapshot completed successfully. Jul 08 18:38:24 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-19bf2333-1105-438e-929e-cb4db2c11eeb tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "cinder-719f1e67-6595-4a0d-89e3-bbb10a32031e-delete_snapshot" released by "delete_snapshot" :: held 4.729s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:38:24 devstack sudo[92599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7ae7ecd4-61f8-476b-8104-0b96953cdf02 Jul 08 18:38:24 devstack sudo[92599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:25 devstack sudo[92599]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3251240c-5133-451f-bd94-ab8874a16241 tempest-VolumesListTestJSON-767900108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7ae7ecd4-61f8-476b-8104-0b96953cdf02" returned: 0 in 1.084s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3251240c-5133-451f-bd94-ab8874a16241 tempest-VolumesListTestJSON-767900108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7ae7ecd4-61f8-476b-8104-0b96953cdf02 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:25 devstack sudo[92620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7ae7ecd4-61f8-476b-8104-0b96953cdf02 Jul 08 18:38:25 devstack sudo[92620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:25 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-b611c144-fdee-4947-80c7-8cf310d08b0a tempest-VolumesSnapshotTestJSON-1399133399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:38:25 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b611c144-fdee-4947-80c7-8cf310d08b0a tempest-VolumesSnapshotTestJSON-1399133399 None] Flow 'volume_create_manager' (e22eb871-161c-4f28-ba94-4137a55c0e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:38:25 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b611c144-fdee-4947-80c7-8cf310d08b0a tempest-VolumesSnapshotTestJSON-1399133399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26c1fc82-e55d-4994-a360-fc20f948bb8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:38:26 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b611c144-fdee-4947-80c7-8cf310d08b0a tempest-VolumesSnapshotTestJSON-1399133399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26c1fc82-e55d-4994-a360-fc20f948bb8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:38:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-282586289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4acab92-2722-4fe0-87b4-79de130d7e9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfae85ad945e4d2585d3823b7b4ef62e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:38:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:38:26Z,use_quota=True,user_id='6a6b7648c1c2476ab78c03983697ff4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:38:26 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b611c144-fdee-4947-80c7-8cf310d08b0a tempest-VolumesSnapshotTestJSON-1399133399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a53391a9-c385-4159-9a04-7259f4e9ecb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:38:26 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b611c144-fdee-4947-80c7-8cf310d08b0a tempest-VolumesSnapshotTestJSON-1399133399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a53391a9-c385-4159-9a04-7259f4e9ecb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:38:26 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b611c144-fdee-4947-80c7-8cf310d08b0a tempest-VolumesSnapshotTestJSON-1399133399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cda0b132-7366-43d5-9bc1-c56a5c2fdaa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:38:26 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b611c144-fdee-4947-80c7-8cf310d08b0a tempest-VolumesSnapshotTestJSON-1399133399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cda0b132-7366-43d5-9bc1-c56a5c2fdaa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4acab92-2722-4fe0-87b4-79de130d7e9c', 'volume_name': 'volume-d4acab92-2722-4fe0-87b4-79de130d7e9c', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:38:26 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b611c144-fdee-4947-80c7-8cf310d08b0a tempest-VolumesSnapshotTestJSON-1399133399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbf16893-1ee8-4b8d-aa95-89417fc0f1b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:38:26 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b611c144-fdee-4947-80c7-8cf310d08b0a tempest-VolumesSnapshotTestJSON-1399133399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbf16893-1ee8-4b8d-aa95-89417fc0f1b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:38:26 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b611c144-fdee-4947-80c7-8cf310d08b0a tempest-VolumesSnapshotTestJSON-1399133399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6684224-94a4-4c6e-8f08-cb135d64324b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:38:26 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-b611c144-fdee-4947-80c7-8cf310d08b0a tempest-VolumesSnapshotTestJSON-1399133399 None] Volume d4acab92-2722-4fe0-87b4-79de130d7e9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4acab92-2722-4fe0-87b4-79de130d7e9c', 'volume_size': 1} Jul 08 18:38:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b611c144-fdee-4947-80c7-8cf310d08b0a tempest-VolumesSnapshotTestJSON-1399133399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:38:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b611c144-fdee-4947-80c7-8cf310d08b0a tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:38:26 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b611c144-fdee-4947-80c7-8cf310d08b0a tempest-VolumesSnapshotTestJSON-1399133399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:38:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-282586289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4acab92-2722-4fe0-87b4-79de130d7e9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfae85ad945e4d2585d3823b7b4ef62e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:38:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:38:26Z,use_quota=True,user_id='6a6b7648c1c2476ab78c03983697ff4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:38:26 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-b611c144-fdee-4947-80c7-8cf310d08b0a tempest-VolumesSnapshotTestJSON-1399133399 None] Creating volume d4acab92-2722-4fe0-87b4-79de130d7e9c {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:38:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b611c144-fdee-4947-80c7-8cf310d08b0a tempest-VolumesSnapshotTestJSON-1399133399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:38:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b611c144-fdee-4947-80c7-8cf310d08b0a tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:38:26 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b611c144-fdee-4947-80c7-8cf310d08b0a tempest-VolumesSnapshotTestJSON-1399133399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:38:26 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b611c144-fdee-4947-80c7-8cf310d08b0a tempest-VolumesSnapshotTestJSON-1399133399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:38:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b611c144-fdee-4947-80c7-8cf310d08b0a tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:38:26 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b611c144-fdee-4947-80c7-8cf310d08b0a tempest-VolumesSnapshotTestJSON-1399133399 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:38:26 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-b611c144-fdee-4947-80c7-8cf310d08b0a tempest-VolumesSnapshotTestJSON-1399133399 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:38:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b611c144-fdee-4947-80c7-8cf310d08b0a tempest-VolumesSnapshotTestJSON-1399133399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4acab92-2722-4fe0-87b4-79de130d7e9c 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:26 devstack sudo[92622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4acab92-2722-4fe0-87b4-79de130d7e9c 1073741824 Jul 08 18:38:26 devstack sudo[92622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:26 devstack sudo[92620]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3251240c-5133-451f-bd94-ab8874a16241 tempest-VolumesListTestJSON-767900108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7ae7ecd4-61f8-476b-8104-0b96953cdf02" returned: 0 in 0.783s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:26 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-3251240c-5133-451f-bd94-ab8874a16241 tempest-VolumesListTestJSON-767900108 None] Lock "cinder-quobyte-7ae7ecd4-61f8-476b-8104-0b96953cdf02" released by "delete_volume" :: held 1.909s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:38:26 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-3251240c-5133-451f-bd94-ab8874a16241 tempest-VolumesListTestJSON-767900108 None] Created reservations ['7c02a7ac-6de8-44cb-aee1-29a532678fa3', '8f1748e9-19d4-4894-bd1d-2ac05318f918', 'e1c4e75d-4609-4be6-bc82-bb4a84151b38', 'f27611c9-2493-4d4d-a166-6e180e2c9dad'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:38:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3251240c-5133-451f-bd94-ab8874a16241 tempest-VolumesListTestJSON-767900108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:38:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3251240c-5133-451f-bd94-ab8874a16241 tempest-VolumesListTestJSON-767900108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:38:26 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-3251240c-5133-451f-bd94-ab8874a16241 tempest-VolumesListTestJSON-767900108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:38:26 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-3251240c-5133-451f-bd94-ab8874a16241 tempest-VolumesListTestJSON-767900108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:38:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3251240c-5133-451f-bd94-ab8874a16241 tempest-VolumesListTestJSON-767900108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:38:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3251240c-5133-451f-bd94-ab8874a16241 tempest-VolumesListTestJSON-767900108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:26 devstack sudo[92625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:38:26 devstack sudo[92625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:27 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-0399a31c-929b-49e5-8601-74223cd91b14 tempest-VolumesListTestJSON-767900108 None] Acquiring lock "cinder-e4e6a7ed-e5c1-4d7b-b9ea-e3da94ab71e8-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:38:27 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-0399a31c-929b-49e5-8601-74223cd91b14 tempest-VolumesListTestJSON-767900108 None] Lock "cinder-e4e6a7ed-e5c1-4d7b-b9ea-e3da94ab71e8-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:38:27 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-0399a31c-929b-49e5-8601-74223cd91b14 tempest-VolumesListTestJSON-767900108 None] Acquiring lock "cinder-quobyte-e4e6a7ed-e5c1-4d7b-b9ea-e3da94ab71e8" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:38:27 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-0399a31c-929b-49e5-8601-74223cd91b14 tempest-VolumesListTestJSON-767900108 None] Lock "cinder-quobyte-e4e6a7ed-e5c1-4d7b-b9ea-e3da94ab71e8" acquired by "delete_volume" :: waited 0.042s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:38:27 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f72d78-a550-4a17-ab32-a7f4e5286e20]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:38:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-0399a31c-929b-49e5-8601-74223cd91b14 tempest-VolumesListTestJSON-767900108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e4e6a7ed-e5c1-4d7b-b9ea-e3da94ab71e8 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:27 devstack sudo[92651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e4e6a7ed-e5c1-4d7b-b9ea-e3da94ab71e8 Jul 08 18:38:27 devstack sudo[92651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:27 devstack sudo[92622]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b611c144-fdee-4947-80c7-8cf310d08b0a tempest-VolumesSnapshotTestJSON-1399133399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4acab92-2722-4fe0-87b4-79de130d7e9c 1073741824" returned: 0 in 1.672s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b611c144-fdee-4947-80c7-8cf310d08b0a tempest-VolumesSnapshotTestJSON-1399133399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4acab92-2722-4fe0-87b4-79de130d7e9c {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:27 devstack sudo[92654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4acab92-2722-4fe0-87b4-79de130d7e9c Jul 08 18:38:27 devstack sudo[92654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:27 devstack sudo[92625]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3251240c-5133-451f-bd94-ab8874a16241 tempest-VolumesListTestJSON-767900108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 1.419s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:27 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-3251240c-5133-451f-bd94-ab8874a16241 tempest-VolumesListTestJSON-767900108 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:38:27 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-3251240c-5133-451f-bd94-ab8874a16241 tempest-VolumesListTestJSON-767900108 None] Deleted volume successfully. Jul 08 18:38:28 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-3251240c-5133-451f-bd94-ab8874a16241 tempest-VolumesListTestJSON-767900108 None] Lock "cinder-7ae7ecd4-61f8-476b-8104-0b96953cdf02-delete_volume" released by "delete_volume" :: held 3.659s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:38:28 devstack sudo[92654]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b611c144-fdee-4947-80c7-8cf310d08b0a tempest-VolumesSnapshotTestJSON-1399133399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4acab92-2722-4fe0-87b4-79de130d7e9c" returned: 0 in 0.874s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:28 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b611c144-fdee-4947-80c7-8cf310d08b0a tempest-VolumesSnapshotTestJSON-1399133399 None] <== create_volume: return (2617ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:38:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b611c144-fdee-4947-80c7-8cf310d08b0a tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.620s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:38:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b611c144-fdee-4947-80c7-8cf310d08b0a tempest-VolumesSnapshotTestJSON-1399133399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6684224-94a4-4c6e-8f08-cb135d64324b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4acab92-2722-4fe0-87b4-79de130d7e9c', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:38:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b611c144-fdee-4947-80c7-8cf310d08b0a tempest-VolumesSnapshotTestJSON-1399133399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73580fa6-c10d-4be9-973a-6f2474061118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:38:28 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-b611c144-fdee-4947-80c7-8cf310d08b0a tempest-VolumesSnapshotTestJSON-1399133399 None] Volume volume-d4acab92-2722-4fe0-87b4-79de130d7e9c (d4acab92-2722-4fe0-87b4-79de130d7e9c): created successfully Jul 08 18:38:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b611c144-fdee-4947-80c7-8cf310d08b0a tempest-VolumesSnapshotTestJSON-1399133399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73580fa6-c10d-4be9-973a-6f2474061118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:38:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b611c144-fdee-4947-80c7-8cf310d08b0a tempest-VolumesSnapshotTestJSON-1399133399 None] Flow 'volume_create_manager' (e22eb871-161c-4f28-ba94-4137a55c0e99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:38:28 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-b611c144-fdee-4947-80c7-8cf310d08b0a tempest-VolumesSnapshotTestJSON-1399133399 None] Created volume successfully. Jul 08 18:38:28 devstack sudo[92651]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-0399a31c-929b-49e5-8601-74223cd91b14 tempest-VolumesListTestJSON-767900108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e4e6a7ed-e5c1-4d7b-b9ea-e3da94ab71e8" returned: 0 in 1.275s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-0399a31c-929b-49e5-8601-74223cd91b14 tempest-VolumesListTestJSON-767900108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e4e6a7ed-e5c1-4d7b-b9ea-e3da94ab71e8 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:28 devstack sudo[92707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e4e6a7ed-e5c1-4d7b-b9ea-e3da94ab71e8 Jul 08 18:38:28 devstack sudo[92707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-a304afbd-3692-4594-9ea9-311b166b1a99 tempest-VolumesSnapshotTestJSON-1399133399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:38:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-a304afbd-3692-4594-9ea9-311b166b1a99 tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:38:29 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-a304afbd-3692-4594-9ea9-311b166b1a99 tempest-VolumesSnapshotTestJSON-1399133399 None] Creating offline snapshot 6afeb3c5-6915-4caa-b16e-bf4422b5ea12 of volume d4acab92-2722-4fe0-87b4-79de130d7e9c {{(pid=86873) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:38:29 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[7750b772-ca33-4dbf-a2df-76cf56349ce6]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:38:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-a304afbd-3692-4594-9ea9-311b166b1a99 tempest-VolumesSnapshotTestJSON-1399133399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4acab92-2722-4fe0-87b4-79de130d7e9c {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:29 devstack sudo[92707]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-0399a31c-929b-49e5-8601-74223cd91b14 tempest-VolumesListTestJSON-767900108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e4e6a7ed-e5c1-4d7b-b9ea-e3da94ab71e8" returned: 0 in 0.771s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:29 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-0399a31c-929b-49e5-8601-74223cd91b14 tempest-VolumesListTestJSON-767900108 None] Lock "cinder-quobyte-e4e6a7ed-e5c1-4d7b-b9ea-e3da94ab71e8" released by "delete_volume" :: held 2.113s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:38:29 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-0399a31c-929b-49e5-8601-74223cd91b14 tempest-VolumesListTestJSON-767900108 None] Created reservations ['5d8a0edd-a4ac-4606-b11e-a722f9c4db24', '506c6ce1-3351-4f85-88f1-8fc4c5450861', '976110cb-8d81-4841-aff4-2941f7cadc2c', 'acaf851b-e543-460c-a130-b30d61cab333'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:38:29 devstack sudo[92712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4acab92-2722-4fe0-87b4-79de130d7e9c Jul 08 18:38:29 devstack sudo[92712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-0399a31c-929b-49e5-8601-74223cd91b14 tempest-VolumesListTestJSON-767900108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:38:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-0399a31c-929b-49e5-8601-74223cd91b14 tempest-VolumesListTestJSON-767900108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:38:29 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-0399a31c-929b-49e5-8601-74223cd91b14 tempest-VolumesListTestJSON-767900108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:38:29 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-0399a31c-929b-49e5-8601-74223cd91b14 tempest-VolumesListTestJSON-767900108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:38:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-0399a31c-929b-49e5-8601-74223cd91b14 tempest-VolumesListTestJSON-767900108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:38:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-0399a31c-929b-49e5-8601-74223cd91b14 tempest-VolumesListTestJSON-767900108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:29 devstack sudo[92714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:38:29 devstack sudo[92714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:30 devstack sudo[92712]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-a304afbd-3692-4594-9ea9-311b166b1a99 tempest-VolumesSnapshotTestJSON-1399133399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4acab92-2722-4fe0-87b4-79de130d7e9c" returned: 0 in 0.980s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:30 devstack sudo[92714]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-a304afbd-3692-4594-9ea9-311b166b1a99 tempest-VolumesSnapshotTestJSON-1399133399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4acab92-2722-4fe0-87b4-79de130d7e9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4acab92-2722-4fe0-87b4-79de130d7e9c.6afeb3c5-6915-4caa-b16e-bf4422b5ea12 1G {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-0399a31c-929b-49e5-8601-74223cd91b14 tempest-VolumesListTestJSON-767900108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.816s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:30 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-0399a31c-929b-49e5-8601-74223cd91b14 tempest-VolumesListTestJSON-767900108 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:38:30 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-0399a31c-929b-49e5-8601-74223cd91b14 tempest-VolumesListTestJSON-767900108 None] Deleted volume successfully. Jul 08 18:38:30 devstack sudo[92723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4acab92-2722-4fe0-87b4-79de130d7e9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4acab92-2722-4fe0-87b4-79de130d7e9c.6afeb3c5-6915-4caa-b16e-bf4422b5ea12 1G Jul 08 18:38:30 devstack sudo[92723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:30 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-0399a31c-929b-49e5-8601-74223cd91b14 tempest-VolumesListTestJSON-767900108 None] Lock "cinder-e4e6a7ed-e5c1-4d7b-b9ea-e3da94ab71e8-delete_volume" released by "delete_volume" :: held 3.371s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:38:30 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-fdd0113e-4524-44f6-bfa7-4a2ec63d95a4 tempest-VolumesListTestJSON-767900108 None] Acquiring lock "cinder-3dbea0e6-c5c1-4039-95a9-74851bdb6090-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:38:30 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-fdd0113e-4524-44f6-bfa7-4a2ec63d95a4 tempest-VolumesListTestJSON-767900108 None] Lock "cinder-3dbea0e6-c5c1-4039-95a9-74851bdb6090-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:38:30 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-fdd0113e-4524-44f6-bfa7-4a2ec63d95a4 tempest-VolumesListTestJSON-767900108 None] Acquiring lock "cinder-quobyte-3dbea0e6-c5c1-4039-95a9-74851bdb6090" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:38:30 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-fdd0113e-4524-44f6-bfa7-4a2ec63d95a4 tempest-VolumesListTestJSON-767900108 None] Lock "cinder-quobyte-3dbea0e6-c5c1-4039-95a9-74851bdb6090" acquired by "delete_volume" :: waited 0.028s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:38:30 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[e291574c-49bd-4ba4-91c8-ba44d0c970e2]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:38:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-fdd0113e-4524-44f6-bfa7-4a2ec63d95a4 tempest-VolumesListTestJSON-767900108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3dbea0e6-c5c1-4039-95a9-74851bdb6090 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:31 devstack sudo[92725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3dbea0e6-c5c1-4039-95a9-74851bdb6090 Jul 08 18:38:31 devstack sudo[92725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:31 devstack sudo[92723]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-a304afbd-3692-4594-9ea9-311b166b1a99 tempest-VolumesSnapshotTestJSON-1399133399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4acab92-2722-4fe0-87b4-79de130d7e9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4acab92-2722-4fe0-87b4-79de130d7e9c.6afeb3c5-6915-4caa-b16e-bf4422b5ea12 1G" returned: 0 in 0.990s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-a304afbd-3692-4594-9ea9-311b166b1a99 tempest-VolumesSnapshotTestJSON-1399133399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4acab92-2722-4fe0-87b4-79de130d7e9c -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4acab92-2722-4fe0-87b4-79de130d7e9c.6afeb3c5-6915-4caa-b16e-bf4422b5ea12 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:31 devstack sudo[92731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4acab92-2722-4fe0-87b4-79de130d7e9c -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4acab92-2722-4fe0-87b4-79de130d7e9c.6afeb3c5-6915-4caa-b16e-bf4422b5ea12 Jul 08 18:38:31 devstack sudo[92731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:32 devstack sudo[92725]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:32 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-fdd0113e-4524-44f6-bfa7-4a2ec63d95a4 tempest-VolumesListTestJSON-767900108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3dbea0e6-c5c1-4039-95a9-74851bdb6090" returned: 0 in 1.140s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:32 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-fdd0113e-4524-44f6-bfa7-4a2ec63d95a4 tempest-VolumesListTestJSON-767900108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3dbea0e6-c5c1-4039-95a9-74851bdb6090 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:32 devstack sudo[92737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3dbea0e6-c5c1-4039-95a9-74851bdb6090 Jul 08 18:38:32 devstack sudo[92737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:32 devstack sudo[92731]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:32 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-a304afbd-3692-4594-9ea9-311b166b1a99 tempest-VolumesSnapshotTestJSON-1399133399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4acab92-2722-4fe0-87b4-79de130d7e9c -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4acab92-2722-4fe0-87b4-79de130d7e9c.6afeb3c5-6915-4caa-b16e-bf4422b5ea12" returned: 0 in 0.854s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:32 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-a304afbd-3692-4594-9ea9-311b166b1a99 tempest-VolumesSnapshotTestJSON-1399133399 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4acab92-2722-4fe0-87b4-79de130d7e9c.6afeb3c5-6915-4caa-b16e-bf4422b5ea12 is being set with open permissions: ugo+rw Jul 08 18:38:32 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-a304afbd-3692-4594-9ea9-311b166b1a99 tempest-VolumesSnapshotTestJSON-1399133399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4acab92-2722-4fe0-87b4-79de130d7e9c.6afeb3c5-6915-4caa-b16e-bf4422b5ea12 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:32 devstack sudo[92743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4acab92-2722-4fe0-87b4-79de130d7e9c.6afeb3c5-6915-4caa-b16e-bf4422b5ea12 Jul 08 18:38:32 devstack sudo[92743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:32 devstack sudo[92737]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:32 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-fdd0113e-4524-44f6-bfa7-4a2ec63d95a4 tempest-VolumesListTestJSON-767900108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3dbea0e6-c5c1-4039-95a9-74851bdb6090" returned: 0 in 0.815s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:32 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-fdd0113e-4524-44f6-bfa7-4a2ec63d95a4 tempest-VolumesListTestJSON-767900108 None] Lock "cinder-quobyte-3dbea0e6-c5c1-4039-95a9-74851bdb6090" released by "delete_volume" :: held 2.006s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:38:32 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-fdd0113e-4524-44f6-bfa7-4a2ec63d95a4 tempest-VolumesListTestJSON-767900108 None] Created reservations ['3c86c948-2c09-4213-80b3-a91f3b7cab42', '27340af3-93f9-4b8c-b233-c1e134ab22cf', 'c54fb366-a14b-4308-99a7-31404f92d643', '83ddff5d-adb8-4452-80f7-218f6a2099e0'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:38:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-fdd0113e-4524-44f6-bfa7-4a2ec63d95a4 tempest-VolumesListTestJSON-767900108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:38:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-fdd0113e-4524-44f6-bfa7-4a2ec63d95a4 tempest-VolumesListTestJSON-767900108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:38:33 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-fdd0113e-4524-44f6-bfa7-4a2ec63d95a4 tempest-VolumesListTestJSON-767900108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:38:33 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-fdd0113e-4524-44f6-bfa7-4a2ec63d95a4 tempest-VolumesListTestJSON-767900108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:38:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-fdd0113e-4524-44f6-bfa7-4a2ec63d95a4 tempest-VolumesListTestJSON-767900108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:38:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-fdd0113e-4524-44f6-bfa7-4a2ec63d95a4 tempest-VolumesListTestJSON-767900108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:33 devstack sudo[92761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:38:33 devstack sudo[92761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:33 devstack sudo[92743]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-a304afbd-3692-4594-9ea9-311b166b1a99 tempest-VolumesSnapshotTestJSON-1399133399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4acab92-2722-4fe0-87b4-79de130d7e9c.6afeb3c5-6915-4caa-b16e-bf4422b5ea12" returned: 0 in 0.829s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-a304afbd-3692-4594-9ea9-311b166b1a99 tempest-VolumesSnapshotTestJSON-1399133399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4acab92-2722-4fe0-87b4-79de130d7e9c.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:33 devstack sudo[92763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4acab92-2722-4fe0-87b4-79de130d7e9c.info Jul 08 18:38:33 devstack sudo[92763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:33 devstack sudo[92761]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-fdd0113e-4524-44f6-bfa7-4a2ec63d95a4 tempest-VolumesListTestJSON-767900108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.932s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:33 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-fdd0113e-4524-44f6-bfa7-4a2ec63d95a4 tempest-VolumesListTestJSON-767900108 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:38:33 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-fdd0113e-4524-44f6-bfa7-4a2ec63d95a4 tempest-VolumesListTestJSON-767900108 None] Deleted volume successfully. Jul 08 18:38:34 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-fdd0113e-4524-44f6-bfa7-4a2ec63d95a4 tempest-VolumesListTestJSON-767900108 None] Lock "cinder-3dbea0e6-c5c1-4039-95a9-74851bdb6090-delete_volume" released by "delete_volume" :: held 3.263s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:38:34 devstack sudo[92763]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-a304afbd-3692-4594-9ea9-311b166b1a99 tempest-VolumesSnapshotTestJSON-1399133399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4acab92-2722-4fe0-87b4-79de130d7e9c.info" returned: 0 in 0.929s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:34 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-a304afbd-3692-4594-9ea9-311b166b1a99 tempest-VolumesSnapshotTestJSON-1399133399 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4acab92-2722-4fe0-87b4-79de130d7e9c.info is being set with open permissions: ugo+rw Jul 08 18:38:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-a304afbd-3692-4594-9ea9-311b166b1a99 tempest-VolumesSnapshotTestJSON-1399133399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4acab92-2722-4fe0-87b4-79de130d7e9c.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:34 devstack sudo[92767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4acab92-2722-4fe0-87b4-79de130d7e9c.info Jul 08 18:38:34 devstack sudo[92767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:34 devstack sudo[92767]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-a304afbd-3692-4594-9ea9-311b166b1a99 tempest-VolumesSnapshotTestJSON-1399133399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4acab92-2722-4fe0-87b4-79de130d7e9c.info" returned: 0 in 0.796s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-a304afbd-3692-4594-9ea9-311b166b1a99 tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.536s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:38:35 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-a304afbd-3692-4594-9ea9-311b166b1a99 tempest-VolumesSnapshotTestJSON-1399133399 None] Create snapshot completed successfully Jul 08 18:38:36 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-87dd9afd-736c-47b1-b3f6-d56113f0ab74 tempest-VolumesSnapshotTestJSON-1399133399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:38:36 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-87dd9afd-736c-47b1-b3f6-d56113f0ab74 tempest-VolumesSnapshotTestJSON-1399133399 None] Flow 'volume_create_manager' (b4e5a756-258a-4527-86c5-ebf83413f8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:38:36 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-87dd9afd-736c-47b1-b3f6-d56113f0ab74 tempest-VolumesSnapshotTestJSON-1399133399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5bd644d-ebc7-4af0-a174-4b0a2151c78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:38:36 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-87dd9afd-736c-47b1-b3f6-d56113f0ab74 tempest-VolumesSnapshotTestJSON-1399133399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5bd644d-ebc7-4af0-a174-4b0a2151c78a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:38:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-540084248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0f0d7e8-21e8-4995-bf26-85d65d76ef8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfae85ad945e4d2585d3823b7b4ef62e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:38:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=6afeb3c5-6915-4caa-b16e-bf4422b5ea12,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:38:37Z,use_quota=True,user_id='6a6b7648c1c2476ab78c03983697ff4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:38:36 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-87dd9afd-736c-47b1-b3f6-d56113f0ab74 tempest-VolumesSnapshotTestJSON-1399133399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (384cd465-6092-4553-8b38-c0af80f631a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:38:36 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-87dd9afd-736c-47b1-b3f6-d56113f0ab74 tempest-VolumesSnapshotTestJSON-1399133399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (384cd465-6092-4553-8b38-c0af80f631a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:38:36 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-87dd9afd-736c-47b1-b3f6-d56113f0ab74 tempest-VolumesSnapshotTestJSON-1399133399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58fbb0c9-2fec-4dbe-b26a-ba0f75b0bb42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:38:36 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-87dd9afd-736c-47b1-b3f6-d56113f0ab74 tempest-VolumesSnapshotTestJSON-1399133399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58fbb0c9-2fec-4dbe-b26a-ba0f75b0bb42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c0f0d7e8-21e8-4995-bf26-85d65d76ef8a', 'volume_name': 'volume-c0f0d7e8-21e8-4995-bf26-85d65d76ef8a', 'volume_size': 2, 'snapshot_id': '6afeb3c5-6915-4caa-b16e-bf4422b5ea12'}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:38:36 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-87dd9afd-736c-47b1-b3f6-d56113f0ab74 tempest-VolumesSnapshotTestJSON-1399133399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (173cf60d-0126-4415-8e04-2b6abdc1f2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:38:36 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-87dd9afd-736c-47b1-b3f6-d56113f0ab74 tempest-VolumesSnapshotTestJSON-1399133399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (173cf60d-0126-4415-8e04-2b6abdc1f2ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:38:36 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-87dd9afd-736c-47b1-b3f6-d56113f0ab74 tempest-VolumesSnapshotTestJSON-1399133399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (329746de-8d7a-417c-a251-1c9986cee527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:38:36 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-87dd9afd-736c-47b1-b3f6-d56113f0ab74 tempest-VolumesSnapshotTestJSON-1399133399 None] Volume c0f0d7e8-21e8-4995-bf26-85d65d76ef8a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c0f0d7e8-21e8-4995-bf26-85d65d76ef8a', 'volume_size': 2, 'snapshot_id': '6afeb3c5-6915-4caa-b16e-bf4422b5ea12'} Jul 08 18:38:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-87dd9afd-736c-47b1-b3f6-d56113f0ab74 tempest-VolumesSnapshotTestJSON-1399133399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:38:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-87dd9afd-736c-47b1-b3f6-d56113f0ab74 tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:38:36 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-87dd9afd-736c-47b1-b3f6-d56113f0ab74 tempest-VolumesSnapshotTestJSON-1399133399 None] Acquiring lock "cinder-quobyte-6afeb3c5-6915-4caa-b16e-bf4422b5ea12-c0f0d7e8-21e8-4995-bf26-85d65d76ef8a" by "_create_volume_from_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:38:36 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-87dd9afd-736c-47b1-b3f6-d56113f0ab74 tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "cinder-quobyte-6afeb3c5-6915-4caa-b16e-bf4422b5ea12-c0f0d7e8-21e8-4995-bf26-85d65d76ef8a" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:38:36 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-87dd9afd-736c-47b1-b3f6-d56113f0ab74 tempest-VolumesSnapshotTestJSON-1399133399 None] Creating volume c0f0d7e8-21e8-4995-bf26-85d65d76ef8a from snapshot 6afeb3c5-6915-4caa-b16e-bf4422b5ea12 {{(pid=86873) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 18:38:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-87dd9afd-736c-47b1-b3f6-d56113f0ab74 tempest-VolumesSnapshotTestJSON-1399133399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:38:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-87dd9afd-736c-47b1-b3f6-d56113f0ab74 tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:38:36 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-87dd9afd-736c-47b1-b3f6-d56113f0ab74 tempest-VolumesSnapshotTestJSON-1399133399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:38:36 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-87dd9afd-736c-47b1-b3f6-d56113f0ab74 tempest-VolumesSnapshotTestJSON-1399133399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:38:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-87dd9afd-736c-47b1-b3f6-d56113f0ab74 tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:38:36 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-87dd9afd-736c-47b1-b3f6-d56113f0ab74 tempest-VolumesSnapshotTestJSON-1399133399 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:38:36 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-87dd9afd-736c-47b1-b3f6-d56113f0ab74 tempest-VolumesSnapshotTestJSON-1399133399 None] Acquiring lock "cinder-quobyte-c0f0d7e8-21e8-4995-bf26-85d65d76ef8a" by "_copy_volume_from_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:38:36 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-87dd9afd-736c-47b1-b3f6-d56113f0ab74 tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "cinder-quobyte-c0f0d7e8-21e8-4995-bf26-85d65d76ef8a" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:38:36 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-87dd9afd-736c-47b1-b3f6-d56113f0ab74 tempest-VolumesSnapshotTestJSON-1399133399 None] snapshot: 6afeb3c5-6915-4caa-b16e-bf4422b5ea12, volume: c0f0d7e8-21e8-4995-bf26-85d65d76ef8a, {{(pid=86873) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 18:38:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-87dd9afd-736c-47b1-b3f6-d56113f0ab74 tempest-VolumesSnapshotTestJSON-1399133399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:38:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-87dd9afd-736c-47b1-b3f6-d56113f0ab74 tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:38:37 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-87dd9afd-736c-47b1-b3f6-d56113f0ab74 tempest-VolumesSnapshotTestJSON-1399133399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:38:37 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-87dd9afd-736c-47b1-b3f6-d56113f0ab74 tempest-VolumesSnapshotTestJSON-1399133399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:38:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-87dd9afd-736c-47b1-b3f6-d56113f0ab74 tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:38:37 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2b0126-b400-41a6-819f-1d5ba9b95eb7]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:38:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-87dd9afd-736c-47b1-b3f6-d56113f0ab74 tempest-VolumesSnapshotTestJSON-1399133399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4acab92-2722-4fe0-87b4-79de130d7e9c.6afeb3c5-6915-4caa-b16e-bf4422b5ea12 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:37 devstack sudo[92770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4acab92-2722-4fe0-87b4-79de130d7e9c.6afeb3c5-6915-4caa-b16e-bf4422b5ea12 Jul 08 18:38:37 devstack sudo[92770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:37 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-acb90ab1-48be-4d04-9d33-8ef3fa1669f9 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:38:37 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-acb90ab1-48be-4d04-9d33-8ef3fa1669f9 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Flow 'volume_create_manager' (9b736ab2-bb87-4258-9242-89d06acc3f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:38:37 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-acb90ab1-48be-4d04-9d33-8ef3fa1669f9 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (392ca472-9022-4aea-b682-71808318f447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:38:37 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-acb90ab1-48be-4d04-9d33-8ef3fa1669f9 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (392ca472-9022-4aea-b682-71808318f447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:38:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-845053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a43cbf4-993a-48bd-84e6-49e95ba57dae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06a40b048dc84b69a2df4d35f46b4231',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:38:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:38:37Z,use_quota=True,user_id='681a2166427040f4ab249df8a7e76572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:38:37 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-acb90ab1-48be-4d04-9d33-8ef3fa1669f9 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cc2f6ce-e782-4290-ac21-3b222bcfd698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:38:37 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-acb90ab1-48be-4d04-9d33-8ef3fa1669f9 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cc2f6ce-e782-4290-ac21-3b222bcfd698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:38:37 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-acb90ab1-48be-4d04-9d33-8ef3fa1669f9 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4baebce1-4483-46c1-b1bf-60568b2e3f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:38:37 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-acb90ab1-48be-4d04-9d33-8ef3fa1669f9 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4baebce1-4483-46c1-b1bf-60568b2e3f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a43cbf4-993a-48bd-84e6-49e95ba57dae', 'volume_name': 'volume-5a43cbf4-993a-48bd-84e6-49e95ba57dae', 'volume_size': 2}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:38:37 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-acb90ab1-48be-4d04-9d33-8ef3fa1669f9 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47fde16d-fbab-4127-9101-b18d9b3ea7d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:38:37 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-acb90ab1-48be-4d04-9d33-8ef3fa1669f9 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47fde16d-fbab-4127-9101-b18d9b3ea7d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:38:37 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-acb90ab1-48be-4d04-9d33-8ef3fa1669f9 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af1f265b-a01c-48ae-b5c6-f061e96e4c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:38:37 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-acb90ab1-48be-4d04-9d33-8ef3fa1669f9 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Volume 5a43cbf4-993a-48bd-84e6-49e95ba57dae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a43cbf4-993a-48bd-84e6-49e95ba57dae', 'volume_size': 2} Jul 08 18:38:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-acb90ab1-48be-4d04-9d33-8ef3fa1669f9 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:38:37 devstack sudo[92770]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-87dd9afd-736c-47b1-b3f6-d56113f0ab74 tempest-VolumesSnapshotTestJSON-1399133399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4acab92-2722-4fe0-87b4-79de130d7e9c.6afeb3c5-6915-4caa-b16e-bf4422b5ea12" returned: 0 in 0.840s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:37 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-87dd9afd-736c-47b1-b3f6-d56113f0ab74 tempest-VolumesSnapshotTestJSON-1399133399 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4acab92-2722-4fe0-87b4-79de130d7e9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:38:37 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-87dd9afd-736c-47b1-b3f6-d56113f0ab74 tempest-VolumesSnapshotTestJSON-1399133399 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4acab92-2722-4fe0-87b4-79de130d7e9c {{(pid=86873) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 18:38:37 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-87dd9afd-736c-47b1-b3f6-d56113f0ab74 tempest-VolumesSnapshotTestJSON-1399133399 None] Creating direct copy from snapshot {{(pid=86873) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 18:38:37 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[1acc5d48-8259-41b4-9db2-2ce4ea5e9830]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:38:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-87dd9afd-736c-47b1-b3f6-d56113f0ab74 tempest-VolumesSnapshotTestJSON-1399133399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4acab92-2722-4fe0-87b4-79de130d7e9c {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:38 devstack sudo[92775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4acab92-2722-4fe0-87b4-79de130d7e9c Jul 08 18:38:38 devstack sudo[92775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:38 devstack sudo[92775]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:38 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-87dd9afd-736c-47b1-b3f6-d56113f0ab74 tempest-VolumesSnapshotTestJSON-1399133399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4acab92-2722-4fe0-87b4-79de130d7e9c" returned: 0 in 0.878s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:38 devstack cinder-volume[86873]: DEBUG cinder.utils [None req-87dd9afd-736c-47b1-b3f6-d56113f0ab74 tempest-VolumesSnapshotTestJSON-1399133399 None] Path /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c0f0d7e8-21e8-4995-bf26-85d65d76ef8a not found in is_blk_device check {{(pid=86873) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 18:38:38 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-87dd9afd-736c-47b1-b3f6-d56113f0ab74 tempest-VolumesSnapshotTestJSON-1399133399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4acab92-2722-4fe0-87b4-79de130d7e9c /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c0f0d7e8-21e8-4995-bf26-85d65d76ef8a {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:38 devstack sudo[92780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4acab92-2722-4fe0-87b4-79de130d7e9c /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c0f0d7e8-21e8-4995-bf26-85d65d76ef8a Jul 08 18:38:38 devstack sudo[92780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:46 devstack sudo[92780]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-87dd9afd-736c-47b1-b3f6-d56113f0ab74 tempest-VolumesSnapshotTestJSON-1399133399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4acab92-2722-4fe0-87b4-79de130d7e9c /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c0f0d7e8-21e8-4995-bf26-85d65d76ef8a" returned: 0 in 7.407s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:46 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[249f05d2-e02e-4600-b735-dbe34c747a38]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:38:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-87dd9afd-736c-47b1-b3f6-d56113f0ab74 tempest-VolumesSnapshotTestJSON-1399133399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4acab92-2722-4fe0-87b4-79de130d7e9c {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:46 devstack sudo[92842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4acab92-2722-4fe0-87b4-79de130d7e9c Jul 08 18:38:46 devstack sudo[92842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:47 devstack sudo[92842]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-87dd9afd-736c-47b1-b3f6-d56113f0ab74 tempest-VolumesSnapshotTestJSON-1399133399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4acab92-2722-4fe0-87b4-79de130d7e9c" returned: 0 in 0.918s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:47 devstack cinder-volume[86873]: DEBUG cinder.image.image_utils [None req-87dd9afd-736c-47b1-b3f6-d56113f0ab74 tempest-VolumesSnapshotTestJSON-1399133399 None] Image conversion details: src /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4acab92-2722-4fe0-87b4-79de130d7e9c, size 1024.00 MB, duration 7.41 sec, destination /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c0f0d7e8-21e8-4995-bf26-85d65d76ef8a {{(pid=86873) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:38:47 devstack cinder-volume[86873]: INFO cinder.image.image_utils [None req-87dd9afd-736c-47b1-b3f6-d56113f0ab74 tempest-VolumesSnapshotTestJSON-1399133399 None] Converted 1024.00 MB image at 138.22 MB/s Jul 08 18:38:47 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-87dd9afd-736c-47b1-b3f6-d56113f0ab74 tempest-VolumesSnapshotTestJSON-1399133399 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c0f0d7e8-21e8-4995-bf26-85d65d76ef8a is being set with open permissions: ugo+rw Jul 08 18:38:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-87dd9afd-736c-47b1-b3f6-d56113f0ab74 tempest-VolumesSnapshotTestJSON-1399133399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c0f0d7e8-21e8-4995-bf26-85d65d76ef8a {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:47 devstack sudo[92847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c0f0d7e8-21e8-4995-bf26-85d65d76ef8a Jul 08 18:38:47 devstack sudo[92847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:47 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:SELECT=32,cinder:UPDATE=39,cinder:INSERT=10,cinder:DELETE=2 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:38:47 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:SELECT=36,cinder:INSERT=9,cinder:UPDATE=37,cinder:DELETE=4 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:38:47 devstack sudo[92847]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-87dd9afd-736c-47b1-b3f6-d56113f0ab74 tempest-VolumesSnapshotTestJSON-1399133399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c0f0d7e8-21e8-4995-bf26-85d65d76ef8a" returned: 0 in 0.712s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:47 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-87dd9afd-736c-47b1-b3f6-d56113f0ab74 tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "cinder-quobyte-c0f0d7e8-21e8-4995-bf26-85d65d76ef8a" released by "_copy_volume_from_snapshot" :: held 10.885s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:38:47 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-87dd9afd-736c-47b1-b3f6-d56113f0ab74 tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "cinder-quobyte-6afeb3c5-6915-4caa-b16e-bf4422b5ea12-c0f0d7e8-21e8-4995-bf26-85d65d76ef8a" released by "_create_volume_from_snapshot" :: held 10.933s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:38:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-87dd9afd-736c-47b1-b3f6-d56113f0ab74 tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.965s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:38:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-acb90ab1-48be-4d04-9d33-8ef3fa1669f9 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.488s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:38:47 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-acb90ab1-48be-4d04-9d33-8ef3fa1669f9 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:38:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-845053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a43cbf4-993a-48bd-84e6-49e95ba57dae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06a40b048dc84b69a2df4d35f46b4231',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:38:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:38:37Z,use_quota=True,user_id='681a2166427040f4ab249df8a7e76572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:38:47 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-acb90ab1-48be-4d04-9d33-8ef3fa1669f9 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Creating volume 5a43cbf4-993a-48bd-84e6-49e95ba57dae {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:38:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-acb90ab1-48be-4d04-9d33-8ef3fa1669f9 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:38:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-acb90ab1-48be-4d04-9d33-8ef3fa1669f9 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:38:47 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-acb90ab1-48be-4d04-9d33-8ef3fa1669f9 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:38:47 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-acb90ab1-48be-4d04-9d33-8ef3fa1669f9 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:38:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-acb90ab1-48be-4d04-9d33-8ef3fa1669f9 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:38:47 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-acb90ab1-48be-4d04-9d33-8ef3fa1669f9 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:38:47 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-acb90ab1-48be-4d04-9d33-8ef3fa1669f9 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:38:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-acb90ab1-48be-4d04-9d33-8ef3fa1669f9 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a43cbf4-993a-48bd-84e6-49e95ba57dae 2147483648 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:47 devstack sudo[92850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a43cbf4-993a-48bd-84e6-49e95ba57dae 2147483648 Jul 08 18:38:47 devstack sudo[92850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-87dd9afd-736c-47b1-b3f6-d56113f0ab74 tempest-VolumesSnapshotTestJSON-1399133399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (329746de-8d7a-417c-a251-1c9986cee527) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0f0d7e8-21e8-4995-bf26-85d65d76ef8a', 'volume_size': 2, 'snapshot_id': '6afeb3c5-6915-4caa-b16e-bf4422b5ea12'}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:38:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-87dd9afd-736c-47b1-b3f6-d56113f0ab74 tempest-VolumesSnapshotTestJSON-1399133399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (183a4820-d04b-4ba9-9e81-f846a395e9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:38:47 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-87dd9afd-736c-47b1-b3f6-d56113f0ab74 tempest-VolumesSnapshotTestJSON-1399133399 None] Volume volume-c0f0d7e8-21e8-4995-bf26-85d65d76ef8a (c0f0d7e8-21e8-4995-bf26-85d65d76ef8a): created successfully Jul 08 18:38:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-87dd9afd-736c-47b1-b3f6-d56113f0ab74 tempest-VolumesSnapshotTestJSON-1399133399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (183a4820-d04b-4ba9-9e81-f846a395e9ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:38:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-87dd9afd-736c-47b1-b3f6-d56113f0ab74 tempest-VolumesSnapshotTestJSON-1399133399 None] Flow 'volume_create_manager' (b4e5a756-258a-4527-86c5-ebf83413f8e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:38:48 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-87dd9afd-736c-47b1-b3f6-d56113f0ab74 tempest-VolumesSnapshotTestJSON-1399133399 None] Created volume successfully. Jul 08 18:38:48 devstack cinder-volume[86873]: DEBUG oslo_service.periodic_task [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86873) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:38:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:38:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:38:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:38:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:38:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:38:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:48 devstack sudo[92852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:38:48 devstack sudo[92852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:48 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-07e240d7-89ad-490d-bd99-77eba682e498 tempest-VolumesSnapshotTestJSON-1399133399 None] Acquiring lock "cinder-c0f0d7e8-21e8-4995-bf26-85d65d76ef8a-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:38:48 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-07e240d7-89ad-490d-bd99-77eba682e498 tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "cinder-c0f0d7e8-21e8-4995-bf26-85d65d76ef8a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:38:48 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-07e240d7-89ad-490d-bd99-77eba682e498 tempest-VolumesSnapshotTestJSON-1399133399 None] Acquiring lock "cinder-quobyte-c0f0d7e8-21e8-4995-bf26-85d65d76ef8a" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:38:48 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-07e240d7-89ad-490d-bd99-77eba682e498 tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "cinder-quobyte-c0f0d7e8-21e8-4995-bf26-85d65d76ef8a" acquired by "delete_volume" :: waited 0.021s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:38:48 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b197d4e-bbc5-443a-a692-5720fd4e5ab1]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:38:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-07e240d7-89ad-490d-bd99-77eba682e498 tempest-VolumesSnapshotTestJSON-1399133399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c0f0d7e8-21e8-4995-bf26-85d65d76ef8a {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:48 devstack sudo[92854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c0f0d7e8-21e8-4995-bf26-85d65d76ef8a Jul 08 18:38:48 devstack sudo[92854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:48 devstack sudo[92850]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-acb90ab1-48be-4d04-9d33-8ef3fa1669f9 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a43cbf4-993a-48bd-84e6-49e95ba57dae 2147483648" returned: 0 in 0.973s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-acb90ab1-48be-4d04-9d33-8ef3fa1669f9 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a43cbf4-993a-48bd-84e6-49e95ba57dae {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:48 devstack sudo[92852]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.744s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:48 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:38:48 devstack cinder-volume[86873]: DEBUG oslo_service.periodic_task [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running periodic task VolumeManager._thread_info {{(pid=86873) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:38:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] thread count: 9 {{(pid=86873) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:38:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] thread info: [<_MainThread(MainThread, started 138577734545536)>, , , , , , , , ] {{(pid=86873) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:38:48 devstack sudo[92861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a43cbf4-993a-48bd-84e6-49e95ba57dae Jul 08 18:38:48 devstack sudo[92861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:49 devstack sudo[92854]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-07e240d7-89ad-490d-bd99-77eba682e498 tempest-VolumesSnapshotTestJSON-1399133399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c0f0d7e8-21e8-4995-bf26-85d65d76ef8a" returned: 0 in 0.902s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-07e240d7-89ad-490d-bd99-77eba682e498 tempest-VolumesSnapshotTestJSON-1399133399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c0f0d7e8-21e8-4995-bf26-85d65d76ef8a {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:49 devstack sudo[92866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c0f0d7e8-21e8-4995-bf26-85d65d76ef8a Jul 08 18:38:49 devstack sudo[92866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:49 devstack sudo[92861]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-acb90ab1-48be-4d04-9d33-8ef3fa1669f9 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a43cbf4-993a-48bd-84e6-49e95ba57dae" returned: 0 in 0.674s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:49 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-acb90ab1-48be-4d04-9d33-8ef3fa1669f9 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] <== create_volume: return (1698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:38:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-acb90ab1-48be-4d04-9d33-8ef3fa1669f9 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.701s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:38:49 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-acb90ab1-48be-4d04-9d33-8ef3fa1669f9 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af1f265b-a01c-48ae-b5c6-f061e96e4c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a43cbf4-993a-48bd-84e6-49e95ba57dae', 'volume_size': 2}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:38:49 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-acb90ab1-48be-4d04-9d33-8ef3fa1669f9 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48ee09fa-d28b-4dfa-b156-63dc4c771277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:38:49 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-acb90ab1-48be-4d04-9d33-8ef3fa1669f9 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Volume volume-5a43cbf4-993a-48bd-84e6-49e95ba57dae (5a43cbf4-993a-48bd-84e6-49e95ba57dae): created successfully Jul 08 18:38:49 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-acb90ab1-48be-4d04-9d33-8ef3fa1669f9 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48ee09fa-d28b-4dfa-b156-63dc4c771277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:38:49 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-acb90ab1-48be-4d04-9d33-8ef3fa1669f9 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Flow 'volume_create_manager' (9b736ab2-bb87-4258-9242-89d06acc3f2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:38:49 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-acb90ab1-48be-4d04-9d33-8ef3fa1669f9 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Created volume successfully. Jul 08 18:38:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-61cb13bb-6c54-45db-8422-d5d5cd2c0cc6 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:38:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-61cb13bb-6c54-45db-8422-d5d5cd2c0cc6 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:38:50 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-61cb13bb-6c54-45db-8422-d5d5cd2c0cc6 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Creating offline snapshot 5c37aa55-3f28-46ce-8e1f-ea7decafe3d5 of volume 5a43cbf4-993a-48bd-84e6-49e95ba57dae {{(pid=86873) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:38:50 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[93026475-bb2c-498a-adb4-68a7fb59a6f4]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:38:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-61cb13bb-6c54-45db-8422-d5d5cd2c0cc6 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a43cbf4-993a-48bd-84e6-49e95ba57dae {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:50 devstack sudo[92866]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-07e240d7-89ad-490d-bd99-77eba682e498 tempest-VolumesSnapshotTestJSON-1399133399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c0f0d7e8-21e8-4995-bf26-85d65d76ef8a" returned: 0 in 0.813s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:50 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-07e240d7-89ad-490d-bd99-77eba682e498 tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "cinder-quobyte-c0f0d7e8-21e8-4995-bf26-85d65d76ef8a" released by "delete_volume" :: held 1.797s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:38:50 devstack sudo[92870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a43cbf4-993a-48bd-84e6-49e95ba57dae Jul 08 18:38:50 devstack sudo[92870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:50 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-07e240d7-89ad-490d-bd99-77eba682e498 tempest-VolumesSnapshotTestJSON-1399133399 None] Created reservations ['c1315bda-fe1f-4f49-b9ba-4cd75aae785b', '4e730dab-ef42-45f2-97d9-b4b7a9970401', '71b4dc64-2f23-4673-9256-8570c7e7d210', '7ce9e333-d28d-4473-97ca-a1211b8ecd11'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:38:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-07e240d7-89ad-490d-bd99-77eba682e498 tempest-VolumesSnapshotTestJSON-1399133399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:38:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-07e240d7-89ad-490d-bd99-77eba682e498 tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:38:50 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-07e240d7-89ad-490d-bd99-77eba682e498 tempest-VolumesSnapshotTestJSON-1399133399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:38:50 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-07e240d7-89ad-490d-bd99-77eba682e498 tempest-VolumesSnapshotTestJSON-1399133399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:38:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-07e240d7-89ad-490d-bd99-77eba682e498 tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:38:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-07e240d7-89ad-490d-bd99-77eba682e498 tempest-VolumesSnapshotTestJSON-1399133399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:50 devstack sudo[92872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:38:50 devstack sudo[92872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:50 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-fd49b463-223c-4ac9-8d43-ae3a14e4a158 tempest-VolumesSnapshotTestJSON-1399133399 None] Acquiring lock "cinder-6afeb3c5-6915-4caa-b16e-bf4422b5ea12-delete_snapshot" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:38:50 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-fd49b463-223c-4ac9-8d43-ae3a14e4a158 tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "cinder-6afeb3c5-6915-4caa-b16e-bf4422b5ea12-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:38:50 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-fd49b463-223c-4ac9-8d43-ae3a14e4a158 tempest-VolumesSnapshotTestJSON-1399133399 None] Acquiring lock "cinder-quobyte-d4acab92-2722-4fe0-87b4-79de130d7e9c" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:38:50 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-fd49b463-223c-4ac9-8d43-ae3a14e4a158 tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "cinder-quobyte-d4acab92-2722-4fe0-87b4-79de130d7e9c" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:38:50 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-fd49b463-223c-4ac9-8d43-ae3a14e4a158 tempest-VolumesSnapshotTestJSON-1399133399 None] Acquiring lock "cinder-quobyte-6afeb3c5-6915-4caa-b16e-bf4422b5ea12" by "_delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:38:50 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-fd49b463-223c-4ac9-8d43-ae3a14e4a158 tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "cinder-quobyte-6afeb3c5-6915-4caa-b16e-bf4422b5ea12" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:38:50 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-fd49b463-223c-4ac9-8d43-ae3a14e4a158 tempest-VolumesSnapshotTestJSON-1399133399 None] Deleting offline snapshot 6afeb3c5-6915-4caa-b16e-bf4422b5ea12 of volume d4acab92-2722-4fe0-87b4-79de130d7e9c {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:38:50 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-fd49b463-223c-4ac9-8d43-ae3a14e4a158 tempest-VolumesSnapshotTestJSON-1399133399 None] snapshot_file for this snap is: volume-d4acab92-2722-4fe0-87b4-79de130d7e9c.6afeb3c5-6915-4caa-b16e-bf4422b5ea12 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:38:50 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b29649-2fef-449c-94b8-eccb5c32c874]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:38:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-fd49b463-223c-4ac9-8d43-ae3a14e4a158 tempest-VolumesSnapshotTestJSON-1399133399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4acab92-2722-4fe0-87b4-79de130d7e9c.6afeb3c5-6915-4caa-b16e-bf4422b5ea12 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:51 devstack sudo[92874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4acab92-2722-4fe0-87b4-79de130d7e9c.6afeb3c5-6915-4caa-b16e-bf4422b5ea12 Jul 08 18:38:51 devstack sudo[92874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:51 devstack sudo[92872]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-07e240d7-89ad-490d-bd99-77eba682e498 tempest-VolumesSnapshotTestJSON-1399133399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 1.027s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:51 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-07e240d7-89ad-490d-bd99-77eba682e498 tempest-VolumesSnapshotTestJSON-1399133399 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:38:51 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-07e240d7-89ad-490d-bd99-77eba682e498 tempest-VolumesSnapshotTestJSON-1399133399 None] Deleted volume successfully. Jul 08 18:38:51 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-07e240d7-89ad-490d-bd99-77eba682e498 tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "cinder-c0f0d7e8-21e8-4995-bf26-85d65d76ef8a-delete_volume" released by "delete_volume" :: held 3.185s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:38:51 devstack sudo[92870]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-61cb13bb-6c54-45db-8422-d5d5cd2c0cc6 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a43cbf4-993a-48bd-84e6-49e95ba57dae" returned: 0 in 1.456s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-61cb13bb-6c54-45db-8422-d5d5cd2c0cc6 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a43cbf4-993a-48bd-84e6-49e95ba57dae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a43cbf4-993a-48bd-84e6-49e95ba57dae.5c37aa55-3f28-46ce-8e1f-ea7decafe3d5 2G {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:51 devstack sudo[92883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a43cbf4-993a-48bd-84e6-49e95ba57dae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a43cbf4-993a-48bd-84e6-49e95ba57dae.5c37aa55-3f28-46ce-8e1f-ea7decafe3d5 2G Jul 08 18:38:51 devstack sudo[92883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:52 devstack sudo[92874]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-fd49b463-223c-4ac9-8d43-ae3a14e4a158 tempest-VolumesSnapshotTestJSON-1399133399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4acab92-2722-4fe0-87b4-79de130d7e9c.6afeb3c5-6915-4caa-b16e-bf4422b5ea12" returned: 0 in 1.377s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:52 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-fd49b463-223c-4ac9-8d43-ae3a14e4a158 tempest-VolumesSnapshotTestJSON-1399133399 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4acab92-2722-4fe0-87b4-79de130d7e9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:38:52 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[954ea7cb-a3e8-4859-bcf2-28bcfad105f0]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:38:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-fd49b463-223c-4ac9-8d43-ae3a14e4a158 tempest-VolumesSnapshotTestJSON-1399133399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4acab92-2722-4fe0-87b4-79de130d7e9c {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:52 devstack sudo[92890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4acab92-2722-4fe0-87b4-79de130d7e9c Jul 08 18:38:52 devstack sudo[92890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:52 devstack sudo[92883]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-61cb13bb-6c54-45db-8422-d5d5cd2c0cc6 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a43cbf4-993a-48bd-84e6-49e95ba57dae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a43cbf4-993a-48bd-84e6-49e95ba57dae.5c37aa55-3f28-46ce-8e1f-ea7decafe3d5 2G" returned: 0 in 1.350s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-61cb13bb-6c54-45db-8422-d5d5cd2c0cc6 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a43cbf4-993a-48bd-84e6-49e95ba57dae -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a43cbf4-993a-48bd-84e6-49e95ba57dae.5c37aa55-3f28-46ce-8e1f-ea7decafe3d5 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:53 devstack sudo[92909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a43cbf4-993a-48bd-84e6-49e95ba57dae -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a43cbf4-993a-48bd-84e6-49e95ba57dae.5c37aa55-3f28-46ce-8e1f-ea7decafe3d5 Jul 08 18:38:53 devstack sudo[92909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:53 devstack sudo[92890]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:53 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-fd49b463-223c-4ac9-8d43-ae3a14e4a158 tempest-VolumesSnapshotTestJSON-1399133399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4acab92-2722-4fe0-87b4-79de130d7e9c" returned: 0 in 1.039s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:53 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-fd49b463-223c-4ac9-8d43-ae3a14e4a158 tempest-VolumesSnapshotTestJSON-1399133399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4acab92-2722-4fe0-87b4-79de130d7e9c.6afeb3c5-6915-4caa-b16e-bf4422b5ea12 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:53 devstack sudo[92923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4acab92-2722-4fe0-87b4-79de130d7e9c.6afeb3c5-6915-4caa-b16e-bf4422b5ea12 Jul 08 18:38:53 devstack sudo[92923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:53 devstack sudo[92909]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:53 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-61cb13bb-6c54-45db-8422-d5d5cd2c0cc6 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a43cbf4-993a-48bd-84e6-49e95ba57dae -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a43cbf4-993a-48bd-84e6-49e95ba57dae.5c37aa55-3f28-46ce-8e1f-ea7decafe3d5" returned: 0 in 0.843s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:53 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-61cb13bb-6c54-45db-8422-d5d5cd2c0cc6 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a43cbf4-993a-48bd-84e6-49e95ba57dae.5c37aa55-3f28-46ce-8e1f-ea7decafe3d5 is being set with open permissions: ugo+rw Jul 08 18:38:53 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-61cb13bb-6c54-45db-8422-d5d5cd2c0cc6 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a43cbf4-993a-48bd-84e6-49e95ba57dae.5c37aa55-3f28-46ce-8e1f-ea7decafe3d5 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:53 devstack sudo[92929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a43cbf4-993a-48bd-84e6-49e95ba57dae.5c37aa55-3f28-46ce-8e1f-ea7decafe3d5 Jul 08 18:38:53 devstack sudo[92929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:54 devstack cinder-volume[86873]: INFO cinder.volume.manager [req-aa26f0b8-a875-41dc-af36-9e6e99f00c3a req-38d182e5-23d6-4cdb-a43d-091006e4656c tempest-AttachVolumeNegativeTest-1161175669 None] Terminate volume connection completed successfully. Jul 08 18:38:54 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-aa26f0b8-a875-41dc-af36-9e6e99f00c3a req-38d182e5-23d6-4cdb-a43d-091006e4656c tempest-AttachVolumeNegativeTest-1161175669 None] Deleting attachment 74b1ca33-77fd-41c7-9cd7-422a57980c4d. {{(pid=86873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 18:38:54 devstack cinder-volume[86873]: INFO cinder.volume.manager [req-f609a009-5526-4bc8-ac70-123e877b71d9 req-78e2aa9e-686f-4632-9e55-1f4c0041a434 tempest-ServerActionsTestOtherA-1985324233 None] Terminate volume connection completed successfully. Jul 08 18:38:54 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-f609a009-5526-4bc8-ac70-123e877b71d9 req-78e2aa9e-686f-4632-9e55-1f4c0041a434 tempest-ServerActionsTestOtherA-1985324233 None] Deleting attachment 40a15851-b6bd-4ecf-abd2-c07b39741d72. {{(pid=86873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 18:38:54 devstack sudo[92923]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-fd49b463-223c-4ac9-8d43-ae3a14e4a158 tempest-VolumesSnapshotTestJSON-1399133399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4acab92-2722-4fe0-87b4-79de130d7e9c.6afeb3c5-6915-4caa-b16e-bf4422b5ea12" returned: 0 in 0.905s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-fd49b463-223c-4ac9-8d43-ae3a14e4a158 tempest-VolumesSnapshotTestJSON-1399133399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4acab92-2722-4fe0-87b4-79de130d7e9c.6afeb3c5-6915-4caa-b16e-bf4422b5ea12 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:54 devstack sudo[92939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4acab92-2722-4fe0-87b4-79de130d7e9c.6afeb3c5-6915-4caa-b16e-bf4422b5ea12 Jul 08 18:38:54 devstack sudo[92939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:54 devstack sudo[92929]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-61cb13bb-6c54-45db-8422-d5d5cd2c0cc6 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a43cbf4-993a-48bd-84e6-49e95ba57dae.5c37aa55-3f28-46ce-8e1f-ea7decafe3d5" returned: 0 in 0.791s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-61cb13bb-6c54-45db-8422-d5d5cd2c0cc6 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a43cbf4-993a-48bd-84e6-49e95ba57dae.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:54 devstack sudo[92942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a43cbf4-993a-48bd-84e6-49e95ba57dae.info Jul 08 18:38:54 devstack sudo[92942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:55 devstack sudo[92939]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-fd49b463-223c-4ac9-8d43-ae3a14e4a158 tempest-VolumesSnapshotTestJSON-1399133399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4acab92-2722-4fe0-87b4-79de130d7e9c.6afeb3c5-6915-4caa-b16e-bf4422b5ea12" returned: 0 in 0.692s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:55 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-fd49b463-223c-4ac9-8d43-ae3a14e4a158 tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "cinder-quobyte-6afeb3c5-6915-4caa-b16e-bf4422b5ea12" released by "_delete_snapshot" :: held 4.164s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:38:55 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-fd49b463-223c-4ac9-8d43-ae3a14e4a158 tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "cinder-quobyte-d4acab92-2722-4fe0-87b4-79de130d7e9c" released by "delete_snapshot" :: held 4.214s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:38:55 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-fd49b463-223c-4ac9-8d43-ae3a14e4a158 tempest-VolumesSnapshotTestJSON-1399133399 None] Created reservations ['9532888b-5040-4714-a750-46a81135227f', '48a25dab-5c2f-47a8-8599-4ed56f766b1a', 'f2f23a00-6fc6-4b2a-83b0-cd71167dc616', 'fea2b35a-f7b5-4e73-abd3-2f6976e21e89'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:38:55 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-fd49b463-223c-4ac9-8d43-ae3a14e4a158 tempest-VolumesSnapshotTestJSON-1399133399 None] Delete snapshot completed successfully. Jul 08 18:38:55 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-fd49b463-223c-4ac9-8d43-ae3a14e4a158 tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "cinder-6afeb3c5-6915-4caa-b16e-bf4422b5ea12-delete_snapshot" released by "delete_snapshot" :: held 4.414s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:38:55 devstack sudo[92942]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-61cb13bb-6c54-45db-8422-d5d5cd2c0cc6 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a43cbf4-993a-48bd-84e6-49e95ba57dae.info" returned: 0 in 0.728s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:55 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-61cb13bb-6c54-45db-8422-d5d5cd2c0cc6 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a43cbf4-993a-48bd-84e6-49e95ba57dae.info is being set with open permissions: ugo+rw Jul 08 18:38:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-61cb13bb-6c54-45db-8422-d5d5cd2c0cc6 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a43cbf4-993a-48bd-84e6-49e95ba57dae.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:55 devstack sudo[92946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a43cbf4-993a-48bd-84e6-49e95ba57dae.info Jul 08 18:38:55 devstack sudo[92946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:56 devstack sudo[92946]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-61cb13bb-6c54-45db-8422-d5d5cd2c0cc6 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a43cbf4-993a-48bd-84e6-49e95ba57dae.info" returned: 0 in 0.757s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-61cb13bb-6c54-45db-8422-d5d5cd2c0cc6 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.059s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:38:56 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-f14cb847-2c88-4fec-b6a7-6c645bddc234 tempest-VolumesSnapshotTestJSON-1399133399 None] Acquiring lock "cinder-d4acab92-2722-4fe0-87b4-79de130d7e9c-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:38:56 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-61cb13bb-6c54-45db-8422-d5d5cd2c0cc6 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Create snapshot completed successfully Jul 08 18:38:56 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-f14cb847-2c88-4fec-b6a7-6c645bddc234 tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "cinder-d4acab92-2722-4fe0-87b4-79de130d7e9c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:38:56 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-f14cb847-2c88-4fec-b6a7-6c645bddc234 tempest-VolumesSnapshotTestJSON-1399133399 None] Acquiring lock "cinder-quobyte-d4acab92-2722-4fe0-87b4-79de130d7e9c" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:38:56 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-f14cb847-2c88-4fec-b6a7-6c645bddc234 tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "cinder-quobyte-d4acab92-2722-4fe0-87b4-79de130d7e9c" acquired by "delete_volume" :: waited 0.018s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:38:56 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec55441-2b7b-4460-8d8b-021344eb1a7a]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:38:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f14cb847-2c88-4fec-b6a7-6c645bddc234 tempest-VolumesSnapshotTestJSON-1399133399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4acab92-2722-4fe0-87b4-79de130d7e9c {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:56 devstack sudo[92964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4acab92-2722-4fe0-87b4-79de130d7e9c Jul 08 18:38:56 devstack sudo[92964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:56 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b6eba096-dd28-4f9a-8f0e-c00cb390ab07 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Acquiring lock "cinder-5c37aa55-3f28-46ce-8e1f-ea7decafe3d5-delete_snapshot" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:38:56 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b6eba096-dd28-4f9a-8f0e-c00cb390ab07 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Lock "cinder-5c37aa55-3f28-46ce-8e1f-ea7decafe3d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:38:56 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b6eba096-dd28-4f9a-8f0e-c00cb390ab07 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Acquiring lock "cinder-quobyte-5a43cbf4-993a-48bd-84e6-49e95ba57dae" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:38:56 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b6eba096-dd28-4f9a-8f0e-c00cb390ab07 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Lock "cinder-quobyte-5a43cbf4-993a-48bd-84e6-49e95ba57dae" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:38:56 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b6eba096-dd28-4f9a-8f0e-c00cb390ab07 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Acquiring lock "cinder-quobyte-5c37aa55-3f28-46ce-8e1f-ea7decafe3d5" by "_delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:38:56 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b6eba096-dd28-4f9a-8f0e-c00cb390ab07 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Lock "cinder-quobyte-5c37aa55-3f28-46ce-8e1f-ea7decafe3d5" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:38:56 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-b6eba096-dd28-4f9a-8f0e-c00cb390ab07 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Deleting offline snapshot 5c37aa55-3f28-46ce-8e1f-ea7decafe3d5 of volume 5a43cbf4-993a-48bd-84e6-49e95ba57dae {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:38:57 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-b6eba096-dd28-4f9a-8f0e-c00cb390ab07 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] snapshot_file for this snap is: volume-5a43cbf4-993a-48bd-84e6-49e95ba57dae.5c37aa55-3f28-46ce-8e1f-ea7decafe3d5 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:38:57 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6469c46-e001-47e3-b7cf-726fd36ba1ab]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:38:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b6eba096-dd28-4f9a-8f0e-c00cb390ab07 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a43cbf4-993a-48bd-84e6-49e95ba57dae.5c37aa55-3f28-46ce-8e1f-ea7decafe3d5 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:57 devstack sudo[92989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a43cbf4-993a-48bd-84e6-49e95ba57dae.5c37aa55-3f28-46ce-8e1f-ea7decafe3d5 Jul 08 18:38:57 devstack sudo[92989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:57 devstack sudo[92964]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f14cb847-2c88-4fec-b6a7-6c645bddc234 tempest-VolumesSnapshotTestJSON-1399133399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4acab92-2722-4fe0-87b4-79de130d7e9c" returned: 0 in 0.967s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f14cb847-2c88-4fec-b6a7-6c645bddc234 tempest-VolumesSnapshotTestJSON-1399133399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4acab92-2722-4fe0-87b4-79de130d7e9c {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:57 devstack sudo[92997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4acab92-2722-4fe0-87b4-79de130d7e9c Jul 08 18:38:57 devstack sudo[92997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:57 devstack sudo[92989]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b6eba096-dd28-4f9a-8f0e-c00cb390ab07 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a43cbf4-993a-48bd-84e6-49e95ba57dae.5c37aa55-3f28-46ce-8e1f-ea7decafe3d5" returned: 0 in 0.867s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:57 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-b6eba096-dd28-4f9a-8f0e-c00cb390ab07 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a43cbf4-993a-48bd-84e6-49e95ba57dae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:38:58 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[3606468a-c983-44e2-aac1-1a8cd5b1e127]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:38:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b6eba096-dd28-4f9a-8f0e-c00cb390ab07 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a43cbf4-993a-48bd-84e6-49e95ba57dae {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:58 devstack sudo[93014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a43cbf4-993a-48bd-84e6-49e95ba57dae Jul 08 18:38:58 devstack sudo[93014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:58 devstack sudo[92997]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f14cb847-2c88-4fec-b6a7-6c645bddc234 tempest-VolumesSnapshotTestJSON-1399133399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4acab92-2722-4fe0-87b4-79de130d7e9c" returned: 0 in 0.920s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:58 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-f14cb847-2c88-4fec-b6a7-6c645bddc234 tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "cinder-quobyte-d4acab92-2722-4fe0-87b4-79de130d7e9c" released by "delete_volume" :: held 2.013s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:38:58 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-f14cb847-2c88-4fec-b6a7-6c645bddc234 tempest-VolumesSnapshotTestJSON-1399133399 None] Created reservations ['8a02ebb2-85bb-4b06-ba32-820adecfceb5', 'd79ba1e6-4d2a-4f58-a202-0c69d035314b', '5184fb1d-f750-4265-b0d9-d97c6d414bab', 'ac01af3c-1a6e-4382-9082-035f944dbfb2'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:38:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f14cb847-2c88-4fec-b6a7-6c645bddc234 tempest-VolumesSnapshotTestJSON-1399133399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:38:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f14cb847-2c88-4fec-b6a7-6c645bddc234 tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:38:58 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-f14cb847-2c88-4fec-b6a7-6c645bddc234 tempest-VolumesSnapshotTestJSON-1399133399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:38:58 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-f14cb847-2c88-4fec-b6a7-6c645bddc234 tempest-VolumesSnapshotTestJSON-1399133399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:38:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f14cb847-2c88-4fec-b6a7-6c645bddc234 tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:38:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f14cb847-2c88-4fec-b6a7-6c645bddc234 tempest-VolumesSnapshotTestJSON-1399133399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:58 devstack sudo[93041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:38:58 devstack sudo[93041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:59 devstack sudo[93014]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b6eba096-dd28-4f9a-8f0e-c00cb390ab07 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a43cbf4-993a-48bd-84e6-49e95ba57dae" returned: 0 in 1.335s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b6eba096-dd28-4f9a-8f0e-c00cb390ab07 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a43cbf4-993a-48bd-84e6-49e95ba57dae.5c37aa55-3f28-46ce-8e1f-ea7decafe3d5 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:59 devstack sudo[93052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a43cbf4-993a-48bd-84e6-49e95ba57dae.5c37aa55-3f28-46ce-8e1f-ea7decafe3d5 Jul 08 18:38:59 devstack sudo[93052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:59 devstack sudo[93041]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f14cb847-2c88-4fec-b6a7-6c645bddc234 tempest-VolumesSnapshotTestJSON-1399133399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.828s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:59 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-f14cb847-2c88-4fec-b6a7-6c645bddc234 tempest-VolumesSnapshotTestJSON-1399133399 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:38:59 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-f14cb847-2c88-4fec-b6a7-6c645bddc234 tempest-VolumesSnapshotTestJSON-1399133399 None] Deleted volume successfully. Jul 08 18:38:59 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-f14cb847-2c88-4fec-b6a7-6c645bddc234 tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "cinder-d4acab92-2722-4fe0-87b4-79de130d7e9c-delete_volume" released by "delete_volume" :: held 3.296s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:39:00 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-dde6c35c-8d16-42f5-9497-01a2536a0481 tempest-VolumesSnapshotTestJSON-1399133399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:39:00 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-dde6c35c-8d16-42f5-9497-01a2536a0481 tempest-VolumesSnapshotTestJSON-1399133399 None] Flow 'volume_create_manager' (a83f6308-0faf-48ec-bc70-ce5852354807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:39:00 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-dde6c35c-8d16-42f5-9497-01a2536a0481 tempest-VolumesSnapshotTestJSON-1399133399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68206970-995e-4d20-a2ca-e302fc99bbd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:39:00 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-dde6c35c-8d16-42f5-9497-01a2536a0481 tempest-VolumesSnapshotTestJSON-1399133399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68206970-995e-4d20-a2ca-e302fc99bbd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1542115827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfae85ad945e4d2585d3823b7b4ef62e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:39:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:39:00Z,use_quota=True,user_id='6a6b7648c1c2476ab78c03983697ff4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:39:00 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-dde6c35c-8d16-42f5-9497-01a2536a0481 tempest-VolumesSnapshotTestJSON-1399133399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71b814b2-9492-4d02-b157-68a61bae1fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:39:00 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-dde6c35c-8d16-42f5-9497-01a2536a0481 tempest-VolumesSnapshotTestJSON-1399133399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71b814b2-9492-4d02-b157-68a61bae1fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:39:00 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-dde6c35c-8d16-42f5-9497-01a2536a0481 tempest-VolumesSnapshotTestJSON-1399133399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fd6cbe9-c47b-451e-b82f-666e958daefc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:39:00 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-dde6c35c-8d16-42f5-9497-01a2536a0481 tempest-VolumesSnapshotTestJSON-1399133399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fd6cbe9-c47b-451e-b82f-666e958daefc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d', 'volume_name': 'volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:39:00 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-dde6c35c-8d16-42f5-9497-01a2536a0481 tempest-VolumesSnapshotTestJSON-1399133399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87a7bf51-6b79-4119-ac60-82ba8fecadeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:39:00 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-dde6c35c-8d16-42f5-9497-01a2536a0481 tempest-VolumesSnapshotTestJSON-1399133399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87a7bf51-6b79-4119-ac60-82ba8fecadeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:39:00 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-dde6c35c-8d16-42f5-9497-01a2536a0481 tempest-VolumesSnapshotTestJSON-1399133399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d74d3f4-1901-452f-91e7-f9553074f986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:39:00 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-dde6c35c-8d16-42f5-9497-01a2536a0481 tempest-VolumesSnapshotTestJSON-1399133399 None] Volume f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d', 'volume_size': 1} Jul 08 18:39:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-dde6c35c-8d16-42f5-9497-01a2536a0481 tempest-VolumesSnapshotTestJSON-1399133399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:39:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-dde6c35c-8d16-42f5-9497-01a2536a0481 tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:39:00 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-dde6c35c-8d16-42f5-9497-01a2536a0481 tempest-VolumesSnapshotTestJSON-1399133399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1542115827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfae85ad945e4d2585d3823b7b4ef62e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:39:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:39:00Z,use_quota=True,user_id='6a6b7648c1c2476ab78c03983697ff4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:39:00 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-dde6c35c-8d16-42f5-9497-01a2536a0481 tempest-VolumesSnapshotTestJSON-1399133399 None] Creating volume f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:39:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-dde6c35c-8d16-42f5-9497-01a2536a0481 tempest-VolumesSnapshotTestJSON-1399133399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:39:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-dde6c35c-8d16-42f5-9497-01a2536a0481 tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:39:00 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-dde6c35c-8d16-42f5-9497-01a2536a0481 tempest-VolumesSnapshotTestJSON-1399133399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:39:00 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-dde6c35c-8d16-42f5-9497-01a2536a0481 tempest-VolumesSnapshotTestJSON-1399133399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:39:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-dde6c35c-8d16-42f5-9497-01a2536a0481 tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:39:00 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-dde6c35c-8d16-42f5-9497-01a2536a0481 tempest-VolumesSnapshotTestJSON-1399133399 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:39:00 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-dde6c35c-8d16-42f5-9497-01a2536a0481 tempest-VolumesSnapshotTestJSON-1399133399 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:39:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dde6c35c-8d16-42f5-9497-01a2536a0481 tempest-VolumesSnapshotTestJSON-1399133399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:39:00 devstack sudo[93060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d 1073741824 Jul 08 18:39:00 devstack sudo[93060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:39:00 devstack sudo[93052]: pam_unix(sudo:session): session closed for user root Jul 08 18:39:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b6eba096-dd28-4f9a-8f0e-c00cb390ab07 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a43cbf4-993a-48bd-84e6-49e95ba57dae.5c37aa55-3f28-46ce-8e1f-ea7decafe3d5" returned: 0 in 1.302s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:39:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b6eba096-dd28-4f9a-8f0e-c00cb390ab07 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a43cbf4-993a-48bd-84e6-49e95ba57dae.5c37aa55-3f28-46ce-8e1f-ea7decafe3d5 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:39:00 devstack sudo[93062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a43cbf4-993a-48bd-84e6-49e95ba57dae.5c37aa55-3f28-46ce-8e1f-ea7decafe3d5 Jul 08 18:39:00 devstack sudo[93062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:39:01 devstack sudo[93062]: pam_unix(sudo:session): session closed for user root Jul 08 18:39:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b6eba096-dd28-4f9a-8f0e-c00cb390ab07 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a43cbf4-993a-48bd-84e6-49e95ba57dae.5c37aa55-3f28-46ce-8e1f-ea7decafe3d5" returned: 0 in 0.934s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:39:01 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b6eba096-dd28-4f9a-8f0e-c00cb390ab07 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Lock "cinder-quobyte-5c37aa55-3f28-46ce-8e1f-ea7decafe3d5" released by "_delete_snapshot" :: held 4.660s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:39:01 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b6eba096-dd28-4f9a-8f0e-c00cb390ab07 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Lock "cinder-quobyte-5a43cbf4-993a-48bd-84e6-49e95ba57dae" released by "delete_snapshot" :: held 4.683s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:39:01 devstack sudo[93060]: pam_unix(sudo:session): session closed for user root Jul 08 18:39:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dde6c35c-8d16-42f5-9497-01a2536a0481 tempest-VolumesSnapshotTestJSON-1399133399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d 1073741824" returned: 0 in 1.192s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:39:01 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-b6eba096-dd28-4f9a-8f0e-c00cb390ab07 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Created reservations ['946f2adc-847c-48a1-868d-10962279b835', '25e47c8a-3d6e-469e-ad62-48a799580be7', '685c0576-2c1a-4b8e-bdc7-5cd8b4adf199', 'f5693f14-6d33-4789-b802-1c9e71edbe54'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:39:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dde6c35c-8d16-42f5-9497-01a2536a0481 tempest-VolumesSnapshotTestJSON-1399133399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:39:01 devstack sudo[93074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d Jul 08 18:39:01 devstack sudo[93074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:39:01 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-b6eba096-dd28-4f9a-8f0e-c00cb390ab07 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Delete snapshot completed successfully. Jul 08 18:39:01 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b6eba096-dd28-4f9a-8f0e-c00cb390ab07 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Lock "cinder-5c37aa55-3f28-46ce-8e1f-ea7decafe3d5-delete_snapshot" released by "delete_snapshot" :: held 4.865s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:39:02 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-79ba4856-2e43-4349-a6ae-41e7ac5bef00 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Acquiring lock "cinder-5a43cbf4-993a-48bd-84e6-49e95ba57dae-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:39:02 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-79ba4856-2e43-4349-a6ae-41e7ac5bef00 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Lock "cinder-5a43cbf4-993a-48bd-84e6-49e95ba57dae-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:39:02 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-79ba4856-2e43-4349-a6ae-41e7ac5bef00 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Acquiring lock "cinder-quobyte-5a43cbf4-993a-48bd-84e6-49e95ba57dae" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:39:02 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-79ba4856-2e43-4349-a6ae-41e7ac5bef00 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Lock "cinder-quobyte-5a43cbf4-993a-48bd-84e6-49e95ba57dae" acquired by "delete_volume" :: waited 0.025s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:39:02 devstack sudo[93074]: pam_unix(sudo:session): session closed for user root Jul 08 18:39:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dde6c35c-8d16-42f5-9497-01a2536a0481 tempest-VolumesSnapshotTestJSON-1399133399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d" returned: 0 in 0.751s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:39:02 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-dde6c35c-8d16-42f5-9497-01a2536a0481 tempest-VolumesSnapshotTestJSON-1399133399 None] <== create_volume: return (2000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:39:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-dde6c35c-8d16-42f5-9497-01a2536a0481 tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.003s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:39:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-dde6c35c-8d16-42f5-9497-01a2536a0481 tempest-VolumesSnapshotTestJSON-1399133399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d74d3f4-1901-452f-91e7-f9553074f986) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:39:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-dde6c35c-8d16-42f5-9497-01a2536a0481 tempest-VolumesSnapshotTestJSON-1399133399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (809bda9a-82bb-4bf4-b3c5-358b2ee02c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:39:02 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb9c803-c65d-4c4e-9b0b-2d83bd8de568]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:39:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-79ba4856-2e43-4349-a6ae-41e7ac5bef00 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a43cbf4-993a-48bd-84e6-49e95ba57dae {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:39:02 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-dde6c35c-8d16-42f5-9497-01a2536a0481 tempest-VolumesSnapshotTestJSON-1399133399 None] Volume volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d (f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d): created successfully Jul 08 18:39:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-dde6c35c-8d16-42f5-9497-01a2536a0481 tempest-VolumesSnapshotTestJSON-1399133399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (809bda9a-82bb-4bf4-b3c5-358b2ee02c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:39:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-dde6c35c-8d16-42f5-9497-01a2536a0481 tempest-VolumesSnapshotTestJSON-1399133399 None] Flow 'volume_create_manager' (a83f6308-0faf-48ec-bc70-ce5852354807) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:39:02 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-dde6c35c-8d16-42f5-9497-01a2536a0481 tempest-VolumesSnapshotTestJSON-1399133399 None] Created volume successfully. Jul 08 18:39:02 devstack sudo[93079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a43cbf4-993a-48bd-84e6-49e95ba57dae Jul 08 18:39:02 devstack sudo[93079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:39:03 devstack sudo[93079]: pam_unix(sudo:session): session closed for user root Jul 08 18:39:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-79ba4856-2e43-4349-a6ae-41e7ac5bef00 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a43cbf4-993a-48bd-84e6-49e95ba57dae" returned: 0 in 0.851s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:39:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-79ba4856-2e43-4349-a6ae-41e7ac5bef00 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a43cbf4-993a-48bd-84e6-49e95ba57dae {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:39:03 devstack sudo[93084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a43cbf4-993a-48bd-84e6-49e95ba57dae Jul 08 18:39:03 devstack sudo[93084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:39:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-335ba22c-47c2-4a02-83e6-03bd3758f13a tempest-VolumesSnapshotTestJSON-1399133399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:39:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-335ba22c-47c2-4a02-83e6-03bd3758f13a tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:39:03 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-335ba22c-47c2-4a02-83e6-03bd3758f13a tempest-VolumesSnapshotTestJSON-1399133399 None] Creating offline snapshot de64c139-3aa4-4c2e-832d-5d3953c05d72 of volume f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d {{(pid=86873) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:39:03 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[53062398-2abd-4932-b95f-4ecdc234fbf5]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:39:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-335ba22c-47c2-4a02-83e6-03bd3758f13a tempest-VolumesSnapshotTestJSON-1399133399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:39:03 devstack sudo[93086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d Jul 08 18:39:03 devstack sudo[93086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:39:04 devstack sudo[93084]: pam_unix(sudo:session): session closed for user root Jul 08 18:39:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-79ba4856-2e43-4349-a6ae-41e7ac5bef00 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a43cbf4-993a-48bd-84e6-49e95ba57dae" returned: 0 in 0.732s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:39:04 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-79ba4856-2e43-4349-a6ae-41e7ac5bef00 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Lock "cinder-quobyte-5a43cbf4-993a-48bd-84e6-49e95ba57dae" released by "delete_volume" :: held 1.666s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:39:04 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-79ba4856-2e43-4349-a6ae-41e7ac5bef00 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Created reservations ['32e787a5-311e-4704-9604-49cb85ec2c19', '7410518a-5913-41a9-8aaa-e4cab98edfa5', '9b7e9d5d-faa2-45ab-a00c-15708556e237', '6fcfea71-b581-49fc-ae44-357e00b41ace'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:39:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-79ba4856-2e43-4349-a6ae-41e7ac5bef00 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:39:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-79ba4856-2e43-4349-a6ae-41e7ac5bef00 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:39:04 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-79ba4856-2e43-4349-a6ae-41e7ac5bef00 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:39:04 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-79ba4856-2e43-4349-a6ae-41e7ac5bef00 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:39:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-79ba4856-2e43-4349-a6ae-41e7ac5bef00 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:39:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-79ba4856-2e43-4349-a6ae-41e7ac5bef00 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:39:04 devstack sudo[93089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:39:04 devstack sudo[93089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:39:04 devstack sudo[93086]: pam_unix(sudo:session): session closed for user root Jul 08 18:39:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-335ba22c-47c2-4a02-83e6-03bd3758f13a tempest-VolumesSnapshotTestJSON-1399133399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d" returned: 0 in 0.911s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:39:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-335ba22c-47c2-4a02-83e6-03bd3758f13a tempest-VolumesSnapshotTestJSON-1399133399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d.de64c139-3aa4-4c2e-832d-5d3953c05d72 1G {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:39:04 devstack sudo[93094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d.de64c139-3aa4-4c2e-832d-5d3953c05d72 1G Jul 08 18:39:04 devstack sudo[93094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:39:05 devstack sudo[93089]: pam_unix(sudo:session): session closed for user root Jul 08 18:39:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-79ba4856-2e43-4349-a6ae-41e7ac5bef00 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.904s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:39:05 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-79ba4856-2e43-4349-a6ae-41e7ac5bef00 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:39:05 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-79ba4856-2e43-4349-a6ae-41e7ac5bef00 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Deleted volume successfully. Jul 08 18:39:05 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-79ba4856-2e43-4349-a6ae-41e7ac5bef00 tempest-VolumesSnapshotNegativeTestJSON-2096313469 None] Lock "cinder-5a43cbf4-993a-48bd-84e6-49e95ba57dae-delete_volume" released by "delete_volume" :: held 2.814s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:39:05 devstack sudo[93094]: pam_unix(sudo:session): session closed for user root Jul 08 18:39:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-335ba22c-47c2-4a02-83e6-03bd3758f13a tempest-VolumesSnapshotTestJSON-1399133399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d.de64c139-3aa4-4c2e-832d-5d3953c05d72 1G" returned: 0 in 1.123s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:39:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-335ba22c-47c2-4a02-83e6-03bd3758f13a tempest-VolumesSnapshotTestJSON-1399133399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d.de64c139-3aa4-4c2e-832d-5d3953c05d72 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:39:05 devstack sudo[93102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d.de64c139-3aa4-4c2e-832d-5d3953c05d72 Jul 08 18:39:05 devstack sudo[93102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:39:06 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-7730000b-4867-4eb3-9586-9d6e787de893 tempest-ServerActionsTestOtherA-1985324233 None] Acquiring lock "cinder-a5202c4a-e705-4e51-9327-2d2a50c54237-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:39:06 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-7730000b-4867-4eb3-9586-9d6e787de893 tempest-ServerActionsTestOtherA-1985324233 None] Lock "cinder-a5202c4a-e705-4e51-9327-2d2a50c54237-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:39:06 devstack sudo[93102]: pam_unix(sudo:session): session closed for user root Jul 08 18:39:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-335ba22c-47c2-4a02-83e6-03bd3758f13a tempest-VolumesSnapshotTestJSON-1399133399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d.de64c139-3aa4-4c2e-832d-5d3953c05d72" returned: 0 in 0.862s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:39:06 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-335ba22c-47c2-4a02-83e6-03bd3758f13a tempest-VolumesSnapshotTestJSON-1399133399 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d.de64c139-3aa4-4c2e-832d-5d3953c05d72 is being set with open permissions: ugo+rw Jul 08 18:39:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-335ba22c-47c2-4a02-83e6-03bd3758f13a tempest-VolumesSnapshotTestJSON-1399133399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d.de64c139-3aa4-4c2e-832d-5d3953c05d72 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:39:06 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-7730000b-4867-4eb3-9586-9d6e787de893 tempest-ServerActionsTestOtherA-1985324233 None] Acquiring lock "cinder-quobyte-a5202c4a-e705-4e51-9327-2d2a50c54237" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:39:06 devstack sudo[93107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d.de64c139-3aa4-4c2e-832d-5d3953c05d72 Jul 08 18:39:06 devstack sudo[93107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:39:06 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-7730000b-4867-4eb3-9586-9d6e787de893 tempest-ServerActionsTestOtherA-1985324233 None] Lock "cinder-quobyte-a5202c4a-e705-4e51-9327-2d2a50c54237" acquired by "delete_volume" :: waited 0.021s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:39:06 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[004466ff-edc7-48c9-8bb7-4f0077a50ee3]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:39:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-7730000b-4867-4eb3-9586-9d6e787de893 tempest-ServerActionsTestOtherA-1985324233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-a5202c4a-e705-4e51-9327-2d2a50c54237 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:39:06 devstack sudo[93109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-a5202c4a-e705-4e51-9327-2d2a50c54237 Jul 08 18:39:06 devstack sudo[93109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:39:07 devstack sudo[93107]: pam_unix(sudo:session): session closed for user root Jul 08 18:39:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-335ba22c-47c2-4a02-83e6-03bd3758f13a tempest-VolumesSnapshotTestJSON-1399133399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d.de64c139-3aa4-4c2e-832d-5d3953c05d72" returned: 0 in 0.870s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:39:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-335ba22c-47c2-4a02-83e6-03bd3758f13a tempest-VolumesSnapshotTestJSON-1399133399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:39:07 devstack sudo[93115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d.info Jul 08 18:39:07 devstack sudo[93115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:39:07 devstack sudo[93109]: pam_unix(sudo:session): session closed for user root Jul 08 18:39:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-7730000b-4867-4eb3-9586-9d6e787de893 tempest-ServerActionsTestOtherA-1985324233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-a5202c4a-e705-4e51-9327-2d2a50c54237" returned: 0 in 0.901s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:39:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-7730000b-4867-4eb3-9586-9d6e787de893 tempest-ServerActionsTestOtherA-1985324233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-a5202c4a-e705-4e51-9327-2d2a50c54237 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:39:07 devstack sudo[93117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-a5202c4a-e705-4e51-9327-2d2a50c54237 Jul 08 18:39:07 devstack sudo[93117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:39:08 devstack sudo[93115]: pam_unix(sudo:session): session closed for user root Jul 08 18:39:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-335ba22c-47c2-4a02-83e6-03bd3758f13a tempest-VolumesSnapshotTestJSON-1399133399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d.info" returned: 0 in 0.801s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:39:08 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-335ba22c-47c2-4a02-83e6-03bd3758f13a tempest-VolumesSnapshotTestJSON-1399133399 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d.info is being set with open permissions: ugo+rw Jul 08 18:39:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-335ba22c-47c2-4a02-83e6-03bd3758f13a tempest-VolumesSnapshotTestJSON-1399133399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:39:08 devstack sudo[93121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d.info Jul 08 18:39:08 devstack sudo[93121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:39:08 devstack sudo[93117]: pam_unix(sudo:session): session closed for user root Jul 08 18:39:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-7730000b-4867-4eb3-9586-9d6e787de893 tempest-ServerActionsTestOtherA-1985324233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-a5202c4a-e705-4e51-9327-2d2a50c54237" returned: 0 in 0.831s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:39:08 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-7730000b-4867-4eb3-9586-9d6e787de893 tempest-ServerActionsTestOtherA-1985324233 None] Lock "cinder-quobyte-a5202c4a-e705-4e51-9327-2d2a50c54237" released by "delete_volume" :: held 1.795s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:39:08 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-7730000b-4867-4eb3-9586-9d6e787de893 tempest-ServerActionsTestOtherA-1985324233 None] Created reservations ['0ff4376f-f13b-4907-b70f-374d74cc9ad6', 'cd000939-3b95-48e7-b460-248e0df59a48', 'c3533943-08a7-4bbe-8aae-66bbfdbe4dc0', 'e010a303-490c-4e18-b164-b7082dfe7c7a'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:39:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-7730000b-4867-4eb3-9586-9d6e787de893 tempest-ServerActionsTestOtherA-1985324233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:39:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-7730000b-4867-4eb3-9586-9d6e787de893 tempest-ServerActionsTestOtherA-1985324233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:39:08 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-7730000b-4867-4eb3-9586-9d6e787de893 tempest-ServerActionsTestOtherA-1985324233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:39:08 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-7730000b-4867-4eb3-9586-9d6e787de893 tempest-ServerActionsTestOtherA-1985324233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:39:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-7730000b-4867-4eb3-9586-9d6e787de893 tempest-ServerActionsTestOtherA-1985324233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:39:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-7730000b-4867-4eb3-9586-9d6e787de893 tempest-ServerActionsTestOtherA-1985324233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:39:08 devstack sudo[93123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:39:08 devstack sudo[93123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:39:09 devstack sudo[93121]: pam_unix(sudo:session): session closed for user root Jul 08 18:39:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-335ba22c-47c2-4a02-83e6-03bd3758f13a tempest-VolumesSnapshotTestJSON-1399133399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d.info" returned: 0 in 0.872s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:39:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-335ba22c-47c2-4a02-83e6-03bd3758f13a tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.568s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:39:09 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-335ba22c-47c2-4a02-83e6-03bd3758f13a tempest-VolumesSnapshotTestJSON-1399133399 None] Create snapshot completed successfully Jul 08 18:39:09 devstack sudo[93123]: pam_unix(sudo:session): session closed for user root Jul 08 18:39:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-7730000b-4867-4eb3-9586-9d6e787de893 tempest-ServerActionsTestOtherA-1985324233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.961s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:39:09 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-7730000b-4867-4eb3-9586-9d6e787de893 tempest-ServerActionsTestOtherA-1985324233 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:39:09 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-7730000b-4867-4eb3-9586-9d6e787de893 tempest-ServerActionsTestOtherA-1985324233 None] Deleted volume successfully. Jul 08 18:39:09 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-7730000b-4867-4eb3-9586-9d6e787de893 tempest-ServerActionsTestOtherA-1985324233 None] Lock "cinder-a5202c4a-e705-4e51-9327-2d2a50c54237-delete_volume" released by "delete_volume" :: held 3.064s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:39:10 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-c46ae500-906d-4004-80c9-97b9c1f184a5 tempest-VolumesSnapshotTestJSON-1399133399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:39:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c46ae500-906d-4004-80c9-97b9c1f184a5 tempest-VolumesSnapshotTestJSON-1399133399 None] Flow 'volume_create_manager' (5c63a8a0-7819-4435-adcd-379a75efd18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:39:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c46ae500-906d-4004-80c9-97b9c1f184a5 tempest-VolumesSnapshotTestJSON-1399133399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4b8f016-1c1a-4e97-9ee6-9f460b1c2570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:39:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c46ae500-906d-4004-80c9-97b9c1f184a5 tempest-VolumesSnapshotTestJSON-1399133399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4b8f016-1c1a-4e97-9ee6-9f460b1c2570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:39:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-385451190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4212dc31-614b-4633-a79c-366c8a2fe768,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfae85ad945e4d2585d3823b7b4ef62e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:39:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=de64c139-3aa4-4c2e-832d-5d3953c05d72,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:39:11Z,use_quota=True,user_id='6a6b7648c1c2476ab78c03983697ff4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:39:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c46ae500-906d-4004-80c9-97b9c1f184a5 tempest-VolumesSnapshotTestJSON-1399133399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c74be253-efaa-400f-a9ee-1f52dca28055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:39:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c46ae500-906d-4004-80c9-97b9c1f184a5 tempest-VolumesSnapshotTestJSON-1399133399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c74be253-efaa-400f-a9ee-1f52dca28055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:39:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c46ae500-906d-4004-80c9-97b9c1f184a5 tempest-VolumesSnapshotTestJSON-1399133399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e75948b-ed2f-4480-bb01-99e6d1683904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:39:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c46ae500-906d-4004-80c9-97b9c1f184a5 tempest-VolumesSnapshotTestJSON-1399133399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e75948b-ed2f-4480-bb01-99e6d1683904) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4212dc31-614b-4633-a79c-366c8a2fe768', 'volume_name': 'volume-4212dc31-614b-4633-a79c-366c8a2fe768', 'volume_size': 1, 'snapshot_id': 'de64c139-3aa4-4c2e-832d-5d3953c05d72'}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:39:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c46ae500-906d-4004-80c9-97b9c1f184a5 tempest-VolumesSnapshotTestJSON-1399133399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be59cc17-8bec-4905-8776-ba97bc823267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:39:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c46ae500-906d-4004-80c9-97b9c1f184a5 tempest-VolumesSnapshotTestJSON-1399133399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be59cc17-8bec-4905-8776-ba97bc823267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:39:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c46ae500-906d-4004-80c9-97b9c1f184a5 tempest-VolumesSnapshotTestJSON-1399133399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33811653-49c0-4905-8368-4e2c972fec17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:39:10 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-c46ae500-906d-4004-80c9-97b9c1f184a5 tempest-VolumesSnapshotTestJSON-1399133399 None] Volume 4212dc31-614b-4633-a79c-366c8a2fe768: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4212dc31-614b-4633-a79c-366c8a2fe768', 'volume_size': 1, 'snapshot_id': 'de64c139-3aa4-4c2e-832d-5d3953c05d72'} Jul 08 18:39:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c46ae500-906d-4004-80c9-97b9c1f184a5 tempest-VolumesSnapshotTestJSON-1399133399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:39:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c46ae500-906d-4004-80c9-97b9c1f184a5 tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:39:10 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-c46ae500-906d-4004-80c9-97b9c1f184a5 tempest-VolumesSnapshotTestJSON-1399133399 None] Acquiring lock "cinder-quobyte-de64c139-3aa4-4c2e-832d-5d3953c05d72-4212dc31-614b-4633-a79c-366c8a2fe768" by "_create_volume_from_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:39:10 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-c46ae500-906d-4004-80c9-97b9c1f184a5 tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "cinder-quobyte-de64c139-3aa4-4c2e-832d-5d3953c05d72-4212dc31-614b-4633-a79c-366c8a2fe768" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:39:10 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c46ae500-906d-4004-80c9-97b9c1f184a5 tempest-VolumesSnapshotTestJSON-1399133399 None] Creating volume 4212dc31-614b-4633-a79c-366c8a2fe768 from snapshot de64c139-3aa4-4c2e-832d-5d3953c05d72 {{(pid=86873) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 18:39:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c46ae500-906d-4004-80c9-97b9c1f184a5 tempest-VolumesSnapshotTestJSON-1399133399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:39:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c46ae500-906d-4004-80c9-97b9c1f184a5 tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:39:10 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c46ae500-906d-4004-80c9-97b9c1f184a5 tempest-VolumesSnapshotTestJSON-1399133399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:39:10 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c46ae500-906d-4004-80c9-97b9c1f184a5 tempest-VolumesSnapshotTestJSON-1399133399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:39:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c46ae500-906d-4004-80c9-97b9c1f184a5 tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:39:10 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c46ae500-906d-4004-80c9-97b9c1f184a5 tempest-VolumesSnapshotTestJSON-1399133399 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:39:10 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-c46ae500-906d-4004-80c9-97b9c1f184a5 tempest-VolumesSnapshotTestJSON-1399133399 None] Acquiring lock "cinder-quobyte-4212dc31-614b-4633-a79c-366c8a2fe768" by "_copy_volume_from_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:39:10 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-c46ae500-906d-4004-80c9-97b9c1f184a5 tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "cinder-quobyte-4212dc31-614b-4633-a79c-366c8a2fe768" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:39:10 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c46ae500-906d-4004-80c9-97b9c1f184a5 tempest-VolumesSnapshotTestJSON-1399133399 None] snapshot: de64c139-3aa4-4c2e-832d-5d3953c05d72, volume: 4212dc31-614b-4633-a79c-366c8a2fe768, {{(pid=86873) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 18:39:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c46ae500-906d-4004-80c9-97b9c1f184a5 tempest-VolumesSnapshotTestJSON-1399133399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:39:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c46ae500-906d-4004-80c9-97b9c1f184a5 tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:39:11 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c46ae500-906d-4004-80c9-97b9c1f184a5 tempest-VolumesSnapshotTestJSON-1399133399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:39:11 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c46ae500-906d-4004-80c9-97b9c1f184a5 tempest-VolumesSnapshotTestJSON-1399133399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:39:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c46ae500-906d-4004-80c9-97b9c1f184a5 tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:39:11 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5207b2-37e3-46f3-8aec-3940a1b86128]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:39:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c46ae500-906d-4004-80c9-97b9c1f184a5 tempest-VolumesSnapshotTestJSON-1399133399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d.de64c139-3aa4-4c2e-832d-5d3953c05d72 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:39:11 devstack sudo[93149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d.de64c139-3aa4-4c2e-832d-5d3953c05d72 Jul 08 18:39:11 devstack sudo[93149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:39:12 devstack sudo[93149]: pam_unix(sudo:session): session closed for user root Jul 08 18:39:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c46ae500-906d-4004-80c9-97b9c1f184a5 tempest-VolumesSnapshotTestJSON-1399133399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d.de64c139-3aa4-4c2e-832d-5d3953c05d72" returned: 0 in 0.992s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:39:12 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-c46ae500-906d-4004-80c9-97b9c1f184a5 tempest-VolumesSnapshotTestJSON-1399133399 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:39:12 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c46ae500-906d-4004-80c9-97b9c1f184a5 tempest-VolumesSnapshotTestJSON-1399133399 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d {{(pid=86873) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 18:39:12 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c46ae500-906d-4004-80c9-97b9c1f184a5 tempest-VolumesSnapshotTestJSON-1399133399 None] Creating direct copy from snapshot {{(pid=86873) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 18:39:12 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb74421b-ae4a-4fdc-983b-43811891594d]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:39:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c46ae500-906d-4004-80c9-97b9c1f184a5 tempest-VolumesSnapshotTestJSON-1399133399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:39:12 devstack sudo[93162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d Jul 08 18:39:12 devstack sudo[93162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:39:13 devstack sudo[93162]: pam_unix(sudo:session): session closed for user root Jul 08 18:39:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c46ae500-906d-4004-80c9-97b9c1f184a5 tempest-VolumesSnapshotTestJSON-1399133399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d" returned: 0 in 0.999s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:39:13 devstack cinder-volume[86873]: DEBUG cinder.utils [None req-c46ae500-906d-4004-80c9-97b9c1f184a5 tempest-VolumesSnapshotTestJSON-1399133399 None] Path /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4212dc31-614b-4633-a79c-366c8a2fe768 not found in is_blk_device check {{(pid=86873) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 18:39:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c46ae500-906d-4004-80c9-97b9c1f184a5 tempest-VolumesSnapshotTestJSON-1399133399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4212dc31-614b-4633-a79c-366c8a2fe768 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:39:13 devstack sudo[93169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4212dc31-614b-4633-a79c-366c8a2fe768 Jul 08 18:39:13 devstack sudo[93169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:39:19 devstack sudo[93169]: pam_unix(sudo:session): session closed for user root Jul 08 18:39:19 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c46ae500-906d-4004-80c9-97b9c1f184a5 tempest-VolumesSnapshotTestJSON-1399133399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4212dc31-614b-4633-a79c-366c8a2fe768" returned: 0 in 6.781s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:39:19 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[e41a38fd-0f94-4e65-a3d7-be2a9838de48]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:39:19 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c46ae500-906d-4004-80c9-97b9c1f184a5 tempest-VolumesSnapshotTestJSON-1399133399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:39:20 devstack sudo[93210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d Jul 08 18:39:20 devstack sudo[93210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:39:20 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:SELECT=41,cinder:UPDATE=52,cinder:DELETE=3,cinder:INSERT=15 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:39:20 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:UPDATE=56,cinder:DELETE=6,cinder:SELECT=51,cinder:INSERT=13 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:39:21 devstack sudo[93210]: pam_unix(sudo:session): session closed for user root Jul 08 18:39:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c46ae500-906d-4004-80c9-97b9c1f184a5 tempest-VolumesSnapshotTestJSON-1399133399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d" returned: 0 in 1.172s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:39:21 devstack cinder-volume[86873]: DEBUG cinder.image.image_utils [None req-c46ae500-906d-4004-80c9-97b9c1f184a5 tempest-VolumesSnapshotTestJSON-1399133399 None] Image conversion details: src /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d, size 1024.00 MB, duration 6.78 sec, destination /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4212dc31-614b-4633-a79c-366c8a2fe768 {{(pid=86873) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:39:21 devstack cinder-volume[86873]: INFO cinder.image.image_utils [None req-c46ae500-906d-4004-80c9-97b9c1f184a5 tempest-VolumesSnapshotTestJSON-1399133399 None] Converted 1024.00 MB image at 150.99 MB/s Jul 08 18:39:21 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-c46ae500-906d-4004-80c9-97b9c1f184a5 tempest-VolumesSnapshotTestJSON-1399133399 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4212dc31-614b-4633-a79c-366c8a2fe768 is being set with open permissions: ugo+rw Jul 08 18:39:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c46ae500-906d-4004-80c9-97b9c1f184a5 tempest-VolumesSnapshotTestJSON-1399133399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4212dc31-614b-4633-a79c-366c8a2fe768 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:39:21 devstack sudo[93215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4212dc31-614b-4633-a79c-366c8a2fe768 Jul 08 18:39:21 devstack sudo[93215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:39:21 devstack sudo[93215]: pam_unix(sudo:session): session closed for user root Jul 08 18:39:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c46ae500-906d-4004-80c9-97b9c1f184a5 tempest-VolumesSnapshotTestJSON-1399133399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4212dc31-614b-4633-a79c-366c8a2fe768" returned: 0 in 0.748s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:39:21 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-c46ae500-906d-4004-80c9-97b9c1f184a5 tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "cinder-quobyte-4212dc31-614b-4633-a79c-366c8a2fe768" released by "_copy_volume_from_snapshot" :: held 10.951s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:39:21 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-c46ae500-906d-4004-80c9-97b9c1f184a5 tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "cinder-quobyte-de64c139-3aa4-4c2e-832d-5d3953c05d72-4212dc31-614b-4633-a79c-366c8a2fe768" released by "_create_volume_from_snapshot" :: held 11.001s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:39:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c46ae500-906d-4004-80c9-97b9c1f184a5 tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.028s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:39:21 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c46ae500-906d-4004-80c9-97b9c1f184a5 tempest-VolumesSnapshotTestJSON-1399133399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33811653-49c0-4905-8368-4e2c972fec17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4212dc31-614b-4633-a79c-366c8a2fe768', 'volume_size': 1, 'snapshot_id': 'de64c139-3aa4-4c2e-832d-5d3953c05d72'}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:39:21 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c46ae500-906d-4004-80c9-97b9c1f184a5 tempest-VolumesSnapshotTestJSON-1399133399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75265e53-fb37-47e4-a5f9-98a93223587c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:39:21 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-c46ae500-906d-4004-80c9-97b9c1f184a5 tempest-VolumesSnapshotTestJSON-1399133399 None] Volume volume-4212dc31-614b-4633-a79c-366c8a2fe768 (4212dc31-614b-4633-a79c-366c8a2fe768): created successfully Jul 08 18:39:21 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c46ae500-906d-4004-80c9-97b9c1f184a5 tempest-VolumesSnapshotTestJSON-1399133399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75265e53-fb37-47e4-a5f9-98a93223587c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:39:21 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c46ae500-906d-4004-80c9-97b9c1f184a5 tempest-VolumesSnapshotTestJSON-1399133399 None] Flow 'volume_create_manager' (5c63a8a0-7819-4435-adcd-379a75efd18f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:39:22 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-c46ae500-906d-4004-80c9-97b9c1f184a5 tempest-VolumesSnapshotTestJSON-1399133399 None] Created volume successfully. Jul 08 18:39:23 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-07e17bfa-ae5e-473f-ab02-bf985661776e tempest-VolumesSnapshotTestJSON-1399133399 None] Acquiring lock "cinder-4212dc31-614b-4633-a79c-366c8a2fe768-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:39:23 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-07e17bfa-ae5e-473f-ab02-bf985661776e tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "cinder-4212dc31-614b-4633-a79c-366c8a2fe768-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:39:23 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-07e17bfa-ae5e-473f-ab02-bf985661776e tempest-VolumesSnapshotTestJSON-1399133399 None] Acquiring lock "cinder-quobyte-4212dc31-614b-4633-a79c-366c8a2fe768" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:39:23 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-07e17bfa-ae5e-473f-ab02-bf985661776e tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "cinder-quobyte-4212dc31-614b-4633-a79c-366c8a2fe768" acquired by "delete_volume" :: waited 0.022s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:39:23 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e71a45-fab6-4bf2-a74e-16cbb538863a]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:39:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-07e17bfa-ae5e-473f-ab02-bf985661776e tempest-VolumesSnapshotTestJSON-1399133399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4212dc31-614b-4633-a79c-366c8a2fe768 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:39:23 devstack sudo[93219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4212dc31-614b-4633-a79c-366c8a2fe768 Jul 08 18:39:23 devstack sudo[93219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:39:24 devstack sudo[93219]: pam_unix(sudo:session): session closed for user root Jul 08 18:39:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-07e17bfa-ae5e-473f-ab02-bf985661776e tempest-VolumesSnapshotTestJSON-1399133399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4212dc31-614b-4633-a79c-366c8a2fe768" returned: 0 in 0.975s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:39:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-07e17bfa-ae5e-473f-ab02-bf985661776e tempest-VolumesSnapshotTestJSON-1399133399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4212dc31-614b-4633-a79c-366c8a2fe768 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:39:24 devstack sudo[93225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4212dc31-614b-4633-a79c-366c8a2fe768 Jul 08 18:39:24 devstack sudo[93225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:39:24 devstack sudo[93225]: pam_unix(sudo:session): session closed for user root Jul 08 18:39:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-07e17bfa-ae5e-473f-ab02-bf985661776e tempest-VolumesSnapshotTestJSON-1399133399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4212dc31-614b-4633-a79c-366c8a2fe768" returned: 0 in 0.797s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:39:24 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-07e17bfa-ae5e-473f-ab02-bf985661776e tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "cinder-quobyte-4212dc31-614b-4633-a79c-366c8a2fe768" released by "delete_volume" :: held 1.831s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:39:25 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-07e17bfa-ae5e-473f-ab02-bf985661776e tempest-VolumesSnapshotTestJSON-1399133399 None] Created reservations ['e35a1604-f506-46a2-8573-444e3511d558', '0a5f1353-8471-4c63-8e32-846669651b8a', '85986a2a-6315-447d-a89f-648b09f60153', '520c06c9-fff6-473f-b244-69b70f9791bb'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:39:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-07e17bfa-ae5e-473f-ab02-bf985661776e tempest-VolumesSnapshotTestJSON-1399133399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:39:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-07e17bfa-ae5e-473f-ab02-bf985661776e tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:39:25 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-07e17bfa-ae5e-473f-ab02-bf985661776e tempest-VolumesSnapshotTestJSON-1399133399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:39:25 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-07e17bfa-ae5e-473f-ab02-bf985661776e tempest-VolumesSnapshotTestJSON-1399133399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:39:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-07e17bfa-ae5e-473f-ab02-bf985661776e tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:39:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-07e17bfa-ae5e-473f-ab02-bf985661776e tempest-VolumesSnapshotTestJSON-1399133399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:39:25 devstack sudo[93228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:39:25 devstack sudo[93228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:39:25 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-20831efa-f154-41e7-aa5f-3e7d69934186 tempest-VolumesSnapshotTestJSON-1399133399 None] Acquiring lock "cinder-de64c139-3aa4-4c2e-832d-5d3953c05d72-delete_snapshot" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:39:25 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-20831efa-f154-41e7-aa5f-3e7d69934186 tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "cinder-de64c139-3aa4-4c2e-832d-5d3953c05d72-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:39:25 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-20831efa-f154-41e7-aa5f-3e7d69934186 tempest-VolumesSnapshotTestJSON-1399133399 None] Acquiring lock "cinder-quobyte-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:39:25 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-20831efa-f154-41e7-aa5f-3e7d69934186 tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "cinder-quobyte-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:39:25 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-20831efa-f154-41e7-aa5f-3e7d69934186 tempest-VolumesSnapshotTestJSON-1399133399 None] Acquiring lock "cinder-quobyte-de64c139-3aa4-4c2e-832d-5d3953c05d72" by "_delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:39:25 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-20831efa-f154-41e7-aa5f-3e7d69934186 tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "cinder-quobyte-de64c139-3aa4-4c2e-832d-5d3953c05d72" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:39:25 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-20831efa-f154-41e7-aa5f-3e7d69934186 tempest-VolumesSnapshotTestJSON-1399133399 None] Deleting offline snapshot de64c139-3aa4-4c2e-832d-5d3953c05d72 of volume f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:39:25 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-20831efa-f154-41e7-aa5f-3e7d69934186 tempest-VolumesSnapshotTestJSON-1399133399 None] snapshot_file for this snap is: volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d.de64c139-3aa4-4c2e-832d-5d3953c05d72 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:39:25 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6130a7-5663-4472-9eb6-4fc64d4ea47c]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:39:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-20831efa-f154-41e7-aa5f-3e7d69934186 tempest-VolumesSnapshotTestJSON-1399133399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d.de64c139-3aa4-4c2e-832d-5d3953c05d72 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:39:25 devstack sudo[93231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d.de64c139-3aa4-4c2e-832d-5d3953c05d72 Jul 08 18:39:25 devstack sudo[93231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:39:26 devstack sudo[93228]: pam_unix(sudo:session): session closed for user root Jul 08 18:39:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-07e17bfa-ae5e-473f-ab02-bf985661776e tempest-VolumesSnapshotTestJSON-1399133399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.919s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:39:26 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-07e17bfa-ae5e-473f-ab02-bf985661776e tempest-VolumesSnapshotTestJSON-1399133399 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:39:26 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-07e17bfa-ae5e-473f-ab02-bf985661776e tempest-VolumesSnapshotTestJSON-1399133399 None] Deleted volume successfully. Jul 08 18:39:26 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-07e17bfa-ae5e-473f-ab02-bf985661776e tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "cinder-4212dc31-614b-4633-a79c-366c8a2fe768-delete_volume" released by "delete_volume" :: held 3.022s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:39:26 devstack sudo[93231]: pam_unix(sudo:session): session closed for user root Jul 08 18:39:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-20831efa-f154-41e7-aa5f-3e7d69934186 tempest-VolumesSnapshotTestJSON-1399133399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d.de64c139-3aa4-4c2e-832d-5d3953c05d72" returned: 0 in 1.005s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:39:26 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-20831efa-f154-41e7-aa5f-3e7d69934186 tempest-VolumesSnapshotTestJSON-1399133399 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:39:26 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[727737be-64fd-4ef9-a2b8-33fd62366a3d]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:39:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-20831efa-f154-41e7-aa5f-3e7d69934186 tempest-VolumesSnapshotTestJSON-1399133399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:39:26 devstack sudo[93239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d Jul 08 18:39:26 devstack sudo[93239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:39:27 devstack sudo[93239]: pam_unix(sudo:session): session closed for user root Jul 08 18:39:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-20831efa-f154-41e7-aa5f-3e7d69934186 tempest-VolumesSnapshotTestJSON-1399133399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d" returned: 0 in 0.964s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:39:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-20831efa-f154-41e7-aa5f-3e7d69934186 tempest-VolumesSnapshotTestJSON-1399133399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d.de64c139-3aa4-4c2e-832d-5d3953c05d72 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:39:27 devstack sudo[93245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d.de64c139-3aa4-4c2e-832d-5d3953c05d72 Jul 08 18:39:27 devstack sudo[93245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:39:28 devstack sudo[93245]: pam_unix(sudo:session): session closed for user root Jul 08 18:39:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-20831efa-f154-41e7-aa5f-3e7d69934186 tempest-VolumesSnapshotTestJSON-1399133399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d.de64c139-3aa4-4c2e-832d-5d3953c05d72" returned: 0 in 0.951s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:39:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-20831efa-f154-41e7-aa5f-3e7d69934186 tempest-VolumesSnapshotTestJSON-1399133399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d.de64c139-3aa4-4c2e-832d-5d3953c05d72 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:39:28 devstack sudo[93250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d.de64c139-3aa4-4c2e-832d-5d3953c05d72 Jul 08 18:39:28 devstack sudo[93250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:39:29 devstack sudo[93250]: pam_unix(sudo:session): session closed for user root Jul 08 18:39:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-20831efa-f154-41e7-aa5f-3e7d69934186 tempest-VolumesSnapshotTestJSON-1399133399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d.de64c139-3aa4-4c2e-832d-5d3953c05d72" returned: 0 in 0.818s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:39:29 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-20831efa-f154-41e7-aa5f-3e7d69934186 tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "cinder-quobyte-de64c139-3aa4-4c2e-832d-5d3953c05d72" released by "_delete_snapshot" :: held 3.941s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:39:29 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-20831efa-f154-41e7-aa5f-3e7d69934186 tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "cinder-quobyte-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d" released by "delete_snapshot" :: held 3.978s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:39:29 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-20831efa-f154-41e7-aa5f-3e7d69934186 tempest-VolumesSnapshotTestJSON-1399133399 None] Created reservations ['d97fb01a-bf9e-492f-96ac-221774a35760', '90dfde6e-5aa5-4d3f-a9ee-6abfdd8dc583', '015914b3-f13b-40dc-b82b-d7a2280d8f0a', '565ec26c-c48e-4d2d-a082-ec73ce0c1696'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:39:29 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-20831efa-f154-41e7-aa5f-3e7d69934186 tempest-VolumesSnapshotTestJSON-1399133399 None] Delete snapshot completed successfully. Jul 08 18:39:29 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-20831efa-f154-41e7-aa5f-3e7d69934186 tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "cinder-de64c139-3aa4-4c2e-832d-5d3953c05d72-delete_snapshot" released by "delete_snapshot" :: held 4.229s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:39:30 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-4db9700a-5962-4f72-a36f-cbd17cdd391e tempest-VolumesSnapshotTestJSON-1399133399 None] Acquiring lock "cinder-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:39:30 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-4db9700a-5962-4f72-a36f-cbd17cdd391e tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "cinder-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:39:30 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-4db9700a-5962-4f72-a36f-cbd17cdd391e tempest-VolumesSnapshotTestJSON-1399133399 None] Acquiring lock "cinder-quobyte-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:39:30 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-4db9700a-5962-4f72-a36f-cbd17cdd391e tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "cinder-quobyte-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d" acquired by "delete_volume" :: waited 0.018s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:39:31 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0226229-48ca-473a-978f-f4d9b58f24d4]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:39:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-4db9700a-5962-4f72-a36f-cbd17cdd391e tempest-VolumesSnapshotTestJSON-1399133399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:39:31 devstack sudo[93254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d Jul 08 18:39:31 devstack sudo[93254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:39:32 devstack sudo[93254]: pam_unix(sudo:session): session closed for user root Jul 08 18:39:32 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-4db9700a-5962-4f72-a36f-cbd17cdd391e tempest-VolumesSnapshotTestJSON-1399133399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d" returned: 0 in 1.059s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:39:32 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-4db9700a-5962-4f72-a36f-cbd17cdd391e tempest-VolumesSnapshotTestJSON-1399133399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:39:32 devstack sudo[93260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d Jul 08 18:39:32 devstack sudo[93260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:39:33 devstack sudo[93260]: pam_unix(sudo:session): session closed for user root Jul 08 18:39:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-4db9700a-5962-4f72-a36f-cbd17cdd391e tempest-VolumesSnapshotTestJSON-1399133399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d" returned: 0 in 1.162s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:39:33 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-4db9700a-5962-4f72-a36f-cbd17cdd391e tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "cinder-quobyte-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d" released by "delete_volume" :: held 2.334s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:39:33 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-4db9700a-5962-4f72-a36f-cbd17cdd391e tempest-VolumesSnapshotTestJSON-1399133399 None] Created reservations ['17d7f708-5b68-47ab-84a6-23b0ee9b98e5', '85331726-1ae4-4847-b5a5-504b9736394c', 'df7af3d9-77f1-4a49-8585-e0760944d336', '48c3b319-63ee-4fc5-b499-533bffd459a8'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:39:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-4db9700a-5962-4f72-a36f-cbd17cdd391e tempest-VolumesSnapshotTestJSON-1399133399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:39:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-4db9700a-5962-4f72-a36f-cbd17cdd391e tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:39:33 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-4db9700a-5962-4f72-a36f-cbd17cdd391e tempest-VolumesSnapshotTestJSON-1399133399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:39:33 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-4db9700a-5962-4f72-a36f-cbd17cdd391e tempest-VolumesSnapshotTestJSON-1399133399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:39:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-4db9700a-5962-4f72-a36f-cbd17cdd391e tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:39:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-4db9700a-5962-4f72-a36f-cbd17cdd391e tempest-VolumesSnapshotTestJSON-1399133399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:39:33 devstack sudo[93308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:39:33 devstack sudo[93308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:39:34 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6dba849d-459b-4fb3-acc1-d15f1537448c tempest-VolumesSnapshotTestJSON-1399133399 None] Acquiring lock "cinder-46de2cf2-f2e9-41d8-8708-feeeeaf85c67-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:39:34 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6dba849d-459b-4fb3-acc1-d15f1537448c tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "cinder-46de2cf2-f2e9-41d8-8708-feeeeaf85c67-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:39:34 devstack sudo[93308]: pam_unix(sudo:session): session closed for user root Jul 08 18:39:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-4db9700a-5962-4f72-a36f-cbd17cdd391e tempest-VolumesSnapshotTestJSON-1399133399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 1.043s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:39:34 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-4db9700a-5962-4f72-a36f-cbd17cdd391e tempest-VolumesSnapshotTestJSON-1399133399 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:39:34 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-4db9700a-5962-4f72-a36f-cbd17cdd391e tempest-VolumesSnapshotTestJSON-1399133399 None] Deleted volume successfully. Jul 08 18:39:34 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6dba849d-459b-4fb3-acc1-d15f1537448c tempest-VolumesSnapshotTestJSON-1399133399 None] Acquiring lock "cinder-quobyte-46de2cf2-f2e9-41d8-8708-feeeeaf85c67" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:39:34 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-4db9700a-5962-4f72-a36f-cbd17cdd391e tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "cinder-f86ab75a-e8d6-46ef-8a47-dbcd457f7b3d-delete_volume" released by "delete_volume" :: held 3.808s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:39:34 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6dba849d-459b-4fb3-acc1-d15f1537448c tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "cinder-quobyte-46de2cf2-f2e9-41d8-8708-feeeeaf85c67" acquired by "delete_volume" :: waited 0.032s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:39:34 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39a9a4a-2479-4e43-af14-6b69cb19902c]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:39:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6dba849d-459b-4fb3-acc1-d15f1537448c tempest-VolumesSnapshotTestJSON-1399133399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-46de2cf2-f2e9-41d8-8708-feeeeaf85c67 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:39:34 devstack sudo[93333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-46de2cf2-f2e9-41d8-8708-feeeeaf85c67 Jul 08 18:39:34 devstack sudo[93333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:39:35 devstack sudo[93333]: pam_unix(sudo:session): session closed for user root Jul 08 18:39:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6dba849d-459b-4fb3-acc1-d15f1537448c tempest-VolumesSnapshotTestJSON-1399133399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-46de2cf2-f2e9-41d8-8708-feeeeaf85c67" returned: 0 in 1.190s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:39:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6dba849d-459b-4fb3-acc1-d15f1537448c tempest-VolumesSnapshotTestJSON-1399133399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-46de2cf2-f2e9-41d8-8708-feeeeaf85c67 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:39:36 devstack sudo[93340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-46de2cf2-f2e9-41d8-8708-feeeeaf85c67 Jul 08 18:39:36 devstack sudo[93340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:39:37 devstack sudo[93340]: pam_unix(sudo:session): session closed for user root Jul 08 18:39:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6dba849d-459b-4fb3-acc1-d15f1537448c tempest-VolumesSnapshotTestJSON-1399133399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-46de2cf2-f2e9-41d8-8708-feeeeaf85c67" returned: 0 in 1.187s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:39:37 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6dba849d-459b-4fb3-acc1-d15f1537448c tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "cinder-quobyte-46de2cf2-f2e9-41d8-8708-feeeeaf85c67" released by "delete_volume" :: held 2.526s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:39:37 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-6dba849d-459b-4fb3-acc1-d15f1537448c tempest-VolumesSnapshotTestJSON-1399133399 None] Created reservations ['49c60945-d2ed-4908-a8e3-e238894a80b8', '124d5f76-0a88-45cd-bcc3-69659ec4c3da', '52736e8c-7af9-4de8-a40e-f8fd3225816c', 'ac192ac9-494a-4010-8a8e-ced179ebcd20'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:39:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6dba849d-459b-4fb3-acc1-d15f1537448c tempest-VolumesSnapshotTestJSON-1399133399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:39:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6dba849d-459b-4fb3-acc1-d15f1537448c tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:39:37 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-6dba849d-459b-4fb3-acc1-d15f1537448c tempest-VolumesSnapshotTestJSON-1399133399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:39:37 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-6dba849d-459b-4fb3-acc1-d15f1537448c tempest-VolumesSnapshotTestJSON-1399133399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:39:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6dba849d-459b-4fb3-acc1-d15f1537448c tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:39:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6dba849d-459b-4fb3-acc1-d15f1537448c tempest-VolumesSnapshotTestJSON-1399133399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:39:37 devstack sudo[93344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:39:37 devstack sudo[93344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:39:38 devstack sudo[93344]: pam_unix(sudo:session): session closed for user root Jul 08 18:39:38 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6dba849d-459b-4fb3-acc1-d15f1537448c tempest-VolumesSnapshotTestJSON-1399133399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.999s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:39:38 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-6dba849d-459b-4fb3-acc1-d15f1537448c tempest-VolumesSnapshotTestJSON-1399133399 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:39:38 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-6dba849d-459b-4fb3-acc1-d15f1537448c tempest-VolumesSnapshotTestJSON-1399133399 None] Deleted volume successfully. Jul 08 18:39:38 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6dba849d-459b-4fb3-acc1-d15f1537448c tempest-VolumesSnapshotTestJSON-1399133399 None] Lock "cinder-46de2cf2-f2e9-41d8-8708-feeeeaf85c67-delete_volume" released by "delete_volume" :: held 4.083s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:39:47 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:UPDATE=35,cinder:SELECT=24,cinder:INSERT=9 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:39:48 devstack cinder-volume[86873]: DEBUG oslo_service.periodic_task [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86873) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:39:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:39:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:39:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:39:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:39:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:39:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:39:48 devstack sudo[93374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:39:48 devstack sudo[93374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:39:48 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f9207b4-4120-43fe-b0f4-63c4de730a7f tempest-VolumesSnapshotListTestJSON-843736305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:39:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-7f9207b4-4120-43fe-b0f4-63c4de730a7f tempest-VolumesSnapshotListTestJSON-843736305 None] Flow 'volume_create_manager' (65a37f24-b293-41d4-ac79-8d322b776038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:39:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-7f9207b4-4120-43fe-b0f4-63c4de730a7f tempest-VolumesSnapshotListTestJSON-843736305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc8042e5-650b-4e88-8280-d204bbd5a3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:39:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-7f9207b4-4120-43fe-b0f4-63c4de730a7f tempest-VolumesSnapshotListTestJSON-843736305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc8042e5-650b-4e88-8280-d204bbd5a3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:39:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-744159970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8fa3369-35f4-4840-b649-101618c67921,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36c067ce463b41388b1881c196a9ebb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:39:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:39:48Z,use_quota=True,user_id='295a6f37d7d34f3aafb03691db639a2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:39:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-7f9207b4-4120-43fe-b0f4-63c4de730a7f tempest-VolumesSnapshotListTestJSON-843736305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bb098dc-f890-4035-9126-a1bbc7173208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:39:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-7f9207b4-4120-43fe-b0f4-63c4de730a7f tempest-VolumesSnapshotListTestJSON-843736305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bb098dc-f890-4035-9126-a1bbc7173208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:39:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-7f9207b4-4120-43fe-b0f4-63c4de730a7f tempest-VolumesSnapshotListTestJSON-843736305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (571b8352-4559-4de0-975a-cd804b0154c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:39:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-7f9207b4-4120-43fe-b0f4-63c4de730a7f tempest-VolumesSnapshotListTestJSON-843736305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (571b8352-4559-4de0-975a-cd804b0154c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8fa3369-35f4-4840-b649-101618c67921', 'volume_name': 'volume-c8fa3369-35f4-4840-b649-101618c67921', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:39:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-7f9207b4-4120-43fe-b0f4-63c4de730a7f tempest-VolumesSnapshotListTestJSON-843736305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72e8857c-3574-4d21-bf85-d7b859def066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:39:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-7f9207b4-4120-43fe-b0f4-63c4de730a7f tempest-VolumesSnapshotListTestJSON-843736305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72e8857c-3574-4d21-bf85-d7b859def066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:39:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-7f9207b4-4120-43fe-b0f4-63c4de730a7f tempest-VolumesSnapshotListTestJSON-843736305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93862e29-7995-4343-8bf1-c78dcfa4c039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:39:48 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-7f9207b4-4120-43fe-b0f4-63c4de730a7f tempest-VolumesSnapshotListTestJSON-843736305 None] Volume c8fa3369-35f4-4840-b649-101618c67921: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8fa3369-35f4-4840-b649-101618c67921', 'volume_size': 1} Jul 08 18:39:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-7f9207b4-4120-43fe-b0f4-63c4de730a7f tempest-VolumesSnapshotListTestJSON-843736305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:39:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-7f9207b4-4120-43fe-b0f4-63c4de730a7f tempest-VolumesSnapshotListTestJSON-843736305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:39:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-7f9207b4-4120-43fe-b0f4-63c4de730a7f tempest-VolumesSnapshotListTestJSON-843736305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:39:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-744159970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8fa3369-35f4-4840-b649-101618c67921,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36c067ce463b41388b1881c196a9ebb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:39:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:39:48Z,use_quota=True,user_id='295a6f37d7d34f3aafb03691db639a2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:39:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-7f9207b4-4120-43fe-b0f4-63c4de730a7f tempest-VolumesSnapshotListTestJSON-843736305 None] Creating volume c8fa3369-35f4-4840-b649-101618c67921 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:39:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-7f9207b4-4120-43fe-b0f4-63c4de730a7f tempest-VolumesSnapshotListTestJSON-843736305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:39:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-7f9207b4-4120-43fe-b0f4-63c4de730a7f tempest-VolumesSnapshotListTestJSON-843736305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:39:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-7f9207b4-4120-43fe-b0f4-63c4de730a7f tempest-VolumesSnapshotListTestJSON-843736305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:39:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-7f9207b4-4120-43fe-b0f4-63c4de730a7f tempest-VolumesSnapshotListTestJSON-843736305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:39:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-7f9207b4-4120-43fe-b0f4-63c4de730a7f tempest-VolumesSnapshotListTestJSON-843736305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:39:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-7f9207b4-4120-43fe-b0f4-63c4de730a7f tempest-VolumesSnapshotListTestJSON-843736305 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:39:48 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-7f9207b4-4120-43fe-b0f4-63c4de730a7f tempest-VolumesSnapshotListTestJSON-843736305 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:39:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-7f9207b4-4120-43fe-b0f4-63c4de730a7f tempest-VolumesSnapshotListTestJSON-843736305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:39:48 devstack sudo[93376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921 1073741824 Jul 08 18:39:48 devstack sudo[93376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:39:49 devstack sudo[93374]: pam_unix(sudo:session): session closed for user root Jul 08 18:39:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.921s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:39:49 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:39:49 devstack cinder-volume[86873]: DEBUG oslo_service.periodic_task [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running periodic task VolumeManager._thread_info {{(pid=86873) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:39:49 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] thread count: 9 {{(pid=86873) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:39:49 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] thread info: [<_MainThread(MainThread, started 138577734545536)>, , , , , , , , ] {{(pid=86873) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:39:49 devstack sudo[93376]: pam_unix(sudo:session): session closed for user root Jul 08 18:39:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-7f9207b4-4120-43fe-b0f4-63c4de730a7f tempest-VolumesSnapshotListTestJSON-843736305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921 1073741824" returned: 0 in 1.049s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:39:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-7f9207b4-4120-43fe-b0f4-63c4de730a7f tempest-VolumesSnapshotListTestJSON-843736305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:39:49 devstack sudo[93384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921 Jul 08 18:39:49 devstack sudo[93384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:39:50 devstack sudo[93384]: pam_unix(sudo:session): session closed for user root Jul 08 18:39:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-7f9207b4-4120-43fe-b0f4-63c4de730a7f tempest-VolumesSnapshotListTestJSON-843736305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921" returned: 0 in 0.770s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:39:50 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-7f9207b4-4120-43fe-b0f4-63c4de730a7f tempest-VolumesSnapshotListTestJSON-843736305 None] <== create_volume: return (1892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:39:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-7f9207b4-4120-43fe-b0f4-63c4de730a7f tempest-VolumesSnapshotListTestJSON-843736305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.895s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:39:50 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-7f9207b4-4120-43fe-b0f4-63c4de730a7f tempest-VolumesSnapshotListTestJSON-843736305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93862e29-7995-4343-8bf1-c78dcfa4c039) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8fa3369-35f4-4840-b649-101618c67921', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:39:50 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-7f9207b4-4120-43fe-b0f4-63c4de730a7f tempest-VolumesSnapshotListTestJSON-843736305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9323edb4-3e43-43a2-806c-38fe796a5a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:39:50 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-7f9207b4-4120-43fe-b0f4-63c4de730a7f tempest-VolumesSnapshotListTestJSON-843736305 None] Volume volume-c8fa3369-35f4-4840-b649-101618c67921 (c8fa3369-35f4-4840-b649-101618c67921): created successfully Jul 08 18:39:50 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-7f9207b4-4120-43fe-b0f4-63c4de730a7f tempest-VolumesSnapshotListTestJSON-843736305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9323edb4-3e43-43a2-806c-38fe796a5a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:39:50 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-7f9207b4-4120-43fe-b0f4-63c4de730a7f tempest-VolumesSnapshotListTestJSON-843736305 None] Flow 'volume_create_manager' (65a37f24-b293-41d4-ac79-8d322b776038) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:39:50 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-7f9207b4-4120-43fe-b0f4-63c4de730a7f tempest-VolumesSnapshotListTestJSON-843736305 None] Created volume successfully. Jul 08 18:39:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-121653d5-4b0e-405d-8921-b0335131ef4d tempest-VolumesSnapshotListTestJSON-843736305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:39:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-121653d5-4b0e-405d-8921-b0335131ef4d tempest-VolumesSnapshotListTestJSON-843736305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:39:51 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-121653d5-4b0e-405d-8921-b0335131ef4d tempest-VolumesSnapshotListTestJSON-843736305 None] Creating offline snapshot dd82985e-f5e1-4a17-8244-705c061f064e of volume c8fa3369-35f4-4840-b649-101618c67921 {{(pid=86873) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:39:51 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4083e3-54b6-42bb-aeed-e49e95db1a38]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:39:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-121653d5-4b0e-405d-8921-b0335131ef4d tempest-VolumesSnapshotListTestJSON-843736305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:39:51 devstack sudo[93388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921 Jul 08 18:39:51 devstack sudo[93388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:39:52 devstack sudo[93388]: pam_unix(sudo:session): session closed for user root Jul 08 18:39:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-121653d5-4b0e-405d-8921-b0335131ef4d tempest-VolumesSnapshotListTestJSON-843736305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921" returned: 0 in 1.038s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:39:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-121653d5-4b0e-405d-8921-b0335131ef4d tempest-VolumesSnapshotListTestJSON-843736305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.dd82985e-f5e1-4a17-8244-705c061f064e 1G {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:39:52 devstack sudo[93397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.dd82985e-f5e1-4a17-8244-705c061f064e 1G Jul 08 18:39:52 devstack sudo[93397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:39:54 devstack sudo[93397]: pam_unix(sudo:session): session closed for user root Jul 08 18:39:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-121653d5-4b0e-405d-8921-b0335131ef4d tempest-VolumesSnapshotListTestJSON-843736305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.dd82985e-f5e1-4a17-8244-705c061f064e 1G" returned: 0 in 1.123s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:39:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-121653d5-4b0e-405d-8921-b0335131ef4d tempest-VolumesSnapshotListTestJSON-843736305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8fa3369-35f4-4840-b649-101618c67921 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.dd82985e-f5e1-4a17-8244-705c061f064e {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:39:54 devstack sudo[93417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8fa3369-35f4-4840-b649-101618c67921 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.dd82985e-f5e1-4a17-8244-705c061f064e Jul 08 18:39:54 devstack sudo[93417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:39:54 devstack sudo[93417]: pam_unix(sudo:session): session closed for user root Jul 08 18:39:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-121653d5-4b0e-405d-8921-b0335131ef4d tempest-VolumesSnapshotListTestJSON-843736305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8fa3369-35f4-4840-b649-101618c67921 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.dd82985e-f5e1-4a17-8244-705c061f064e" returned: 0 in 0.862s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:39:54 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-121653d5-4b0e-405d-8921-b0335131ef4d tempest-VolumesSnapshotListTestJSON-843736305 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.dd82985e-f5e1-4a17-8244-705c061f064e is being set with open permissions: ugo+rw Jul 08 18:39:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-121653d5-4b0e-405d-8921-b0335131ef4d tempest-VolumesSnapshotListTestJSON-843736305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.dd82985e-f5e1-4a17-8244-705c061f064e {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:39:54 devstack sudo[93442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.dd82985e-f5e1-4a17-8244-705c061f064e Jul 08 18:39:54 devstack sudo[93442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:39:55 devstack sudo[93442]: pam_unix(sudo:session): session closed for user root Jul 08 18:39:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-121653d5-4b0e-405d-8921-b0335131ef4d tempest-VolumesSnapshotListTestJSON-843736305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.dd82985e-f5e1-4a17-8244-705c061f064e" returned: 0 in 0.784s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:39:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-121653d5-4b0e-405d-8921-b0335131ef4d tempest-VolumesSnapshotListTestJSON-843736305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:39:55 devstack sudo[93451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.info Jul 08 18:39:55 devstack sudo[93451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:39:56 devstack sudo[93451]: pam_unix(sudo:session): session closed for user root Jul 08 18:39:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-121653d5-4b0e-405d-8921-b0335131ef4d tempest-VolumesSnapshotListTestJSON-843736305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.info" returned: 0 in 0.798s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:39:56 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-121653d5-4b0e-405d-8921-b0335131ef4d tempest-VolumesSnapshotListTestJSON-843736305 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.info is being set with open permissions: ugo+rw Jul 08 18:39:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-121653d5-4b0e-405d-8921-b0335131ef4d tempest-VolumesSnapshotListTestJSON-843736305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:39:56 devstack sudo[93455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.info Jul 08 18:39:56 devstack sudo[93455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:39:57 devstack sudo[93455]: pam_unix(sudo:session): session closed for user root Jul 08 18:39:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-121653d5-4b0e-405d-8921-b0335131ef4d tempest-VolumesSnapshotListTestJSON-843736305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.info" returned: 0 in 1.207s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:39:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-121653d5-4b0e-405d-8921-b0335131ef4d tempest-VolumesSnapshotListTestJSON-843736305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.953s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:39:57 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-121653d5-4b0e-405d-8921-b0335131ef4d tempest-VolumesSnapshotListTestJSON-843736305 None] Create snapshot completed successfully Jul 08 18:39:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-4eb5822e-a35e-492a-a7ca-98cb8203da74 tempest-VolumesSnapshotListTestJSON-843736305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:39:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-4eb5822e-a35e-492a-a7ca-98cb8203da74 tempest-VolumesSnapshotListTestJSON-843736305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:39:58 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-999f3420-5c13-4052-8f77-88bad6d4baec tempest-AttachVolumeNegativeTest-1161175669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:39:58 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-999f3420-5c13-4052-8f77-88bad6d4baec tempest-AttachVolumeNegativeTest-1161175669 None] Flow 'volume_create_manager' (bc615bbb-1413-43e2-af30-19a853ba4c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:39:58 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-999f3420-5c13-4052-8f77-88bad6d4baec tempest-AttachVolumeNegativeTest-1161175669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d470109-1f2d-4df2-a5f5-bba8b4417970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:39:58 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-4eb5822e-a35e-492a-a7ca-98cb8203da74 tempest-VolumesSnapshotListTestJSON-843736305 None] Creating offline snapshot e5bf1eef-f8a6-408e-b28f-4b8f06f375d8 of volume c8fa3369-35f4-4840-b649-101618c67921 {{(pid=86873) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:39:58 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-999f3420-5c13-4052-8f77-88bad6d4baec tempest-AttachVolumeNegativeTest-1161175669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d470109-1f2d-4df2-a5f5-bba8b4417970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:39:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1115524276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deaf735b-3954-4ddb-88a2-7407cb3d1367,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='035c4dfd607044478d3458ed4f58e3a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:39:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:39:58Z,use_quota=True,user_id='543e2e6506b348a1a7caf34ac9ee1346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:39:58 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-999f3420-5c13-4052-8f77-88bad6d4baec tempest-AttachVolumeNegativeTest-1161175669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9199eaec-4925-4dd3-aa39-6e70906bc088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:39:58 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-999f3420-5c13-4052-8f77-88bad6d4baec tempest-AttachVolumeNegativeTest-1161175669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9199eaec-4925-4dd3-aa39-6e70906bc088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:39:58 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-999f3420-5c13-4052-8f77-88bad6d4baec tempest-AttachVolumeNegativeTest-1161175669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (044fb6dc-3f0b-4063-a350-e26e3df4aace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:39:58 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-999f3420-5c13-4052-8f77-88bad6d4baec tempest-AttachVolumeNegativeTest-1161175669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (044fb6dc-3f0b-4063-a350-e26e3df4aace) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'deaf735b-3954-4ddb-88a2-7407cb3d1367', 'volume_name': 'volume-deaf735b-3954-4ddb-88a2-7407cb3d1367', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:39:58 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-999f3420-5c13-4052-8f77-88bad6d4baec tempest-AttachVolumeNegativeTest-1161175669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09ccb56b-61e7-4146-886a-4780389bd461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:39:58 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-999f3420-5c13-4052-8f77-88bad6d4baec tempest-AttachVolumeNegativeTest-1161175669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09ccb56b-61e7-4146-886a-4780389bd461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:39:58 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-999f3420-5c13-4052-8f77-88bad6d4baec tempest-AttachVolumeNegativeTest-1161175669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d6f5081-60ba-4363-a50d-a68e22623de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:39:58 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-999f3420-5c13-4052-8f77-88bad6d4baec tempest-AttachVolumeNegativeTest-1161175669 None] Volume deaf735b-3954-4ddb-88a2-7407cb3d1367: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-deaf735b-3954-4ddb-88a2-7407cb3d1367', 'volume_size': 1} Jul 08 18:39:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-999f3420-5c13-4052-8f77-88bad6d4baec tempest-AttachVolumeNegativeTest-1161175669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:39:58 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[279f64c6-8354-48d3-97ea-ddd3f1e78709]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:39:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-4eb5822e-a35e-492a-a7ca-98cb8203da74 tempest-VolumesSnapshotListTestJSON-843736305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.dd82985e-f5e1-4a17-8244-705c061f064e {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:39:58 devstack sudo[93563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.dd82985e-f5e1-4a17-8244-705c061f064e Jul 08 18:39:58 devstack sudo[93563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:39:59 devstack sudo[93563]: pam_unix(sudo:session): session closed for user root Jul 08 18:39:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-4eb5822e-a35e-492a-a7ca-98cb8203da74 tempest-VolumesSnapshotListTestJSON-843736305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.dd82985e-f5e1-4a17-8244-705c061f064e" returned: 0 in 0.862s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:39:59 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-4eb5822e-a35e-492a-a7ca-98cb8203da74 tempest-VolumesSnapshotListTestJSON-843736305 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c8fa3369-35f4-4840-b649-101618c67921(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:39:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-4eb5822e-a35e-492a-a7ca-98cb8203da74 tempest-VolumesSnapshotListTestJSON-843736305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.dd82985e-f5e1-4a17-8244-705c061f064e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.e5bf1eef-f8a6-408e-b28f-4b8f06f375d8 1G {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:39:59 devstack sudo[93570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.dd82985e-f5e1-4a17-8244-705c061f064e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.e5bf1eef-f8a6-408e-b28f-4b8f06f375d8 1G Jul 08 18:39:59 devstack sudo[93570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:40:00 devstack sudo[93570]: pam_unix(sudo:session): session closed for user root Jul 08 18:40:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-4eb5822e-a35e-492a-a7ca-98cb8203da74 tempest-VolumesSnapshotListTestJSON-843736305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.dd82985e-f5e1-4a17-8244-705c061f064e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.e5bf1eef-f8a6-408e-b28f-4b8f06f375d8 1G" returned: 0 in 1.313s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:40:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-4eb5822e-a35e-492a-a7ca-98cb8203da74 tempest-VolumesSnapshotListTestJSON-843736305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8fa3369-35f4-4840-b649-101618c67921.dd82985e-f5e1-4a17-8244-705c061f064e -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.e5bf1eef-f8a6-408e-b28f-4b8f06f375d8 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:40:00 devstack sudo[93577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8fa3369-35f4-4840-b649-101618c67921.dd82985e-f5e1-4a17-8244-705c061f064e -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.e5bf1eef-f8a6-408e-b28f-4b8f06f375d8 Jul 08 18:40:00 devstack sudo[93577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:40:02 devstack sudo[93577]: pam_unix(sudo:session): session closed for user root Jul 08 18:40:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-4eb5822e-a35e-492a-a7ca-98cb8203da74 tempest-VolumesSnapshotListTestJSON-843736305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8fa3369-35f4-4840-b649-101618c67921.dd82985e-f5e1-4a17-8244-705c061f064e -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.e5bf1eef-f8a6-408e-b28f-4b8f06f375d8" returned: 0 in 1.252s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:40:02 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-4eb5822e-a35e-492a-a7ca-98cb8203da74 tempest-VolumesSnapshotListTestJSON-843736305 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.e5bf1eef-f8a6-408e-b28f-4b8f06f375d8 is being set with open permissions: ugo+rw Jul 08 18:40:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-4eb5822e-a35e-492a-a7ca-98cb8203da74 tempest-VolumesSnapshotListTestJSON-843736305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.e5bf1eef-f8a6-408e-b28f-4b8f06f375d8 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:40:02 devstack sudo[93599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.e5bf1eef-f8a6-408e-b28f-4b8f06f375d8 Jul 08 18:40:02 devstack sudo[93599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:40:03 devstack sudo[93599]: pam_unix(sudo:session): session closed for user root Jul 08 18:40:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-4eb5822e-a35e-492a-a7ca-98cb8203da74 tempest-VolumesSnapshotListTestJSON-843736305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.e5bf1eef-f8a6-408e-b28f-4b8f06f375d8" returned: 0 in 0.999s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:40:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-4eb5822e-a35e-492a-a7ca-98cb8203da74 tempest-VolumesSnapshotListTestJSON-843736305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.759s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:40:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-999f3420-5c13-4052-8f77-88bad6d4baec tempest-AttachVolumeNegativeTest-1161175669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.482s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:40:03 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-999f3420-5c13-4052-8f77-88bad6d4baec tempest-AttachVolumeNegativeTest-1161175669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:39:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1115524276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deaf735b-3954-4ddb-88a2-7407cb3d1367,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='035c4dfd607044478d3458ed4f58e3a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:39:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:39:58Z,use_quota=True,user_id='543e2e6506b348a1a7caf34ac9ee1346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:40:03 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-999f3420-5c13-4052-8f77-88bad6d4baec tempest-AttachVolumeNegativeTest-1161175669 None] Creating volume deaf735b-3954-4ddb-88a2-7407cb3d1367 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:40:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-999f3420-5c13-4052-8f77-88bad6d4baec tempest-AttachVolumeNegativeTest-1161175669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:40:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-999f3420-5c13-4052-8f77-88bad6d4baec tempest-AttachVolumeNegativeTest-1161175669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:40:03 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-999f3420-5c13-4052-8f77-88bad6d4baec tempest-AttachVolumeNegativeTest-1161175669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:40:03 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-999f3420-5c13-4052-8f77-88bad6d4baec tempest-AttachVolumeNegativeTest-1161175669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:40:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-999f3420-5c13-4052-8f77-88bad6d4baec tempest-AttachVolumeNegativeTest-1161175669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:40:03 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-999f3420-5c13-4052-8f77-88bad6d4baec tempest-AttachVolumeNegativeTest-1161175669 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:40:03 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-999f3420-5c13-4052-8f77-88bad6d4baec tempest-AttachVolumeNegativeTest-1161175669 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:40:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-999f3420-5c13-4052-8f77-88bad6d4baec tempest-AttachVolumeNegativeTest-1161175669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-deaf735b-3954-4ddb-88a2-7407cb3d1367 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:40:03 devstack sudo[93609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-deaf735b-3954-4ddb-88a2-7407cb3d1367 1073741824 Jul 08 18:40:03 devstack sudo[93609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:40:03 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-4eb5822e-a35e-492a-a7ca-98cb8203da74 tempest-VolumesSnapshotListTestJSON-843736305 None] Create snapshot completed successfully Jul 08 18:40:03 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c989d6c-bb04-4244-abcf-64500057fe61 tempest-TestMinimumBasicScenario-1335437034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:40:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3c989d6c-bb04-4244-abcf-64500057fe61 tempest-TestMinimumBasicScenario-1335437034 None] Flow 'volume_create_manager' (18a5b4e7-0d50-4cff-8dfb-1d3979d3bbcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:40:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3c989d6c-bb04-4244-abcf-64500057fe61 tempest-TestMinimumBasicScenario-1335437034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19c5644c-5dfd-4a48-80a0-072e8b235d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:40:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3c989d6c-bb04-4244-abcf-64500057fe61 tempest-TestMinimumBasicScenario-1335437034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19c5644c-5dfd-4a48-80a0-072e8b235d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:40:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-451411345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cc87414-83b6-411f-932a-c88d6236e18c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='195573e396cc4485a112647f2028f512',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:40:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:40:04Z,use_quota=True,user_id='d045662bd2d14e4d879a17bcbdbb33be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:40:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3c989d6c-bb04-4244-abcf-64500057fe61 tempest-TestMinimumBasicScenario-1335437034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da3e431f-326b-4959-be58-e4b8ce7c864a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:40:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3c989d6c-bb04-4244-abcf-64500057fe61 tempest-TestMinimumBasicScenario-1335437034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da3e431f-326b-4959-be58-e4b8ce7c864a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:40:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3c989d6c-bb04-4244-abcf-64500057fe61 tempest-TestMinimumBasicScenario-1335437034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1811d0a1-137e-4466-b143-3cc04e9cc54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:40:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3c989d6c-bb04-4244-abcf-64500057fe61 tempest-TestMinimumBasicScenario-1335437034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1811d0a1-137e-4466-b143-3cc04e9cc54c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cc87414-83b6-411f-932a-c88d6236e18c', 'volume_name': 'volume-3cc87414-83b6-411f-932a-c88d6236e18c', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:40:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3c989d6c-bb04-4244-abcf-64500057fe61 tempest-TestMinimumBasicScenario-1335437034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8446c96-92e0-4547-8154-f2d47177e644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:40:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3c989d6c-bb04-4244-abcf-64500057fe61 tempest-TestMinimumBasicScenario-1335437034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8446c96-92e0-4547-8154-f2d47177e644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:40:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3c989d6c-bb04-4244-abcf-64500057fe61 tempest-TestMinimumBasicScenario-1335437034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2cc1620-a8c4-4f46-bb2a-bfa83903cfe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:40:03 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-3c989d6c-bb04-4244-abcf-64500057fe61 tempest-TestMinimumBasicScenario-1335437034 None] Volume 3cc87414-83b6-411f-932a-c88d6236e18c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cc87414-83b6-411f-932a-c88d6236e18c', 'volume_size': 1} Jul 08 18:40:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3c989d6c-bb04-4244-abcf-64500057fe61 tempest-TestMinimumBasicScenario-1335437034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:40:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c139f6d5-d5e4-445b-8ffb-0218896b8bce tempest-VolumesSnapshotListTestJSON-843736305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:40:04 devstack sudo[93609]: pam_unix(sudo:session): session closed for user root Jul 08 18:40:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-999f3420-5c13-4052-8f77-88bad6d4baec tempest-AttachVolumeNegativeTest-1161175669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-deaf735b-3954-4ddb-88a2-7407cb3d1367 1073741824" returned: 0 in 1.144s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:40:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-999f3420-5c13-4052-8f77-88bad6d4baec tempest-AttachVolumeNegativeTest-1161175669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-deaf735b-3954-4ddb-88a2-7407cb3d1367 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:40:04 devstack sudo[93616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-deaf735b-3954-4ddb-88a2-7407cb3d1367 Jul 08 18:40:04 devstack sudo[93616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:40:05 devstack sudo[93616]: pam_unix(sudo:session): session closed for user root Jul 08 18:40:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-999f3420-5c13-4052-8f77-88bad6d4baec tempest-AttachVolumeNegativeTest-1161175669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-deaf735b-3954-4ddb-88a2-7407cb3d1367" returned: 0 in 0.763s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:40:05 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-999f3420-5c13-4052-8f77-88bad6d4baec tempest-AttachVolumeNegativeTest-1161175669 None] <== create_volume: return (1962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:40:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-999f3420-5c13-4052-8f77-88bad6d4baec tempest-AttachVolumeNegativeTest-1161175669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.966s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:40:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3c989d6c-bb04-4244-abcf-64500057fe61 tempest-TestMinimumBasicScenario-1335437034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.458s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:40:05 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-3c989d6c-bb04-4244-abcf-64500057fe61 tempest-TestMinimumBasicScenario-1335437034 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:40:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-451411345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cc87414-83b6-411f-932a-c88d6236e18c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='195573e396cc4485a112647f2028f512',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:40:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:40:04Z,use_quota=True,user_id='d045662bd2d14e4d879a17bcbdbb33be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:40:05 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-3c989d6c-bb04-4244-abcf-64500057fe61 tempest-TestMinimumBasicScenario-1335437034 None] Creating volume 3cc87414-83b6-411f-932a-c88d6236e18c {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:40:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3c989d6c-bb04-4244-abcf-64500057fe61 tempest-TestMinimumBasicScenario-1335437034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:40:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3c989d6c-bb04-4244-abcf-64500057fe61 tempest-TestMinimumBasicScenario-1335437034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:40:05 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-3c989d6c-bb04-4244-abcf-64500057fe61 tempest-TestMinimumBasicScenario-1335437034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:40:05 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-3c989d6c-bb04-4244-abcf-64500057fe61 tempest-TestMinimumBasicScenario-1335437034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:40:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3c989d6c-bb04-4244-abcf-64500057fe61 tempest-TestMinimumBasicScenario-1335437034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:40:05 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-3c989d6c-bb04-4244-abcf-64500057fe61 tempest-TestMinimumBasicScenario-1335437034 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:40:05 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-3c989d6c-bb04-4244-abcf-64500057fe61 tempest-TestMinimumBasicScenario-1335437034 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:40:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3c989d6c-bb04-4244-abcf-64500057fe61 tempest-TestMinimumBasicScenario-1335437034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3cc87414-83b6-411f-932a-c88d6236e18c 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:40:05 devstack sudo[93619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3cc87414-83b6-411f-932a-c88d6236e18c 1073741824 Jul 08 18:40:05 devstack sudo[93619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:40:05 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-999f3420-5c13-4052-8f77-88bad6d4baec tempest-AttachVolumeNegativeTest-1161175669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d6f5081-60ba-4363-a50d-a68e22623de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-deaf735b-3954-4ddb-88a2-7407cb3d1367', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:40:05 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-999f3420-5c13-4052-8f77-88bad6d4baec tempest-AttachVolumeNegativeTest-1161175669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3810032c-0b1a-4eb5-a6da-b98698234e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:40:05 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-999f3420-5c13-4052-8f77-88bad6d4baec tempest-AttachVolumeNegativeTest-1161175669 None] Volume volume-deaf735b-3954-4ddb-88a2-7407cb3d1367 (deaf735b-3954-4ddb-88a2-7407cb3d1367): created successfully Jul 08 18:40:05 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-999f3420-5c13-4052-8f77-88bad6d4baec tempest-AttachVolumeNegativeTest-1161175669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3810032c-0b1a-4eb5-a6da-b98698234e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:40:05 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-999f3420-5c13-4052-8f77-88bad6d4baec tempest-AttachVolumeNegativeTest-1161175669 None] Flow 'volume_create_manager' (bc615bbb-1413-43e2-af30-19a853ba4c3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:40:05 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-999f3420-5c13-4052-8f77-88bad6d4baec tempest-AttachVolumeNegativeTest-1161175669 None] Created volume successfully. Jul 08 18:40:06 devstack sudo[93619]: pam_unix(sudo:session): session closed for user root Jul 08 18:40:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3c989d6c-bb04-4244-abcf-64500057fe61 tempest-TestMinimumBasicScenario-1335437034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3cc87414-83b6-411f-932a-c88d6236e18c 1073741824" returned: 0 in 0.917s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:40:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3c989d6c-bb04-4244-abcf-64500057fe61 tempest-TestMinimumBasicScenario-1335437034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3cc87414-83b6-411f-932a-c88d6236e18c {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:40:06 devstack sudo[93626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3cc87414-83b6-411f-932a-c88d6236e18c Jul 08 18:40:06 devstack sudo[93626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:40:07 devstack sudo[93626]: pam_unix(sudo:session): session closed for user root Jul 08 18:40:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3c989d6c-bb04-4244-abcf-64500057fe61 tempest-TestMinimumBasicScenario-1335437034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3cc87414-83b6-411f-932a-c88d6236e18c" returned: 0 in 1.148s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:40:07 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-3c989d6c-bb04-4244-abcf-64500057fe61 tempest-TestMinimumBasicScenario-1335437034 None] <== create_volume: return (2118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:40:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3c989d6c-bb04-4244-abcf-64500057fe61 tempest-TestMinimumBasicScenario-1335437034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.121s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:40:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c139f6d5-d5e4-445b-8ffb-0218896b8bce tempest-VolumesSnapshotListTestJSON-843736305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.321s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:40:07 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-c139f6d5-d5e4-445b-8ffb-0218896b8bce tempest-VolumesSnapshotListTestJSON-843736305 None] Creating offline snapshot 265a84b0-12e6-4c25-a3ca-8b7ebbc9fc26 of volume c8fa3369-35f4-4840-b649-101618c67921 {{(pid=86873) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:40:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3c989d6c-bb04-4244-abcf-64500057fe61 tempest-TestMinimumBasicScenario-1335437034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2cc1620-a8c4-4f46-bb2a-bfa83903cfe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cc87414-83b6-411f-932a-c88d6236e18c', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:40:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3c989d6c-bb04-4244-abcf-64500057fe61 tempest-TestMinimumBasicScenario-1335437034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df7b911a-07e4-40a6-b299-ff08dcf75753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:40:07 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-3c989d6c-bb04-4244-abcf-64500057fe61 tempest-TestMinimumBasicScenario-1335437034 None] Volume volume-3cc87414-83b6-411f-932a-c88d6236e18c (3cc87414-83b6-411f-932a-c88d6236e18c): created successfully Jul 08 18:40:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3c989d6c-bb04-4244-abcf-64500057fe61 tempest-TestMinimumBasicScenario-1335437034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df7b911a-07e4-40a6-b299-ff08dcf75753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:40:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3c989d6c-bb04-4244-abcf-64500057fe61 tempest-TestMinimumBasicScenario-1335437034 None] Flow 'volume_create_manager' (18a5b4e7-0d50-4cff-8dfb-1d3979d3bbcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:40:07 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9272762-bc2a-486e-80b4-5d3aa5d9e06b]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:40:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c139f6d5-d5e4-445b-8ffb-0218896b8bce tempest-VolumesSnapshotListTestJSON-843736305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.e5bf1eef-f8a6-408e-b28f-4b8f06f375d8 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:40:07 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-3c989d6c-bb04-4244-abcf-64500057fe61 tempest-TestMinimumBasicScenario-1335437034 None] Created volume successfully. Jul 08 18:40:07 devstack sudo[93675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.e5bf1eef-f8a6-408e-b28f-4b8f06f375d8 Jul 08 18:40:07 devstack sudo[93675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:40:08 devstack sudo[93675]: pam_unix(sudo:session): session closed for user root Jul 08 18:40:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c139f6d5-d5e4-445b-8ffb-0218896b8bce tempest-VolumesSnapshotListTestJSON-843736305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.e5bf1eef-f8a6-408e-b28f-4b8f06f375d8" returned: 0 in 0.957s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:40:08 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-c139f6d5-d5e4-445b-8ffb-0218896b8bce tempest-VolumesSnapshotListTestJSON-843736305 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c8fa3369-35f4-4840-b649-101618c67921(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:40:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c139f6d5-d5e4-445b-8ffb-0218896b8bce tempest-VolumesSnapshotListTestJSON-843736305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.e5bf1eef-f8a6-408e-b28f-4b8f06f375d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.265a84b0-12e6-4c25-a3ca-8b7ebbc9fc26 1G {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:40:08 devstack sudo[93707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.e5bf1eef-f8a6-408e-b28f-4b8f06f375d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.265a84b0-12e6-4c25-a3ca-8b7ebbc9fc26 1G Jul 08 18:40:08 devstack sudo[93707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:40:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-a24d2453-1bff-4e1a-b566-aa96fac8d70b req-1dbb3e32-a1df-40ce-9e8e-33411f635a0d tempest-AttachVolumeNegativeTest-1161175669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:40:09 devstack sudo[93707]: pam_unix(sudo:session): session closed for user root Jul 08 18:40:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c139f6d5-d5e4-445b-8ffb-0218896b8bce tempest-VolumesSnapshotListTestJSON-843736305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.e5bf1eef-f8a6-408e-b28f-4b8f06f375d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.265a84b0-12e6-4c25-a3ca-8b7ebbc9fc26 1G" returned: 0 in 1.206s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:40:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c139f6d5-d5e4-445b-8ffb-0218896b8bce tempest-VolumesSnapshotListTestJSON-843736305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8fa3369-35f4-4840-b649-101618c67921.e5bf1eef-f8a6-408e-b28f-4b8f06f375d8 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.265a84b0-12e6-4c25-a3ca-8b7ebbc9fc26 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:40:09 devstack sudo[93724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8fa3369-35f4-4840-b649-101618c67921.e5bf1eef-f8a6-408e-b28f-4b8f06f375d8 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.265a84b0-12e6-4c25-a3ca-8b7ebbc9fc26 Jul 08 18:40:09 devstack sudo[93724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:40:10 devstack sudo[93724]: pam_unix(sudo:session): session closed for user root Jul 08 18:40:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c139f6d5-d5e4-445b-8ffb-0218896b8bce tempest-VolumesSnapshotListTestJSON-843736305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8fa3369-35f4-4840-b649-101618c67921.e5bf1eef-f8a6-408e-b28f-4b8f06f375d8 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.265a84b0-12e6-4c25-a3ca-8b7ebbc9fc26" returned: 0 in 1.053s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:40:10 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-c139f6d5-d5e4-445b-8ffb-0218896b8bce tempest-VolumesSnapshotListTestJSON-843736305 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.265a84b0-12e6-4c25-a3ca-8b7ebbc9fc26 is being set with open permissions: ugo+rw Jul 08 18:40:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c139f6d5-d5e4-445b-8ffb-0218896b8bce tempest-VolumesSnapshotListTestJSON-843736305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.265a84b0-12e6-4c25-a3ca-8b7ebbc9fc26 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:40:10 devstack sudo[93731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.265a84b0-12e6-4c25-a3ca-8b7ebbc9fc26 Jul 08 18:40:10 devstack sudo[93731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:40:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-0ef6a240-6a0a-4f3f-8740-806cc7b95d2f req-d2f82ea6-2bcb-4797-b4ca-4d5577167677 tempest-TestMinimumBasicScenario-1335437034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:40:11 devstack sudo[93731]: pam_unix(sudo:session): session closed for user root Jul 08 18:40:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c139f6d5-d5e4-445b-8ffb-0218896b8bce tempest-VolumesSnapshotListTestJSON-843736305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.265a84b0-12e6-4c25-a3ca-8b7ebbc9fc26" returned: 0 in 0.825s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:40:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c139f6d5-d5e4-445b-8ffb-0218896b8bce tempest-VolumesSnapshotListTestJSON-843736305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.239s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:40:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-a24d2453-1bff-4e1a-b566-aa96fac8d70b req-1dbb3e32-a1df-40ce-9e8e-33411f635a0d tempest-AttachVolumeNegativeTest-1161175669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.954s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:40:11 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac7f36d-5aa1-4ba8-9dc7-5b4fb0ce992e]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:40:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-a24d2453-1bff-4e1a-b566-aa96fac8d70b req-1dbb3e32-a1df-40ce-9e8e-33411f635a0d tempest-AttachVolumeNegativeTest-1161175669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-deaf735b-3954-4ddb-88a2-7407cb3d1367 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:40:11 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-c139f6d5-d5e4-445b-8ffb-0218896b8bce tempest-VolumesSnapshotListTestJSON-843736305 None] Create snapshot completed successfully Jul 08 18:40:11 devstack sudo[93742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-deaf735b-3954-4ddb-88a2-7407cb3d1367 Jul 08 18:40:11 devstack sudo[93742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:40:12 devstack sudo[93742]: pam_unix(sudo:session): session closed for user root Jul 08 18:40:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-a24d2453-1bff-4e1a-b566-aa96fac8d70b req-1dbb3e32-a1df-40ce-9e8e-33411f635a0d tempest-AttachVolumeNegativeTest-1161175669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-deaf735b-3954-4ddb-88a2-7407cb3d1367" returned: 0 in 1.054s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:40:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-a24d2453-1bff-4e1a-b566-aa96fac8d70b req-1dbb3e32-a1df-40ce-9e8e-33411f635a0d tempest-AttachVolumeNegativeTest-1161175669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.075s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:40:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-0ef6a240-6a0a-4f3f-8740-806cc7b95d2f req-d2f82ea6-2bcb-4797-b4ca-4d5577167677 tempest-TestMinimumBasicScenario-1335437034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.292s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:40:12 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e4e1e7b-219d-4708-a408-5e2705cce9d7]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:40:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-0ef6a240-6a0a-4f3f-8740-806cc7b95d2f req-d2f82ea6-2bcb-4797-b4ca-4d5577167677 tempest-TestMinimumBasicScenario-1335437034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3cc87414-83b6-411f-932a-c88d6236e18c {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:40:12 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-a24d2453-1bff-4e1a-b566-aa96fac8d70b req-1dbb3e32-a1df-40ce-9e8e-33411f635a0d tempest-AttachVolumeNegativeTest-1161175669 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2', 'name': 'volume-deaf735b-3954-4ddb-88a2-7407cb3d1367', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c6a1179e-1998-4a7a-bfd3-1fe6b4e316af', 'enforce_multipath': True} {{(pid=86873) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 18:40:12 devstack sudo[93759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3cc87414-83b6-411f-932a-c88d6236e18c Jul 08 18:40:12 devstack sudo[93759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:40:12 devstack cinder-volume[86873]: INFO cinder.volume.manager [req-a24d2453-1bff-4e1a-b566-aa96fac8d70b req-1dbb3e32-a1df-40ce-9e8e-33411f635a0d tempest-AttachVolumeNegativeTest-1161175669 None] attachment_update completed successfully. Jul 08 18:40:13 devstack sudo[93759]: pam_unix(sudo:session): session closed for user root Jul 08 18:40:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-0ef6a240-6a0a-4f3f-8740-806cc7b95d2f req-d2f82ea6-2bcb-4797-b4ca-4d5577167677 tempest-TestMinimumBasicScenario-1335437034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3cc87414-83b6-411f-932a-c88d6236e18c" returned: 0 in 1.332s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:40:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-0ef6a240-6a0a-4f3f-8740-806cc7b95d2f req-d2f82ea6-2bcb-4797-b4ca-4d5577167677 tempest-TestMinimumBasicScenario-1335437034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.363s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:40:14 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-0ef6a240-6a0a-4f3f-8740-806cc7b95d2f req-d2f82ea6-2bcb-4797-b4ca-4d5577167677 tempest-TestMinimumBasicScenario-1335437034 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2', 'name': 'volume-3cc87414-83b6-411f-932a-c88d6236e18c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '60466609-6264-4c56-a7da-7eb64224e149', 'enforce_multipath': True} {{(pid=86873) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 18:40:14 devstack cinder-volume[86873]: INFO cinder.volume.manager [req-0ef6a240-6a0a-4f3f-8740-806cc7b95d2f req-d2f82ea6-2bcb-4797-b4ca-4d5577167677 tempest-TestMinimumBasicScenario-1335437034 None] attachment_update completed successfully. Jul 08 18:40:14 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-8882efd0-f767-41a9-9952-97e0748b059f tempest-VolumesSnapshotListTestJSON-843736305 None] Acquiring lock "cinder-265a84b0-12e6-4c25-a3ca-8b7ebbc9fc26-delete_snapshot" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:40:14 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-8882efd0-f767-41a9-9952-97e0748b059f tempest-VolumesSnapshotListTestJSON-843736305 None] Lock "cinder-265a84b0-12e6-4c25-a3ca-8b7ebbc9fc26-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:40:14 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-8882efd0-f767-41a9-9952-97e0748b059f tempest-VolumesSnapshotListTestJSON-843736305 None] Acquiring lock "cinder-quobyte-c8fa3369-35f4-4840-b649-101618c67921" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:40:14 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-8882efd0-f767-41a9-9952-97e0748b059f tempest-VolumesSnapshotListTestJSON-843736305 None] Lock "cinder-quobyte-c8fa3369-35f4-4840-b649-101618c67921" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:40:14 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-8882efd0-f767-41a9-9952-97e0748b059f tempest-VolumesSnapshotListTestJSON-843736305 None] Acquiring lock "cinder-quobyte-265a84b0-12e6-4c25-a3ca-8b7ebbc9fc26" by "_delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:40:14 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-8882efd0-f767-41a9-9952-97e0748b059f tempest-VolumesSnapshotListTestJSON-843736305 None] Lock "cinder-quobyte-265a84b0-12e6-4c25-a3ca-8b7ebbc9fc26" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:40:14 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-8882efd0-f767-41a9-9952-97e0748b059f tempest-VolumesSnapshotListTestJSON-843736305 None] Deleting offline snapshot 265a84b0-12e6-4c25-a3ca-8b7ebbc9fc26 of volume c8fa3369-35f4-4840-b649-101618c67921 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:40:14 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-8882efd0-f767-41a9-9952-97e0748b059f tempest-VolumesSnapshotListTestJSON-843736305 None] snapshot_file for this snap is: volume-c8fa3369-35f4-4840-b649-101618c67921.265a84b0-12e6-4c25-a3ca-8b7ebbc9fc26 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:40:14 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b30cb7-c476-458a-8a6a-927b21202481]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:40:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8882efd0-f767-41a9-9952-97e0748b059f tempest-VolumesSnapshotListTestJSON-843736305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.265a84b0-12e6-4c25-a3ca-8b7ebbc9fc26 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:40:14 devstack sudo[94152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.265a84b0-12e6-4c25-a3ca-8b7ebbc9fc26 Jul 08 18:40:14 devstack sudo[94152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:40:15 devstack sudo[94152]: pam_unix(sudo:session): session closed for user root Jul 08 18:40:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8882efd0-f767-41a9-9952-97e0748b059f tempest-VolumesSnapshotListTestJSON-843736305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.265a84b0-12e6-4c25-a3ca-8b7ebbc9fc26" returned: 0 in 0.853s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:40:15 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-8882efd0-f767-41a9-9952-97e0748b059f tempest-VolumesSnapshotListTestJSON-843736305 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c8fa3369-35f4-4840-b649-101618c67921(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:40:15 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8ccf7f-778e-4f75-946d-1227f3f4cce0]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:40:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8882efd0-f767-41a9-9952-97e0748b059f tempest-VolumesSnapshotListTestJSON-843736305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.e5bf1eef-f8a6-408e-b28f-4b8f06f375d8 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:40:15 devstack sudo[94166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.e5bf1eef-f8a6-408e-b28f-4b8f06f375d8 Jul 08 18:40:15 devstack sudo[94166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:40:16 devstack sudo[94166]: pam_unix(sudo:session): session closed for user root Jul 08 18:40:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8882efd0-f767-41a9-9952-97e0748b059f tempest-VolumesSnapshotListTestJSON-843736305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.e5bf1eef-f8a6-408e-b28f-4b8f06f375d8" returned: 0 in 0.787s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:40:16 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-8882efd0-f767-41a9-9952-97e0748b059f tempest-VolumesSnapshotListTestJSON-843736305 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c8fa3369-35f4-4840-b649-101618c67921(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:40:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8882efd0-f767-41a9-9952-97e0748b059f tempest-VolumesSnapshotListTestJSON-843736305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.265a84b0-12e6-4c25-a3ca-8b7ebbc9fc26 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:40:16 devstack sudo[94171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.265a84b0-12e6-4c25-a3ca-8b7ebbc9fc26 Jul 08 18:40:16 devstack sudo[94171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:40:17 devstack sudo[94171]: pam_unix(sudo:session): session closed for user root Jul 08 18:40:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8882efd0-f767-41a9-9952-97e0748b059f tempest-VolumesSnapshotListTestJSON-843736305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.265a84b0-12e6-4c25-a3ca-8b7ebbc9fc26" returned: 0 in 0.856s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:40:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8882efd0-f767-41a9-9952-97e0748b059f tempest-VolumesSnapshotListTestJSON-843736305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.265a84b0-12e6-4c25-a3ca-8b7ebbc9fc26 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:40:17 devstack sudo[94177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.265a84b0-12e6-4c25-a3ca-8b7ebbc9fc26 Jul 08 18:40:17 devstack sudo[94177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:40:18 devstack sudo[94177]: pam_unix(sudo:session): session closed for user root Jul 08 18:40:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8882efd0-f767-41a9-9952-97e0748b059f tempest-VolumesSnapshotListTestJSON-843736305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.265a84b0-12e6-4c25-a3ca-8b7ebbc9fc26" returned: 0 in 0.766s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:40:18 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-8882efd0-f767-41a9-9952-97e0748b059f tempest-VolumesSnapshotListTestJSON-843736305 None] Lock "cinder-quobyte-265a84b0-12e6-4c25-a3ca-8b7ebbc9fc26" released by "_delete_snapshot" :: held 3.390s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:40:18 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-8882efd0-f767-41a9-9952-97e0748b059f tempest-VolumesSnapshotListTestJSON-843736305 None] Lock "cinder-quobyte-c8fa3369-35f4-4840-b649-101618c67921" released by "delete_snapshot" :: held 3.417s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:40:18 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-8882efd0-f767-41a9-9952-97e0748b059f tempest-VolumesSnapshotListTestJSON-843736305 None] Created reservations ['252eaf26-d3aa-45be-8694-839994263705', '081049cf-a42d-48dd-880d-1d11739a1314', '7002e4b7-88c1-4d4a-8bf2-4f9c06cdefb7', '945745e1-baec-41b3-b4b6-289491762e77'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:40:18 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-8882efd0-f767-41a9-9952-97e0748b059f tempest-VolumesSnapshotListTestJSON-843736305 None] Delete snapshot completed successfully. Jul 08 18:40:18 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-8882efd0-f767-41a9-9952-97e0748b059f tempest-VolumesSnapshotListTestJSON-843736305 None] Lock "cinder-265a84b0-12e6-4c25-a3ca-8b7ebbc9fc26-delete_snapshot" released by "delete_snapshot" :: held 3.613s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:40:18 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b1a72fd3-9832-4889-ac4e-d3491cd9c54a tempest-VolumesSnapshotListTestJSON-843736305 None] Acquiring lock "cinder-e5bf1eef-f8a6-408e-b28f-4b8f06f375d8-delete_snapshot" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:40:18 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b1a72fd3-9832-4889-ac4e-d3491cd9c54a tempest-VolumesSnapshotListTestJSON-843736305 None] Lock "cinder-e5bf1eef-f8a6-408e-b28f-4b8f06f375d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:40:18 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b1a72fd3-9832-4889-ac4e-d3491cd9c54a tempest-VolumesSnapshotListTestJSON-843736305 None] Acquiring lock "cinder-quobyte-c8fa3369-35f4-4840-b649-101618c67921" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:40:18 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b1a72fd3-9832-4889-ac4e-d3491cd9c54a tempest-VolumesSnapshotListTestJSON-843736305 None] Lock "cinder-quobyte-c8fa3369-35f4-4840-b649-101618c67921" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:40:18 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b1a72fd3-9832-4889-ac4e-d3491cd9c54a tempest-VolumesSnapshotListTestJSON-843736305 None] Acquiring lock "cinder-quobyte-e5bf1eef-f8a6-408e-b28f-4b8f06f375d8" by "_delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:40:18 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b1a72fd3-9832-4889-ac4e-d3491cd9c54a tempest-VolumesSnapshotListTestJSON-843736305 None] Lock "cinder-quobyte-e5bf1eef-f8a6-408e-b28f-4b8f06f375d8" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:40:18 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-b1a72fd3-9832-4889-ac4e-d3491cd9c54a tempest-VolumesSnapshotListTestJSON-843736305 None] Deleting offline snapshot e5bf1eef-f8a6-408e-b28f-4b8f06f375d8 of volume c8fa3369-35f4-4840-b649-101618c67921 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:40:19 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-b1a72fd3-9832-4889-ac4e-d3491cd9c54a tempest-VolumesSnapshotListTestJSON-843736305 None] snapshot_file for this snap is: volume-c8fa3369-35f4-4840-b649-101618c67921.e5bf1eef-f8a6-408e-b28f-4b8f06f375d8 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:40:19 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[45dbec75-9540-4d93-83cb-f633919b764b]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:40:19 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b1a72fd3-9832-4889-ac4e-d3491cd9c54a tempest-VolumesSnapshotListTestJSON-843736305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.e5bf1eef-f8a6-408e-b28f-4b8f06f375d8 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:40:19 devstack sudo[94181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.e5bf1eef-f8a6-408e-b28f-4b8f06f375d8 Jul 08 18:40:19 devstack sudo[94181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:40:20 devstack cinder-volume[86873]: INFO cinder.volume.manager [req-323d2139-c281-49fb-ae16-66cf064f6b02 req-bcfb88ff-98a5-490d-8931-c6f6860a889e tempest-AttachVolumeNegativeTest-1161175669 None] Terminate volume connection completed successfully. Jul 08 18:40:20 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-323d2139-c281-49fb-ae16-66cf064f6b02 req-bcfb88ff-98a5-490d-8931-c6f6860a889e tempest-AttachVolumeNegativeTest-1161175669 None] Deleting attachment c6a1179e-1998-4a7a-bfd3-1fe6b4e316af. {{(pid=86873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 18:40:20 devstack sudo[94181]: pam_unix(sudo:session): session closed for user root Jul 08 18:40:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b1a72fd3-9832-4889-ac4e-d3491cd9c54a tempest-VolumesSnapshotListTestJSON-843736305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.e5bf1eef-f8a6-408e-b28f-4b8f06f375d8" returned: 0 in 1.102s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:40:20 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-b1a72fd3-9832-4889-ac4e-d3491cd9c54a tempest-VolumesSnapshotListTestJSON-843736305 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c8fa3369-35f4-4840-b649-101618c67921(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:40:20 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4944a4-5399-45f9-9c8b-c99c594642a7]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:40:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b1a72fd3-9832-4889-ac4e-d3491cd9c54a tempest-VolumesSnapshotListTestJSON-843736305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.dd82985e-f5e1-4a17-8244-705c061f064e {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:40:20 devstack sudo[94188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.dd82985e-f5e1-4a17-8244-705c061f064e Jul 08 18:40:20 devstack sudo[94188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:40:21 devstack sudo[94188]: pam_unix(sudo:session): session closed for user root Jul 08 18:40:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b1a72fd3-9832-4889-ac4e-d3491cd9c54a tempest-VolumesSnapshotListTestJSON-843736305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.dd82985e-f5e1-4a17-8244-705c061f064e" returned: 0 in 1.127s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:40:21 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-b1a72fd3-9832-4889-ac4e-d3491cd9c54a tempest-VolumesSnapshotListTestJSON-843736305 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c8fa3369-35f4-4840-b649-101618c67921(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:40:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b1a72fd3-9832-4889-ac4e-d3491cd9c54a tempest-VolumesSnapshotListTestJSON-843736305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.e5bf1eef-f8a6-408e-b28f-4b8f06f375d8 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:40:21 devstack sudo[94200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.e5bf1eef-f8a6-408e-b28f-4b8f06f375d8 Jul 08 18:40:21 devstack sudo[94200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:40:22 devstack sudo[94200]: pam_unix(sudo:session): session closed for user root Jul 08 18:40:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b1a72fd3-9832-4889-ac4e-d3491cd9c54a tempest-VolumesSnapshotListTestJSON-843736305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.e5bf1eef-f8a6-408e-b28f-4b8f06f375d8" returned: 0 in 1.250s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:40:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b1a72fd3-9832-4889-ac4e-d3491cd9c54a tempest-VolumesSnapshotListTestJSON-843736305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.e5bf1eef-f8a6-408e-b28f-4b8f06f375d8 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:40:22 devstack sudo[94262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.e5bf1eef-f8a6-408e-b28f-4b8f06f375d8 Jul 08 18:40:22 devstack sudo[94262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:40:23 devstack sudo[94262]: pam_unix(sudo:session): session closed for user root Jul 08 18:40:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b1a72fd3-9832-4889-ac4e-d3491cd9c54a tempest-VolumesSnapshotListTestJSON-843736305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.e5bf1eef-f8a6-408e-b28f-4b8f06f375d8" returned: 0 in 0.771s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:40:23 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b1a72fd3-9832-4889-ac4e-d3491cd9c54a tempest-VolumesSnapshotListTestJSON-843736305 None] Lock "cinder-quobyte-e5bf1eef-f8a6-408e-b28f-4b8f06f375d8" released by "_delete_snapshot" :: held 4.418s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:40:23 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b1a72fd3-9832-4889-ac4e-d3491cd9c54a tempest-VolumesSnapshotListTestJSON-843736305 None] Lock "cinder-quobyte-c8fa3369-35f4-4840-b649-101618c67921" released by "delete_snapshot" :: held 4.451s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:40:23 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:SELECT=48,cinder:UPDATE=53,cinder:DELETE=6,cinder:INSERT=11 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:40:23 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-b1a72fd3-9832-4889-ac4e-d3491cd9c54a tempest-VolumesSnapshotListTestJSON-843736305 None] Created reservations ['931b85ea-ac3b-4bbe-a49e-2138802f031e', '1f204257-c021-4d8b-ba2a-a4a9deacd9b1', '89ce128d-a082-47fd-bc45-75dfae4c3c70', 'e8c71f1d-1b8e-4498-a027-c0778cb19170'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:40:23 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-b1a72fd3-9832-4889-ac4e-d3491cd9c54a tempest-VolumesSnapshotListTestJSON-843736305 None] Delete snapshot completed successfully. Jul 08 18:40:23 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b1a72fd3-9832-4889-ac4e-d3491cd9c54a tempest-VolumesSnapshotListTestJSON-843736305 None] Lock "cinder-e5bf1eef-f8a6-408e-b28f-4b8f06f375d8-delete_snapshot" released by "delete_snapshot" :: held 4.643s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:40:24 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-498b9ffb-5a88-4f0f-adf0-ed15743a9519 tempest-VolumesSnapshotListTestJSON-843736305 None] Acquiring lock "cinder-dd82985e-f5e1-4a17-8244-705c061f064e-delete_snapshot" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:40:24 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-498b9ffb-5a88-4f0f-adf0-ed15743a9519 tempest-VolumesSnapshotListTestJSON-843736305 None] Lock "cinder-dd82985e-f5e1-4a17-8244-705c061f064e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:40:24 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-498b9ffb-5a88-4f0f-adf0-ed15743a9519 tempest-VolumesSnapshotListTestJSON-843736305 None] Acquiring lock "cinder-quobyte-c8fa3369-35f4-4840-b649-101618c67921" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:40:24 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-498b9ffb-5a88-4f0f-adf0-ed15743a9519 tempest-VolumesSnapshotListTestJSON-843736305 None] Lock "cinder-quobyte-c8fa3369-35f4-4840-b649-101618c67921" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:40:24 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-498b9ffb-5a88-4f0f-adf0-ed15743a9519 tempest-VolumesSnapshotListTestJSON-843736305 None] Acquiring lock "cinder-quobyte-dd82985e-f5e1-4a17-8244-705c061f064e" by "_delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:40:24 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-498b9ffb-5a88-4f0f-adf0-ed15743a9519 tempest-VolumesSnapshotListTestJSON-843736305 None] Lock "cinder-quobyte-dd82985e-f5e1-4a17-8244-705c061f064e" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:40:24 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-498b9ffb-5a88-4f0f-adf0-ed15743a9519 tempest-VolumesSnapshotListTestJSON-843736305 None] Deleting offline snapshot dd82985e-f5e1-4a17-8244-705c061f064e of volume c8fa3369-35f4-4840-b649-101618c67921 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:40:24 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-498b9ffb-5a88-4f0f-adf0-ed15743a9519 tempest-VolumesSnapshotListTestJSON-843736305 None] snapshot_file for this snap is: volume-c8fa3369-35f4-4840-b649-101618c67921.dd82985e-f5e1-4a17-8244-705c061f064e {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:40:24 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7995fc-e28a-4ca6-8790-a0c1100a3287]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:40:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-498b9ffb-5a88-4f0f-adf0-ed15743a9519 tempest-VolumesSnapshotListTestJSON-843736305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.dd82985e-f5e1-4a17-8244-705c061f064e {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:40:24 devstack sudo[94280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.dd82985e-f5e1-4a17-8244-705c061f064e Jul 08 18:40:24 devstack sudo[94280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:40:25 devstack sudo[94280]: pam_unix(sudo:session): session closed for user root Jul 08 18:40:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-498b9ffb-5a88-4f0f-adf0-ed15743a9519 tempest-VolumesSnapshotListTestJSON-843736305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.dd82985e-f5e1-4a17-8244-705c061f064e" returned: 0 in 0.997s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:40:25 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-498b9ffb-5a88-4f0f-adf0-ed15743a9519 tempest-VolumesSnapshotListTestJSON-843736305 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c8fa3369-35f4-4840-b649-101618c67921(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:40:25 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0957bdb-cb6b-4a73-8ab0-abd92c6ab55d]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:40:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-498b9ffb-5a88-4f0f-adf0-ed15743a9519 tempest-VolumesSnapshotListTestJSON-843736305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:40:25 devstack sudo[94294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921 Jul 08 18:40:25 devstack sudo[94294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:40:26 devstack sudo[94294]: pam_unix(sudo:session): session closed for user root Jul 08 18:40:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-498b9ffb-5a88-4f0f-adf0-ed15743a9519 tempest-VolumesSnapshotListTestJSON-843736305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921" returned: 0 in 1.022s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:40:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-498b9ffb-5a88-4f0f-adf0-ed15743a9519 tempest-VolumesSnapshotListTestJSON-843736305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.dd82985e-f5e1-4a17-8244-705c061f064e {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:40:26 devstack sudo[94302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.dd82985e-f5e1-4a17-8244-705c061f064e Jul 08 18:40:26 devstack sudo[94302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:40:27 devstack sudo[94302]: pam_unix(sudo:session): session closed for user root Jul 08 18:40:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-498b9ffb-5a88-4f0f-adf0-ed15743a9519 tempest-VolumesSnapshotListTestJSON-843736305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.dd82985e-f5e1-4a17-8244-705c061f064e" returned: 0 in 0.910s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:40:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-498b9ffb-5a88-4f0f-adf0-ed15743a9519 tempest-VolumesSnapshotListTestJSON-843736305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.dd82985e-f5e1-4a17-8244-705c061f064e {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:40:27 devstack sudo[94311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.dd82985e-f5e1-4a17-8244-705c061f064e Jul 08 18:40:27 devstack sudo[94311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:40:28 devstack sudo[94311]: pam_unix(sudo:session): session closed for user root Jul 08 18:40:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-498b9ffb-5a88-4f0f-adf0-ed15743a9519 tempest-VolumesSnapshotListTestJSON-843736305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921.dd82985e-f5e1-4a17-8244-705c061f064e" returned: 0 in 0.699s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:40:28 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-498b9ffb-5a88-4f0f-adf0-ed15743a9519 tempest-VolumesSnapshotListTestJSON-843736305 None] Lock "cinder-quobyte-dd82985e-f5e1-4a17-8244-705c061f064e" released by "_delete_snapshot" :: held 3.875s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:40:28 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-498b9ffb-5a88-4f0f-adf0-ed15743a9519 tempest-VolumesSnapshotListTestJSON-843736305 None] Lock "cinder-quobyte-c8fa3369-35f4-4840-b649-101618c67921" released by "delete_snapshot" :: held 3.923s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:40:28 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-498b9ffb-5a88-4f0f-adf0-ed15743a9519 tempest-VolumesSnapshotListTestJSON-843736305 None] Created reservations ['f1810014-2855-4835-87ec-41267e38e613', 'f9afc4b1-1659-4241-aea6-7741a1d63cba', '4eb2af1b-5ca5-4b64-802b-c5f05cdf8fa2', '14d96b84-d8bc-4333-a29c-f0cac3df79eb'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:40:28 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-498b9ffb-5a88-4f0f-adf0-ed15743a9519 tempest-VolumesSnapshotListTestJSON-843736305 None] Delete snapshot completed successfully. Jul 08 18:40:28 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-498b9ffb-5a88-4f0f-adf0-ed15743a9519 tempest-VolumesSnapshotListTestJSON-843736305 None] Lock "cinder-dd82985e-f5e1-4a17-8244-705c061f064e-delete_snapshot" released by "delete_snapshot" :: held 4.108s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:40:28 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-52561484-16d7-4dab-80ad-5c394e9e2ac7 tempest-VolumesSnapshotListTestJSON-843736305 None] Acquiring lock "cinder-c8fa3369-35f4-4840-b649-101618c67921-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:40:28 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-52561484-16d7-4dab-80ad-5c394e9e2ac7 tempest-VolumesSnapshotListTestJSON-843736305 None] Lock "cinder-c8fa3369-35f4-4840-b649-101618c67921-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:40:28 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-52561484-16d7-4dab-80ad-5c394e9e2ac7 tempest-VolumesSnapshotListTestJSON-843736305 None] Acquiring lock "cinder-quobyte-c8fa3369-35f4-4840-b649-101618c67921" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:40:28 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-52561484-16d7-4dab-80ad-5c394e9e2ac7 tempest-VolumesSnapshotListTestJSON-843736305 None] Lock "cinder-quobyte-c8fa3369-35f4-4840-b649-101618c67921" acquired by "delete_volume" :: waited 0.030s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:40:28 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b236c8-3e2d-4488-8eef-dc1408f4a566]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:40:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-52561484-16d7-4dab-80ad-5c394e9e2ac7 tempest-VolumesSnapshotListTestJSON-843736305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:40:28 devstack sudo[94314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921 Jul 08 18:40:28 devstack sudo[94314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:40:29 devstack sudo[94314]: pam_unix(sudo:session): session closed for user root Jul 08 18:40:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-52561484-16d7-4dab-80ad-5c394e9e2ac7 tempest-VolumesSnapshotListTestJSON-843736305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921" returned: 0 in 0.879s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:40:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-52561484-16d7-4dab-80ad-5c394e9e2ac7 tempest-VolumesSnapshotListTestJSON-843736305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:40:29 devstack sudo[94319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921 Jul 08 18:40:29 devstack sudo[94319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:40:30 devstack sudo[94319]: pam_unix(sudo:session): session closed for user root Jul 08 18:40:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-52561484-16d7-4dab-80ad-5c394e9e2ac7 tempest-VolumesSnapshotListTestJSON-843736305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c8fa3369-35f4-4840-b649-101618c67921" returned: 0 in 0.689s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:40:30 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-52561484-16d7-4dab-80ad-5c394e9e2ac7 tempest-VolumesSnapshotListTestJSON-843736305 None] Lock "cinder-quobyte-c8fa3369-35f4-4840-b649-101618c67921" released by "delete_volume" :: held 1.632s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:40:30 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-52561484-16d7-4dab-80ad-5c394e9e2ac7 tempest-VolumesSnapshotListTestJSON-843736305 None] Created reservations ['a77fbc66-3ac6-4e41-a659-be3345fff0d7', '3b99e80f-62a5-433e-b559-95fd33207769', 'e8bfb86c-de85-4518-86a0-4970a5a88cee', '1691f975-c613-4ed5-8927-29efbbbb77af'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:40:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-52561484-16d7-4dab-80ad-5c394e9e2ac7 tempest-VolumesSnapshotListTestJSON-843736305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:40:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-52561484-16d7-4dab-80ad-5c394e9e2ac7 tempest-VolumesSnapshotListTestJSON-843736305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:40:30 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-52561484-16d7-4dab-80ad-5c394e9e2ac7 tempest-VolumesSnapshotListTestJSON-843736305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:40:30 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-52561484-16d7-4dab-80ad-5c394e9e2ac7 tempest-VolumesSnapshotListTestJSON-843736305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:40:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-52561484-16d7-4dab-80ad-5c394e9e2ac7 tempest-VolumesSnapshotListTestJSON-843736305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:40:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-52561484-16d7-4dab-80ad-5c394e9e2ac7 tempest-VolumesSnapshotListTestJSON-843736305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:40:30 devstack sudo[94322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:40:30 devstack sudo[94322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:40:31 devstack sudo[94322]: pam_unix(sudo:session): session closed for user root Jul 08 18:40:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-52561484-16d7-4dab-80ad-5c394e9e2ac7 tempest-VolumesSnapshotListTestJSON-843736305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.732s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:40:31 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-52561484-16d7-4dab-80ad-5c394e9e2ac7 tempest-VolumesSnapshotListTestJSON-843736305 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:40:31 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-52561484-16d7-4dab-80ad-5c394e9e2ac7 tempest-VolumesSnapshotListTestJSON-843736305 None] Deleted volume successfully. Jul 08 18:40:31 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-52561484-16d7-4dab-80ad-5c394e9e2ac7 tempest-VolumesSnapshotListTestJSON-843736305 None] Lock "cinder-c8fa3369-35f4-4840-b649-101618c67921-delete_volume" released by "delete_volume" :: held 2.734s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:40:34 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c072510-1b33-4688-b244-1662d56033a7 tempest-AttachVolumeTestJSON-339721191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:40:34 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5c072510-1b33-4688-b244-1662d56033a7 tempest-AttachVolumeTestJSON-339721191 None] Flow 'volume_create_manager' (29460abd-1d23-4450-8e1a-cd8b6663ca39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:40:34 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5c072510-1b33-4688-b244-1662d56033a7 tempest-AttachVolumeTestJSON-339721191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c317d3fe-108f-4cd1-a5ff-8e095ec17af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:40:34 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5c072510-1b33-4688-b244-1662d56033a7 tempest-AttachVolumeTestJSON-339721191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c317d3fe-108f-4cd1-a5ff-8e095ec17af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:40:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1486436244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07fde341-5b1d-4c61-be93-8ddc382c67a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca0fb35f852f43cfa610f321cd0c3609',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:40:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:40:34Z,use_quota=True,user_id='a0502d45925349ba9e1ff3abaa2e395f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:40:34 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5c072510-1b33-4688-b244-1662d56033a7 tempest-AttachVolumeTestJSON-339721191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14cff5eb-ded8-47d0-9dcf-108906863fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:40:34 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5c072510-1b33-4688-b244-1662d56033a7 tempest-AttachVolumeTestJSON-339721191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14cff5eb-ded8-47d0-9dcf-108906863fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:40:34 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5c072510-1b33-4688-b244-1662d56033a7 tempest-AttachVolumeTestJSON-339721191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (488c3c48-7b20-437c-b14b-642b5d4d3bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:40:34 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5c072510-1b33-4688-b244-1662d56033a7 tempest-AttachVolumeTestJSON-339721191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (488c3c48-7b20-437c-b14b-642b5d4d3bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07fde341-5b1d-4c61-be93-8ddc382c67a9', 'volume_name': 'volume-07fde341-5b1d-4c61-be93-8ddc382c67a9', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:40:34 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5c072510-1b33-4688-b244-1662d56033a7 tempest-AttachVolumeTestJSON-339721191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bae2fb3e-245a-42eb-82ee-e691786a3ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:40:34 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5c072510-1b33-4688-b244-1662d56033a7 tempest-AttachVolumeTestJSON-339721191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bae2fb3e-245a-42eb-82ee-e691786a3ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:40:34 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5c072510-1b33-4688-b244-1662d56033a7 tempest-AttachVolumeTestJSON-339721191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f349226-6747-4da9-bac7-e8d464e70443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:40:34 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-5c072510-1b33-4688-b244-1662d56033a7 tempest-AttachVolumeTestJSON-339721191 None] Volume 07fde341-5b1d-4c61-be93-8ddc382c67a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07fde341-5b1d-4c61-be93-8ddc382c67a9', 'volume_size': 1} Jul 08 18:40:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5c072510-1b33-4688-b244-1662d56033a7 tempest-AttachVolumeTestJSON-339721191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:40:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5c072510-1b33-4688-b244-1662d56033a7 tempest-AttachVolumeTestJSON-339721191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:40:34 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-5c072510-1b33-4688-b244-1662d56033a7 tempest-AttachVolumeTestJSON-339721191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:40:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1486436244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07fde341-5b1d-4c61-be93-8ddc382c67a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca0fb35f852f43cfa610f321cd0c3609',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:40:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:40:34Z,use_quota=True,user_id='a0502d45925349ba9e1ff3abaa2e395f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:40:34 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-5c072510-1b33-4688-b244-1662d56033a7 tempest-AttachVolumeTestJSON-339721191 None] Creating volume 07fde341-5b1d-4c61-be93-8ddc382c67a9 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:40:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5c072510-1b33-4688-b244-1662d56033a7 tempest-AttachVolumeTestJSON-339721191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:40:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5c072510-1b33-4688-b244-1662d56033a7 tempest-AttachVolumeTestJSON-339721191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:40:34 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-5c072510-1b33-4688-b244-1662d56033a7 tempest-AttachVolumeTestJSON-339721191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:40:34 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-5c072510-1b33-4688-b244-1662d56033a7 tempest-AttachVolumeTestJSON-339721191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:40:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5c072510-1b33-4688-b244-1662d56033a7 tempest-AttachVolumeTestJSON-339721191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:40:34 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-5c072510-1b33-4688-b244-1662d56033a7 tempest-AttachVolumeTestJSON-339721191 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:40:34 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-5c072510-1b33-4688-b244-1662d56033a7 tempest-AttachVolumeTestJSON-339721191 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:40:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5c072510-1b33-4688-b244-1662d56033a7 tempest-AttachVolumeTestJSON-339721191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07fde341-5b1d-4c61-be93-8ddc382c67a9 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:40:34 devstack sudo[94356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07fde341-5b1d-4c61-be93-8ddc382c67a9 1073741824 Jul 08 18:40:34 devstack sudo[94356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:40:35 devstack sudo[94356]: pam_unix(sudo:session): session closed for user root Jul 08 18:40:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5c072510-1b33-4688-b244-1662d56033a7 tempest-AttachVolumeTestJSON-339721191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07fde341-5b1d-4c61-be93-8ddc382c67a9 1073741824" returned: 0 in 1.016s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:40:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5c072510-1b33-4688-b244-1662d56033a7 tempest-AttachVolumeTestJSON-339721191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07fde341-5b1d-4c61-be93-8ddc382c67a9 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:40:35 devstack sudo[94365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07fde341-5b1d-4c61-be93-8ddc382c67a9 Jul 08 18:40:35 devstack sudo[94365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:40:36 devstack sudo[94365]: pam_unix(sudo:session): session closed for user root Jul 08 18:40:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5c072510-1b33-4688-b244-1662d56033a7 tempest-AttachVolumeTestJSON-339721191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07fde341-5b1d-4c61-be93-8ddc382c67a9" returned: 0 in 0.846s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:40:36 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-5c072510-1b33-4688-b244-1662d56033a7 tempest-AttachVolumeTestJSON-339721191 None] <== create_volume: return (1956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:40:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5c072510-1b33-4688-b244-1662d56033a7 tempest-AttachVolumeTestJSON-339721191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.959s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:40:36 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5c072510-1b33-4688-b244-1662d56033a7 tempest-AttachVolumeTestJSON-339721191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f349226-6747-4da9-bac7-e8d464e70443) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07fde341-5b1d-4c61-be93-8ddc382c67a9', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:40:36 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5c072510-1b33-4688-b244-1662d56033a7 tempest-AttachVolumeTestJSON-339721191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (296ba8e6-09b3-4b4f-ab28-b94b7ceddf5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:40:36 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-5c072510-1b33-4688-b244-1662d56033a7 tempest-AttachVolumeTestJSON-339721191 None] Volume volume-07fde341-5b1d-4c61-be93-8ddc382c67a9 (07fde341-5b1d-4c61-be93-8ddc382c67a9): created successfully Jul 08 18:40:36 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5c072510-1b33-4688-b244-1662d56033a7 tempest-AttachVolumeTestJSON-339721191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (296ba8e6-09b3-4b4f-ab28-b94b7ceddf5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:40:36 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5c072510-1b33-4688-b244-1662d56033a7 tempest-AttachVolumeTestJSON-339721191 None] Flow 'volume_create_manager' (29460abd-1d23-4450-8e1a-cd8b6663ca39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:40:36 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-5c072510-1b33-4688-b244-1662d56033a7 tempest-AttachVolumeTestJSON-339721191 None] Created volume successfully. Jul 08 18:40:38 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:40:38 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Flow 'volume_create_manager' (b9bb98d6-7a7b-4330-965a-9e74f57ebced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:40:38 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e20d83e8-1490-40f2-b9e8-342591723acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:40:38 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e20d83e8-1490-40f2-b9e8-342591723acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:40:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63507671-1b13-40ae-b6e2-7a0d865731ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='261dc9d36f4f400985f20f6440d95079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:40:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:40:39Z,use_quota=True,user_id='09af16b40ab44032b77c93bec6d4e671',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10a2cf1b-7bf8-466b-ac9f-831cc6ed4859),volume_type_id=10a2cf1b-7bf8-466b-ac9f-831cc6ed4859)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:40:38 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (224a1ca1-e9cc-43e2-97b5-ec34db100cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:40:38 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (224a1ca1-e9cc-43e2-97b5-ec34db100cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:40:38 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6e1a42a-3cc4-48ba-a88c-736775a1f878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:40:38 devstack cinder-volume[86873]: DEBUG cinder.image.glance [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Creating Keystone auth plugin from conf {{(pid=86873) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 18:40:39 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6e1a42a-3cc4-48ba-a88c-736775a1f878) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '63507671-1b13-40ae-b6e2-7a0d865731ec', 'volume_name': 'volume-63507671-1b13-40ae-b6e2-7a0d865731ec', 'volume_size': 1, 'image_id': 'f23da43a-a847-4012-af24-164b6e29a72a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f23da43a-a847-4012-af24-164b6e29a72a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd810358597150a1cf9c7b58a123bdb36', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '261dc9d36f4f400985f20f6440d95079', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1577ea4780c1fd50515a47c0df50dcc3a2c36056007b2c97e1fead6e15ead55d599a7e92976d64fd4e3890724645ffe0d4bb364242a1dfd0e0449824ef258cb4', 'id': 'f23da43a-a847-4012-af24-164b6e29a72a', 'created_at': datetime.datetime(2026, 7, 8, 16, 40, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 40, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f23da43a-a847-4012-af24-164b6e29a72a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:40:39 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71342d51-fe51-4b21-b4e0-076ff76b5519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:40:39 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71342d51-fe51-4b21-b4e0-076ff76b5519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:40:39 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (250817b6-8979-4b12-a611-29b8e90fb8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:40:39 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Volume 63507671-1b13-40ae-b6e2-7a0d865731ec: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-63507671-1b13-40ae-b6e2-7a0d865731ec', 'volume_size': 1, 'image_id': 'f23da43a-a847-4012-af24-164b6e29a72a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f23da43a-a847-4012-af24-164b6e29a72a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd810358597150a1cf9c7b58a123bdb36', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '261dc9d36f4f400985f20f6440d95079', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1577ea4780c1fd50515a47c0df50dcc3a2c36056007b2c97e1fead6e15ead55d599a7e92976d64fd4e3890724645ffe0d4bb364242a1dfd0e0449824ef258cb4', 'id': 'f23da43a-a847-4012-af24-164b6e29a72a', 'created_at': datetime.datetime(2026, 7, 8, 16, 40, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 40, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f23da43a-a847-4012-af24-164b6e29a72a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 08 18:40:39 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Trying to clone 63507671-1b13-40ae-b6e2-7a0d865731ec from image f23da43a-a847-4012-af24-164b6e29a72a at location (None, [{'url': 'file:///opt/stack/data/glance/images/f23da43a-a847-4012-af24-164b6e29a72a', 'metadata': {}}]). {{(pid=86873) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 18:40:39 devstack cinder-volume[86873]: DEBUG cinder.image.image_utils [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f23da43a-a847-4012-af24-164b6e29a72a_p367rvmwdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86873) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 18:40:39 devstack cinder-volume[86873]: INFO cinder.image.image_utils [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Image download 0.00 MB at 0.00 MB/s Jul 08 18:40:39 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[028d40ca-5594-4b60-b1c7-f8d0335e2167]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:40:39 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f23da43a-a847-4012-af24-164b6e29a72a_p367rvmwdevstack@QuobyteHD {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:40:39 devstack sudo[94420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f23da43a-a847-4012-af24-164b6e29a72a_p367rvmwdevstack@QuobyteHD Jul 08 18:40:39 devstack sudo[94420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:40:40 devstack sudo[94420]: pam_unix(sudo:session): session closed for user root Jul 08 18:40:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f23da43a-a847-4012-af24-164b6e29a72a_p367rvmwdevstack@QuobyteHD" returned: 0 in 1.276s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:40:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f23da43a-a847-4012-af24-164b6e29a72a_p367rvmwdevstack@QuobyteHD {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:40:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-5efd496a-8c47-4f21-ab6a-79519c4e6f69 req-c0e738bf-5c79-4728-8e98-f319bb74b2c5 tempest-AttachVolumeTestJSON-339721191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:40:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-5efd496a-8c47-4f21-ab6a-79519c4e6f69 req-c0e738bf-5c79-4728-8e98-f319bb74b2c5 tempest-AttachVolumeTestJSON-339721191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:40:41 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2809453-49fe-493c-bb5c-40da9dc8e125]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:40:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-5efd496a-8c47-4f21-ab6a-79519c4e6f69 req-c0e738bf-5c79-4728-8e98-f319bb74b2c5 tempest-AttachVolumeTestJSON-339721191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07fde341-5b1d-4c61-be93-8ddc382c67a9 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:40:41 devstack sudo[94435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f23da43a-a847-4012-af24-164b6e29a72a_p367rvmwdevstack@QuobyteHD Jul 08 18:40:41 devstack sudo[94435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:40:41 devstack sudo[94436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07fde341-5b1d-4c61-be93-8ddc382c67a9 Jul 08 18:40:41 devstack sudo[94436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:40:42 devstack sudo[94435]: pam_unix(sudo:session): session closed for user root Jul 08 18:40:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f23da43a-a847-4012-af24-164b6e29a72a_p367rvmwdevstack@QuobyteHD" returned: 1 in 1.441s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:40:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f23da43a-a847-4012-af24-164b6e29a72a_p367rvmwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:40:42 devstack cinder-volume[86873]: DEBUG cinder.image.image_utils [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Temporary image f23da43a-a847-4012-af24-164b6e29a72a is fetched for user 09af16b40ab44032b77c93bec6d4e671. {{(pid=86873) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 18:40:42 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c669196-4a57-493e-a373-f53d769d2e5e]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:40:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f23da43a-a847-4012-af24-164b6e29a72a_p367rvmwdevstack@QuobyteHD {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:40:42 devstack sudo[94436]: pam_unix(sudo:session): session closed for user root Jul 08 18:40:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-5efd496a-8c47-4f21-ab6a-79519c4e6f69 req-c0e738bf-5c79-4728-8e98-f319bb74b2c5 tempest-AttachVolumeTestJSON-339721191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07fde341-5b1d-4c61-be93-8ddc382c67a9" returned: 0 in 1.356s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:40:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-5efd496a-8c47-4f21-ab6a-79519c4e6f69 req-c0e738bf-5c79-4728-8e98-f319bb74b2c5 tempest-AttachVolumeTestJSON-339721191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.395s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:40:42 devstack sudo[94453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f23da43a-a847-4012-af24-164b6e29a72a_p367rvmwdevstack@QuobyteHD Jul 08 18:40:42 devstack sudo[94453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:40:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-5efd496a-8c47-4f21-ab6a-79519c4e6f69 req-c0e738bf-5c79-4728-8e98-f319bb74b2c5 tempest-AttachVolumeTestJSON-339721191 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2', 'name': 'volume-07fde341-5b1d-4c61-be93-8ddc382c67a9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f160e8da-f35d-48ef-b917-710e0543803d', 'enforce_multipath': True} {{(pid=86873) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 18:40:42 devstack cinder-volume[86873]: INFO cinder.volume.manager [req-5efd496a-8c47-4f21-ab6a-79519c4e6f69 req-c0e738bf-5c79-4728-8e98-f319bb74b2c5 tempest-AttachVolumeTestJSON-339721191 None] attachment_update completed successfully. Jul 08 18:40:43 devstack sudo[94453]: pam_unix(sudo:session): session closed for user root Jul 08 18:40:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f23da43a-a847-4012-af24-164b6e29a72a_p367rvmwdevstack@QuobyteHD" returned: 0 in 1.109s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:40:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f23da43a-a847-4012-af24-164b6e29a72a_p367rvmwdevstack@QuobyteHD {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:40:43 devstack sudo[94466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f23da43a-a847-4012-af24-164b6e29a72a_p367rvmwdevstack@QuobyteHD Jul 08 18:40:43 devstack sudo[94466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:40:44 devstack sudo[94466]: pam_unix(sudo:session): session closed for user root Jul 08 18:40:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f23da43a-a847-4012-af24-164b6e29a72a_p367rvmwdevstack@QuobyteHD" returned: 1 in 0.815s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:40:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f23da43a-a847-4012-af24-164b6e29a72a_p367rvmwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:40:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:40:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:40:44 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:40:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63507671-1b13-40ae-b6e2-7a0d865731ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='261dc9d36f4f400985f20f6440d95079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:40:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:40:39Z,use_quota=True,user_id='09af16b40ab44032b77c93bec6d4e671',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10a2cf1b-7bf8-466b-ac9f-831cc6ed4859),volume_type_id=10a2cf1b-7bf8-466b-ac9f-831cc6ed4859)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:40:44 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Creating volume 63507671-1b13-40ae-b6e2-7a0d865731ec {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:40:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:40:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:40:44 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:40:44 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:40:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:40:44 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:40:44 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:40:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-63507671-1b13-40ae-b6e2-7a0d865731ec 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:40:44 devstack sudo[94473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-63507671-1b13-40ae-b6e2-7a0d865731ec 1073741824 Jul 08 18:40:44 devstack sudo[94473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:40:45 devstack sudo[94473]: pam_unix(sudo:session): session closed for user root Jul 08 18:40:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-63507671-1b13-40ae-b6e2-7a0d865731ec 1073741824" returned: 0 in 0.878s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:40:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-63507671-1b13-40ae-b6e2-7a0d865731ec {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:40:45 devstack sudo[94478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-63507671-1b13-40ae-b6e2-7a0d865731ec Jul 08 18:40:45 devstack sudo[94478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:40:45 devstack sudo[94478]: pam_unix(sudo:session): session closed for user root Jul 08 18:40:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-63507671-1b13-40ae-b6e2-7a0d865731ec" returned: 0 in 0.747s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:40:45 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] <== create_volume: return (1688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:40:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.691s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:40:45 devstack cinder-volume[86873]: DEBUG cinder.volume.volume_utils [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Attempting download of f23da43a-a847-4012-af24-164b6e29a72a ((None, [{'url': 'file:///opt/stack/data/glance/images/f23da43a-a847-4012-af24-164b6e29a72a', 'metadata': {}}])) to volume 63507671-1b13-40ae-b6e2-7a0d865731ec. {{(pid=86873) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 18:40:45 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a902345-ab84-4ccc-bfe6-79a5977e43d0]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:40:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f23da43a-a847-4012-af24-164b6e29a72a_2_bgn6ep {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:40:46 devstack sudo[94481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f23da43a-a847-4012-af24-164b6e29a72a_2_bgn6ep Jul 08 18:40:46 devstack sudo[94481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:40:46 devstack sudo[94481]: pam_unix(sudo:session): session closed for user root Jul 08 18:40:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f23da43a-a847-4012-af24-164b6e29a72a_2_bgn6ep" returned: 0 in 1.050s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:40:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f23da43a-a847-4012-af24-164b6e29a72a_2_bgn6ep {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:40:47 devstack sudo[94502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f23da43a-a847-4012-af24-164b6e29a72a_2_bgn6ep Jul 08 18:40:47 devstack sudo[94502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:40:48 devstack cinder-volume[86873]: DEBUG oslo_service.periodic_task [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86873) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:40:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:40:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:40:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:40:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:40:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:40:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:40:48 devstack sudo[94536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:40:48 devstack sudo[94536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:40:48 devstack sudo[94502]: pam_unix(sudo:session): session closed for user root Jul 08 18:40:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f23da43a-a847-4012-af24-164b6e29a72a_2_bgn6ep" returned: 1 in 1.348s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:40:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f23da43a-a847-4012-af24-164b6e29a72a_2_bgn6ep' failed. Not Retrying. {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:40:48 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1d9591-92e3-426d-a38c-834c99399aae]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:40:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f23da43a-a847-4012-af24-164b6e29a72a_p367rvmwdevstack@QuobyteHD {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:40:48 devstack sudo[94542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f23da43a-a847-4012-af24-164b6e29a72a_p367rvmwdevstack@QuobyteHD Jul 08 18:40:48 devstack sudo[94542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:40:49 devstack sudo[94536]: pam_unix(sudo:session): session closed for user root Jul 08 18:40:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.922s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:40:49 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:40:49 devstack cinder-volume[86873]: DEBUG oslo_service.periodic_task [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running periodic task VolumeManager._thread_info {{(pid=86873) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:40:49 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] thread count: 29 {{(pid=86873) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:40:49 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] thread info: [<_MainThread(MainThread, started 138577734545536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86873) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:40:49 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:SELECT=59,cinder:UPDATE=43,cinder:DELETE=6,cinder:INSERT=14 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:40:49 devstack sudo[94542]: pam_unix(sudo:session): session closed for user root Jul 08 18:40:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f23da43a-a847-4012-af24-164b6e29a72a_p367rvmwdevstack@QuobyteHD" returned: 0 in 1.113s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:40:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f23da43a-a847-4012-af24-164b6e29a72a_p367rvmwdevstack@QuobyteHD {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:40:49 devstack sudo[94570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f23da43a-a847-4012-af24-164b6e29a72a_p367rvmwdevstack@QuobyteHD Jul 08 18:40:49 devstack sudo[94570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:40:50 devstack sudo[94570]: pam_unix(sudo:session): session closed for user root Jul 08 18:40:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f23da43a-a847-4012-af24-164b6e29a72a_p367rvmwdevstack@QuobyteHD" returned: 1 in 1.106s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:40:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f23da43a-a847-4012-af24-164b6e29a72a_p367rvmwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:40:50 devstack cinder-volume[86873]: DEBUG cinder.image.image_utils [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] f23da43a-a847-4012-af24-164b6e29a72a was raw, converting to raw {{(pid=86873) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 18:40:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f23da43a-a847-4012-af24-164b6e29a72a_p367rvmwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-63507671-1b13-40ae-b6e2-7a0d865731ec {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:40:50 devstack sudo[94577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f23da43a-a847-4012-af24-164b6e29a72a_p367rvmwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-63507671-1b13-40ae-b6e2-7a0d865731ec Jul 08 18:40:50 devstack sudo[94577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:40:51 devstack sudo[94577]: pam_unix(sudo:session): session closed for user root Jul 08 18:40:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f23da43a-a847-4012-af24-164b6e29a72a_p367rvmwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-63507671-1b13-40ae-b6e2-7a0d865731ec" returned: 0 in 1.194s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:40:51 devstack cinder-volume[86873]: DEBUG cinder.image.image_utils [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f23da43a-a847-4012-af24-164b6e29a72a_p367rvmwdevstack@QuobyteHD, size 0.00 MB, duration 1.20 sec, destination /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-63507671-1b13-40ae-b6e2-7a0d865731ec {{(pid=86873) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:40:51 devstack cinder-volume[86873]: INFO cinder.image.image_utils [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 18:40:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-63507671-1b13-40ae-b6e2-7a0d865731ec 1G {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:40:51 devstack sudo[94583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-63507671-1b13-40ae-b6e2-7a0d865731ec 1G Jul 08 18:40:51 devstack sudo[94583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:40:52 devstack sudo[94583]: pam_unix(sudo:session): session closed for user root Jul 08 18:40:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-63507671-1b13-40ae-b6e2-7a0d865731ec 1G" returned: 0 in 0.968s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:40:52 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb56691-9ff8-4e55-8567-9dfb2477143c]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:40:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-63507671-1b13-40ae-b6e2-7a0d865731ec {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:40:53 devstack sudo[94589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-63507671-1b13-40ae-b6e2-7a0d865731ec Jul 08 18:40:53 devstack sudo[94589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:40:54 devstack sudo[94589]: pam_unix(sudo:session): session closed for user root Jul 08 18:40:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-63507671-1b13-40ae-b6e2-7a0d865731ec" returned: 0 in 1.399s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:40:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-63507671-1b13-40ae-b6e2-7a0d865731ec {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:40:54 devstack sudo[94611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-63507671-1b13-40ae-b6e2-7a0d865731ec Jul 08 18:40:54 devstack sudo[94611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:40:55 devstack sudo[94611]: pam_unix(sudo:session): session closed for user root Jul 08 18:40:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-63507671-1b13-40ae-b6e2-7a0d865731ec" returned: 1 in 1.128s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:40:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-63507671-1b13-40ae-b6e2-7a0d865731ec' failed. Not Retrying. {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:40:55 devstack cinder-volume[86873]: DEBUG cinder.volume.volume_utils [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Downloaded image f23da43a-a847-4012-af24-164b6e29a72a ((None, [{'url': 'file:///opt/stack/data/glance/images/f23da43a-a847-4012-af24-164b6e29a72a', 'metadata': {}}])) to volume 63507671-1b13-40ae-b6e2-7a0d865731ec successfully. {{(pid=86873) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 18:40:55 devstack cinder-volume[86873]: DEBUG cinder.image.image_utils [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Temporary image f23da43a-a847-4012-af24-164b6e29a72a for user 09af16b40ab44032b77c93bec6d4e671 is deleted. {{(pid=86873) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 18:40:55 devstack cinder-volume[86873]: DEBUG cinder.volume.volume_utils [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Marking volume 63507671-1b13-40ae-b6e2-7a0d865731ec as bootable. {{(pid=86873) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 18:40:55 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Copying metadata from image f23da43a-a847-4012-af24-164b6e29a72a to 63507671-1b13-40ae-b6e2-7a0d865731ec. {{(pid=86873) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 18:40:55 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Creating volume glance metadata for volume 63507671-1b13-40ae-b6e2-7a0d865731ec backed by image f23da43a-a847-4012-af24-164b6e29a72a with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'f23da43a-a847-4012-af24-164b6e29a72a', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'd810358597150a1cf9c7b58a123bdb36', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86873) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 18:40:55 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (250817b6-8979-4b12-a611-29b8e90fb8a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63507671-1b13-40ae-b6e2-7a0d865731ec', 'volume_size': 1, 'image_id': 'f23da43a-a847-4012-af24-164b6e29a72a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f23da43a-a847-4012-af24-164b6e29a72a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd810358597150a1cf9c7b58a123bdb36', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '261dc9d36f4f400985f20f6440d95079', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1577ea4780c1fd50515a47c0df50dcc3a2c36056007b2c97e1fead6e15ead55d599a7e92976d64fd4e3890724645ffe0d4bb364242a1dfd0e0449824ef258cb4', 'id': 'f23da43a-a847-4012-af24-164b6e29a72a', 'created_at': datetime.datetime(2026, 7, 8, 16, 40, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 40, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f23da43a-a847-4012-af24-164b6e29a72a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:40:55 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b16a020-d1a6-48ec-948d-0225bd35a10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:40:55 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Volume volume-63507671-1b13-40ae-b6e2-7a0d865731ec (63507671-1b13-40ae-b6e2-7a0d865731ec): created successfully Jul 08 18:40:55 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b16a020-d1a6-48ec-948d-0225bd35a10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:40:55 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Flow 'volume_create_manager' (b9bb98d6-7a7b-4330-965a-9e74f57ebced) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:40:55 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-49fcf464-7627-447c-a697-cac1e856f8ce tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Created volume successfully. Jul 08 18:40:56 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-efb78995-df28-4a55-bbc8-a4a5916a1d82 tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Acquiring lock "cinder-63507671-1b13-40ae-b6e2-7a0d865731ec-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:40:56 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-efb78995-df28-4a55-bbc8-a4a5916a1d82 tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Lock "cinder-63507671-1b13-40ae-b6e2-7a0d865731ec-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:40:56 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-efb78995-df28-4a55-bbc8-a4a5916a1d82 tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Acquiring lock "cinder-quobyte-63507671-1b13-40ae-b6e2-7a0d865731ec" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:40:56 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-efb78995-df28-4a55-bbc8-a4a5916a1d82 tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Lock "cinder-quobyte-63507671-1b13-40ae-b6e2-7a0d865731ec" acquired by "delete_volume" :: waited 0.026s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:40:56 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[05daa1f5-3fb0-4718-9520-3e4cf1f11c48]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:40:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-efb78995-df28-4a55-bbc8-a4a5916a1d82 tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-63507671-1b13-40ae-b6e2-7a0d865731ec {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:40:56 devstack sudo[94637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-63507671-1b13-40ae-b6e2-7a0d865731ec Jul 08 18:40:56 devstack sudo[94637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:40:57 devstack sudo[94637]: pam_unix(sudo:session): session closed for user root Jul 08 18:40:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-efb78995-df28-4a55-bbc8-a4a5916a1d82 tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-63507671-1b13-40ae-b6e2-7a0d865731ec" returned: 0 in 1.006s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:40:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-efb78995-df28-4a55-bbc8-a4a5916a1d82 tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-63507671-1b13-40ae-b6e2-7a0d865731ec {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:40:57 devstack sudo[94659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-63507671-1b13-40ae-b6e2-7a0d865731ec Jul 08 18:40:57 devstack sudo[94659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:40:58 devstack sudo[94659]: pam_unix(sudo:session): session closed for user root Jul 08 18:40:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-efb78995-df28-4a55-bbc8-a4a5916a1d82 tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-63507671-1b13-40ae-b6e2-7a0d865731ec" returned: 1 in 0.949s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:40:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-efb78995-df28-4a55-bbc8-a4a5916a1d82 tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-63507671-1b13-40ae-b6e2-7a0d865731ec' failed. Not Retrying. {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:40:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-efb78995-df28-4a55-bbc8-a4a5916a1d82 tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-63507671-1b13-40ae-b6e2-7a0d865731ec {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:40:58 devstack sudo[94700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-63507671-1b13-40ae-b6e2-7a0d865731ec Jul 08 18:40:58 devstack sudo[94700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:40:59 devstack sudo[94700]: pam_unix(sudo:session): session closed for user root Jul 08 18:40:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-efb78995-df28-4a55-bbc8-a4a5916a1d82 tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-63507671-1b13-40ae-b6e2-7a0d865731ec" returned: 0 in 0.720s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:40:59 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-efb78995-df28-4a55-bbc8-a4a5916a1d82 tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Lock "cinder-quobyte-63507671-1b13-40ae-b6e2-7a0d865731ec" released by "delete_volume" :: held 2.752s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:40:59 devstack cinder-volume[86873]: WARNING cinder.quota [None req-efb78995-df28-4a55-bbc8-a4a5916a1d82 tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:40:59 devstack cinder-volume[86873]: WARNING cinder.quota [None req-efb78995-df28-4a55-bbc8-a4a5916a1d82 tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:40:59 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-efb78995-df28-4a55-bbc8-a4a5916a1d82 tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Created reservations ['8dc83630-30be-4921-8da3-cfa74e79694e', 'cedc457f-ebd1-4f34-916a-68d05b95de71', '88376764-094f-4d6c-9432-82621071a00d', 'a1cf79e7-7dd8-4da2-8503-3444bfe28d39'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:40:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-efb78995-df28-4a55-bbc8-a4a5916a1d82 tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:40:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-efb78995-df28-4a55-bbc8-a4a5916a1d82 tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:40:59 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-efb78995-df28-4a55-bbc8-a4a5916a1d82 tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:40:59 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-efb78995-df28-4a55-bbc8-a4a5916a1d82 tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:40:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-efb78995-df28-4a55-bbc8-a4a5916a1d82 tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:40:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-efb78995-df28-4a55-bbc8-a4a5916a1d82 tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:40:59 devstack sudo[94709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:40:59 devstack sudo[94709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:41:00 devstack sudo[94709]: pam_unix(sudo:session): session closed for user root Jul 08 18:41:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-efb78995-df28-4a55-bbc8-a4a5916a1d82 tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.746s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:41:00 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-efb78995-df28-4a55-bbc8-a4a5916a1d82 tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:41:00 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-efb78995-df28-4a55-bbc8-a4a5916a1d82 tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Deleted volume successfully. Jul 08 18:41:00 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-efb78995-df28-4a55-bbc8-a4a5916a1d82 tempest-VolumeAndVolumeTypeFromImageTest-1106404520 None] Lock "cinder-63507671-1b13-40ae-b6e2-7a0d865731ec-delete_volume" released by "delete_volume" :: held 3.768s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:41:06 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1faca03-b5cc-4831-b99a-9652050b0646 tempest-CreateVolumesFromImageTest-1957600402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:41:06 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d1faca03-b5cc-4831-b99a-9652050b0646 tempest-CreateVolumesFromImageTest-1957600402 None] Flow 'volume_create_manager' (e33d3d50-7938-4ee4-b5ae-8670219c637a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:41:06 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d1faca03-b5cc-4831-b99a-9652050b0646 tempest-CreateVolumesFromImageTest-1957600402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39a43275-7baf-4b42-95b2-fa55d4215dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:06 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d1faca03-b5cc-4831-b99a-9652050b0646 tempest-CreateVolumesFromImageTest-1957600402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39a43275-7baf-4b42-95b2-fa55d4215dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-199784016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fbff77a-223d-4970-b924-76b2670cc80e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd9611a1477c454e88d27f87b029d121',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:41:06Z,use_quota=True,user_id='5f3c6f3503764d01ba8ae2681b04e659',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:41:06 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d1faca03-b5cc-4831-b99a-9652050b0646 tempest-CreateVolumesFromImageTest-1957600402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08876153-213d-4568-8f50-deb9a154a97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:06 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d1faca03-b5cc-4831-b99a-9652050b0646 tempest-CreateVolumesFromImageTest-1957600402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08876153-213d-4568-8f50-deb9a154a97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:41:06 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d1faca03-b5cc-4831-b99a-9652050b0646 tempest-CreateVolumesFromImageTest-1957600402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ebbc1ac-0716-4f68-a7c2-1688940c5797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:06 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d1faca03-b5cc-4831-b99a-9652050b0646 tempest-CreateVolumesFromImageTest-1957600402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ebbc1ac-0716-4f68-a7c2-1688940c5797) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fbff77a-223d-4970-b924-76b2670cc80e', 'volume_name': 'volume-8fbff77a-223d-4970-b924-76b2670cc80e', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:41:06 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d1faca03-b5cc-4831-b99a-9652050b0646 tempest-CreateVolumesFromImageTest-1957600402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5059c9a2-39b7-4ade-b8e5-0e3698b38f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:06 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d1faca03-b5cc-4831-b99a-9652050b0646 tempest-CreateVolumesFromImageTest-1957600402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5059c9a2-39b7-4ade-b8e5-0e3698b38f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:41:06 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d1faca03-b5cc-4831-b99a-9652050b0646 tempest-CreateVolumesFromImageTest-1957600402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fe54934-5677-416a-b96c-bd6ed5ee0a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:06 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-d1faca03-b5cc-4831-b99a-9652050b0646 tempest-CreateVolumesFromImageTest-1957600402 None] Volume 8fbff77a-223d-4970-b924-76b2670cc80e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fbff77a-223d-4970-b924-76b2670cc80e', 'volume_size': 1} Jul 08 18:41:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-d1faca03-b5cc-4831-b99a-9652050b0646 tempest-CreateVolumesFromImageTest-1957600402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:41:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-d1faca03-b5cc-4831-b99a-9652050b0646 tempest-CreateVolumesFromImageTest-1957600402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:41:06 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-d1faca03-b5cc-4831-b99a-9652050b0646 tempest-CreateVolumesFromImageTest-1957600402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-199784016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fbff77a-223d-4970-b924-76b2670cc80e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd9611a1477c454e88d27f87b029d121',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:41:06Z,use_quota=True,user_id='5f3c6f3503764d01ba8ae2681b04e659',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:41:06 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-d1faca03-b5cc-4831-b99a-9652050b0646 tempest-CreateVolumesFromImageTest-1957600402 None] Creating volume 8fbff77a-223d-4970-b924-76b2670cc80e {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:41:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-d1faca03-b5cc-4831-b99a-9652050b0646 tempest-CreateVolumesFromImageTest-1957600402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:41:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-d1faca03-b5cc-4831-b99a-9652050b0646 tempest-CreateVolumesFromImageTest-1957600402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:41:06 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-d1faca03-b5cc-4831-b99a-9652050b0646 tempest-CreateVolumesFromImageTest-1957600402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:41:06 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-d1faca03-b5cc-4831-b99a-9652050b0646 tempest-CreateVolumesFromImageTest-1957600402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:41:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-d1faca03-b5cc-4831-b99a-9652050b0646 tempest-CreateVolumesFromImageTest-1957600402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:41:06 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-d1faca03-b5cc-4831-b99a-9652050b0646 tempest-CreateVolumesFromImageTest-1957600402 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:41:06 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-d1faca03-b5cc-4831-b99a-9652050b0646 tempest-CreateVolumesFromImageTest-1957600402 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:41:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d1faca03-b5cc-4831-b99a-9652050b0646 tempest-CreateVolumesFromImageTest-1957600402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8fbff77a-223d-4970-b924-76b2670cc80e 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:41:06 devstack sudo[94818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8fbff77a-223d-4970-b924-76b2670cc80e 1073741824 Jul 08 18:41:06 devstack sudo[94818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:41:06 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-c95c04b6-d2f9-473e-8eec-346405f9770a tempest-CreateVolumesFromImageTest-1957600402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:41:06 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c95c04b6-d2f9-473e-8eec-346405f9770a tempest-CreateVolumesFromImageTest-1957600402 None] Flow 'volume_create_manager' (484d2822-0caf-4669-a3ee-d158b0d1a405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:41:06 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c95c04b6-d2f9-473e-8eec-346405f9770a tempest-CreateVolumesFromImageTest-1957600402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64abd4a4-e07c-49cd-9e4d-30d9d208050a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:06 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c95c04b6-d2f9-473e-8eec-346405f9770a tempest-CreateVolumesFromImageTest-1957600402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64abd4a4-e07c-49cd-9e4d-30d9d208050a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1861928367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=001b2f91-bcfd-417f-b661-968b2ea8cdb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd9611a1477c454e88d27f87b029d121',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:41:07Z,use_quota=True,user_id='5f3c6f3503764d01ba8ae2681b04e659',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:41:06 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c95c04b6-d2f9-473e-8eec-346405f9770a tempest-CreateVolumesFromImageTest-1957600402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d783cbcc-49b9-479e-b228-fa756ba61e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:06 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c95c04b6-d2f9-473e-8eec-346405f9770a tempest-CreateVolumesFromImageTest-1957600402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d783cbcc-49b9-479e-b228-fa756ba61e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:41:06 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c95c04b6-d2f9-473e-8eec-346405f9770a tempest-CreateVolumesFromImageTest-1957600402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51ddecb7-b193-48d1-88f2-a384aa646139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:06 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c95c04b6-d2f9-473e-8eec-346405f9770a tempest-CreateVolumesFromImageTest-1957600402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51ddecb7-b193-48d1-88f2-a384aa646139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '001b2f91-bcfd-417f-b661-968b2ea8cdb1', 'volume_name': 'volume-001b2f91-bcfd-417f-b661-968b2ea8cdb1', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:41:06 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c95c04b6-d2f9-473e-8eec-346405f9770a tempest-CreateVolumesFromImageTest-1957600402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31378b0f-38db-4b87-a0d4-23b85901e800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:06 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c95c04b6-d2f9-473e-8eec-346405f9770a tempest-CreateVolumesFromImageTest-1957600402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31378b0f-38db-4b87-a0d4-23b85901e800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:41:06 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c95c04b6-d2f9-473e-8eec-346405f9770a tempest-CreateVolumesFromImageTest-1957600402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee4682bc-1b76-441d-a9cd-619c15d38bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:06 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-c95c04b6-d2f9-473e-8eec-346405f9770a tempest-CreateVolumesFromImageTest-1957600402 None] Volume 001b2f91-bcfd-417f-b661-968b2ea8cdb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-001b2f91-bcfd-417f-b661-968b2ea8cdb1', 'volume_size': 1} Jul 08 18:41:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c95c04b6-d2f9-473e-8eec-346405f9770a tempest-CreateVolumesFromImageTest-1957600402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:41:07 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-b74eece5-ead3-4186-8cf8-bb531e5f1366 tempest-CreateVolumesFromImageTest-1957600402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:41:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b74eece5-ead3-4186-8cf8-bb531e5f1366 tempest-CreateVolumesFromImageTest-1957600402 None] Flow 'volume_create_manager' (1f0cfc2e-364e-41d6-b2b9-e28008c22499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:41:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b74eece5-ead3-4186-8cf8-bb531e5f1366 tempest-CreateVolumesFromImageTest-1957600402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (457344ae-56d8-4714-8c10-05749e253b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b74eece5-ead3-4186-8cf8-bb531e5f1366 tempest-CreateVolumesFromImageTest-1957600402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (457344ae-56d8-4714-8c10-05749e253b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2082324305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e835c855-3536-4793-ad0b-325748d22f85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd9611a1477c454e88d27f87b029d121',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:41:07Z,use_quota=True,user_id='5f3c6f3503764d01ba8ae2681b04e659',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:41:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b74eece5-ead3-4186-8cf8-bb531e5f1366 tempest-CreateVolumesFromImageTest-1957600402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a3feeeb-d8ec-4621-ba42-1f1e582ca717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b74eece5-ead3-4186-8cf8-bb531e5f1366 tempest-CreateVolumesFromImageTest-1957600402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a3feeeb-d8ec-4621-ba42-1f1e582ca717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:41:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b74eece5-ead3-4186-8cf8-bb531e5f1366 tempest-CreateVolumesFromImageTest-1957600402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3628e4ab-63e0-4221-8266-f663f8fb49b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b74eece5-ead3-4186-8cf8-bb531e5f1366 tempest-CreateVolumesFromImageTest-1957600402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3628e4ab-63e0-4221-8266-f663f8fb49b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e835c855-3536-4793-ad0b-325748d22f85', 'volume_name': 'volume-e835c855-3536-4793-ad0b-325748d22f85', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:41:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b74eece5-ead3-4186-8cf8-bb531e5f1366 tempest-CreateVolumesFromImageTest-1957600402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (397840f7-dfea-48d5-8b35-47061bca1b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b74eece5-ead3-4186-8cf8-bb531e5f1366 tempest-CreateVolumesFromImageTest-1957600402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (397840f7-dfea-48d5-8b35-47061bca1b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:41:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b74eece5-ead3-4186-8cf8-bb531e5f1366 tempest-CreateVolumesFromImageTest-1957600402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (999c9f42-c09b-4d7e-92af-b6e423356166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:07 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-b74eece5-ead3-4186-8cf8-bb531e5f1366 tempest-CreateVolumesFromImageTest-1957600402 None] Volume e835c855-3536-4793-ad0b-325748d22f85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e835c855-3536-4793-ad0b-325748d22f85', 'volume_size': 1} Jul 08 18:41:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b74eece5-ead3-4186-8cf8-bb531e5f1366 tempest-CreateVolumesFromImageTest-1957600402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:41:07 devstack sudo[94818]: pam_unix(sudo:session): session closed for user root Jul 08 18:41:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d1faca03-b5cc-4831-b99a-9652050b0646 tempest-CreateVolumesFromImageTest-1957600402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8fbff77a-223d-4970-b924-76b2670cc80e 1073741824" returned: 0 in 0.982s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:41:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d1faca03-b5cc-4831-b99a-9652050b0646 tempest-CreateVolumesFromImageTest-1957600402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8fbff77a-223d-4970-b924-76b2670cc80e {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:41:07 devstack sudo[94825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8fbff77a-223d-4970-b924-76b2670cc80e Jul 08 18:41:07 devstack sudo[94825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:41:07 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-15917863-cbf8-41e3-a534-f676a31e0030 tempest-CreateVolumesFromImageTest-1957600402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:41:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-15917863-cbf8-41e3-a534-f676a31e0030 tempest-CreateVolumesFromImageTest-1957600402 None] Flow 'volume_create_manager' (9186c17d-d045-4c02-a497-b5ec1115afc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:41:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-15917863-cbf8-41e3-a534-f676a31e0030 tempest-CreateVolumesFromImageTest-1957600402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (387350d6-a8d5-4c26-b713-a307cd37a0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-15917863-cbf8-41e3-a534-f676a31e0030 tempest-CreateVolumesFromImageTest-1957600402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (387350d6-a8d5-4c26-b713-a307cd37a0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-479170194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1eee94b-cd07-4d35-8ee9-9b571daeb853,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd9611a1477c454e88d27f87b029d121',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:41:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:41:08Z,use_quota=True,user_id='5f3c6f3503764d01ba8ae2681b04e659',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:41:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-15917863-cbf8-41e3-a534-f676a31e0030 tempest-CreateVolumesFromImageTest-1957600402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51dce48f-8d2e-47a7-b04e-a1667ab15542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-15917863-cbf8-41e3-a534-f676a31e0030 tempest-CreateVolumesFromImageTest-1957600402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51dce48f-8d2e-47a7-b04e-a1667ab15542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:41:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-15917863-cbf8-41e3-a534-f676a31e0030 tempest-CreateVolumesFromImageTest-1957600402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a79ad371-d215-46e4-bbf4-3069a53979d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-15917863-cbf8-41e3-a534-f676a31e0030 tempest-CreateVolumesFromImageTest-1957600402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a79ad371-d215-46e4-bbf4-3069a53979d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1eee94b-cd07-4d35-8ee9-9b571daeb853', 'volume_name': 'volume-b1eee94b-cd07-4d35-8ee9-9b571daeb853', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:41:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-15917863-cbf8-41e3-a534-f676a31e0030 tempest-CreateVolumesFromImageTest-1957600402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed63bbbb-7f83-40fd-9e97-8a0ed7a60f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-15917863-cbf8-41e3-a534-f676a31e0030 tempest-CreateVolumesFromImageTest-1957600402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed63bbbb-7f83-40fd-9e97-8a0ed7a60f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:41:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-15917863-cbf8-41e3-a534-f676a31e0030 tempest-CreateVolumesFromImageTest-1957600402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8627310d-7b34-4e10-923c-f6850e627df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:07 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-15917863-cbf8-41e3-a534-f676a31e0030 tempest-CreateVolumesFromImageTest-1957600402 None] Volume b1eee94b-cd07-4d35-8ee9-9b571daeb853: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1eee94b-cd07-4d35-8ee9-9b571daeb853', 'volume_size': 1} Jul 08 18:41:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-15917863-cbf8-41e3-a534-f676a31e0030 tempest-CreateVolumesFromImageTest-1957600402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:41:08 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7bfe8ef-780d-4940-8755-dd841e5ffbee tempest-CreateVolumesFromImageTest-1957600402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:41:08 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e7bfe8ef-780d-4940-8755-dd841e5ffbee tempest-CreateVolumesFromImageTest-1957600402 None] Flow 'volume_create_manager' (16efbd0d-0918-4e39-9c97-3b1461e47319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:41:08 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e7bfe8ef-780d-4940-8755-dd841e5ffbee tempest-CreateVolumesFromImageTest-1957600402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e83569b-7008-4deb-8353-e26fc54f6101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:08 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e7bfe8ef-780d-4940-8755-dd841e5ffbee tempest-CreateVolumesFromImageTest-1957600402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e83569b-7008-4deb-8353-e26fc54f6101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-360152274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=804a613d-8152-4b9f-a2bf-697d1f4eacf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd9611a1477c454e88d27f87b029d121',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:41:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:41:08Z,use_quota=True,user_id='5f3c6f3503764d01ba8ae2681b04e659',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:41:08 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e7bfe8ef-780d-4940-8755-dd841e5ffbee tempest-CreateVolumesFromImageTest-1957600402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93f727e3-1710-41a4-81ab-7cc8fcd0493b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:08 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e7bfe8ef-780d-4940-8755-dd841e5ffbee tempest-CreateVolumesFromImageTest-1957600402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93f727e3-1710-41a4-81ab-7cc8fcd0493b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:41:08 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e7bfe8ef-780d-4940-8755-dd841e5ffbee tempest-CreateVolumesFromImageTest-1957600402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (511c5a75-177b-4ed2-b47f-4278729fa158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:08 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e7bfe8ef-780d-4940-8755-dd841e5ffbee tempest-CreateVolumesFromImageTest-1957600402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (511c5a75-177b-4ed2-b47f-4278729fa158) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '804a613d-8152-4b9f-a2bf-697d1f4eacf5', 'volume_name': 'volume-804a613d-8152-4b9f-a2bf-697d1f4eacf5', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:41:08 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e7bfe8ef-780d-4940-8755-dd841e5ffbee tempest-CreateVolumesFromImageTest-1957600402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (322f0dba-f296-4fc9-ba33-71b53d2f69d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:08 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e7bfe8ef-780d-4940-8755-dd841e5ffbee tempest-CreateVolumesFromImageTest-1957600402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (322f0dba-f296-4fc9-ba33-71b53d2f69d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:41:08 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e7bfe8ef-780d-4940-8755-dd841e5ffbee tempest-CreateVolumesFromImageTest-1957600402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78318e44-3073-47eb-930f-6714871dbf89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:08 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-e7bfe8ef-780d-4940-8755-dd841e5ffbee tempest-CreateVolumesFromImageTest-1957600402 None] Volume 804a613d-8152-4b9f-a2bf-697d1f4eacf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-804a613d-8152-4b9f-a2bf-697d1f4eacf5', 'volume_size': 1} Jul 08 18:41:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-e7bfe8ef-780d-4940-8755-dd841e5ffbee tempest-CreateVolumesFromImageTest-1957600402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:41:08 devstack sudo[94825]: pam_unix(sudo:session): session closed for user root Jul 08 18:41:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d1faca03-b5cc-4831-b99a-9652050b0646 tempest-CreateVolumesFromImageTest-1957600402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8fbff77a-223d-4970-b924-76b2670cc80e" returned: 0 in 0.906s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:41:08 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-d1faca03-b5cc-4831-b99a-9652050b0646 tempest-CreateVolumesFromImageTest-1957600402 None] <== create_volume: return (1936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:41:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-d1faca03-b5cc-4831-b99a-9652050b0646 tempest-CreateVolumesFromImageTest-1957600402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.938s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:41:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c95c04b6-d2f9-473e-8eec-346405f9770a tempest-CreateVolumesFromImageTest-1957600402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.510s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:41:08 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c95c04b6-d2f9-473e-8eec-346405f9770a tempest-CreateVolumesFromImageTest-1957600402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1861928367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=001b2f91-bcfd-417f-b661-968b2ea8cdb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd9611a1477c454e88d27f87b029d121',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:41:07Z,use_quota=True,user_id='5f3c6f3503764d01ba8ae2681b04e659',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:41:08 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-c95c04b6-d2f9-473e-8eec-346405f9770a tempest-CreateVolumesFromImageTest-1957600402 None] Creating volume 001b2f91-bcfd-417f-b661-968b2ea8cdb1 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:41:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c95c04b6-d2f9-473e-8eec-346405f9770a tempest-CreateVolumesFromImageTest-1957600402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:41:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c95c04b6-d2f9-473e-8eec-346405f9770a tempest-CreateVolumesFromImageTest-1957600402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:41:08 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c95c04b6-d2f9-473e-8eec-346405f9770a tempest-CreateVolumesFromImageTest-1957600402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:41:08 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c95c04b6-d2f9-473e-8eec-346405f9770a tempest-CreateVolumesFromImageTest-1957600402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:41:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c95c04b6-d2f9-473e-8eec-346405f9770a tempest-CreateVolumesFromImageTest-1957600402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:41:08 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c95c04b6-d2f9-473e-8eec-346405f9770a tempest-CreateVolumesFromImageTest-1957600402 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:41:08 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-c95c04b6-d2f9-473e-8eec-346405f9770a tempest-CreateVolumesFromImageTest-1957600402 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:41:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c95c04b6-d2f9-473e-8eec-346405f9770a tempest-CreateVolumesFromImageTest-1957600402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-001b2f91-bcfd-417f-b661-968b2ea8cdb1 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:41:08 devstack sudo[94828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-001b2f91-bcfd-417f-b661-968b2ea8cdb1 1073741824 Jul 08 18:41:08 devstack sudo[94828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:41:08 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d1faca03-b5cc-4831-b99a-9652050b0646 tempest-CreateVolumesFromImageTest-1957600402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fe54934-5677-416a-b96c-bd6ed5ee0a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fbff77a-223d-4970-b924-76b2670cc80e', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:41:08 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d1faca03-b5cc-4831-b99a-9652050b0646 tempest-CreateVolumesFromImageTest-1957600402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8bc20ac-4842-4aee-80b3-d14f3e2d1d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:08 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-d1faca03-b5cc-4831-b99a-9652050b0646 tempest-CreateVolumesFromImageTest-1957600402 None] Volume volume-8fbff77a-223d-4970-b924-76b2670cc80e (8fbff77a-223d-4970-b924-76b2670cc80e): created successfully Jul 08 18:41:08 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d1faca03-b5cc-4831-b99a-9652050b0646 tempest-CreateVolumesFromImageTest-1957600402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8bc20ac-4842-4aee-80b3-d14f3e2d1d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:41:08 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d1faca03-b5cc-4831-b99a-9652050b0646 tempest-CreateVolumesFromImageTest-1957600402 None] Flow 'volume_create_manager' (e33d3d50-7938-4ee4-b5ae-8670219c637a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:41:08 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-d1faca03-b5cc-4831-b99a-9652050b0646 tempest-CreateVolumesFromImageTest-1957600402 None] Created volume successfully. Jul 08 18:41:09 devstack sudo[94828]: pam_unix(sudo:session): session closed for user root Jul 08 18:41:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c95c04b6-d2f9-473e-8eec-346405f9770a tempest-CreateVolumesFromImageTest-1957600402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-001b2f91-bcfd-417f-b661-968b2ea8cdb1 1073741824" returned: 0 in 0.845s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:41:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c95c04b6-d2f9-473e-8eec-346405f9770a tempest-CreateVolumesFromImageTest-1957600402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-001b2f91-bcfd-417f-b661-968b2ea8cdb1 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:41:09 devstack sudo[94834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-001b2f91-bcfd-417f-b661-968b2ea8cdb1 Jul 08 18:41:09 devstack sudo[94834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:41:09 devstack sudo[94834]: pam_unix(sudo:session): session closed for user root Jul 08 18:41:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c95c04b6-d2f9-473e-8eec-346405f9770a tempest-CreateVolumesFromImageTest-1957600402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-001b2f91-bcfd-417f-b661-968b2ea8cdb1" returned: 0 in 0.632s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:41:09 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c95c04b6-d2f9-473e-8eec-346405f9770a tempest-CreateVolumesFromImageTest-1957600402 None] <== create_volume: return (1518ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:41:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c95c04b6-d2f9-473e-8eec-346405f9770a tempest-CreateVolumesFromImageTest-1957600402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:41:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b74eece5-ead3-4186-8cf8-bb531e5f1366 tempest-CreateVolumesFromImageTest-1957600402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.510s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:41:09 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b74eece5-ead3-4186-8cf8-bb531e5f1366 tempest-CreateVolumesFromImageTest-1957600402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2082324305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e835c855-3536-4793-ad0b-325748d22f85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd9611a1477c454e88d27f87b029d121',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:41:07Z,use_quota=True,user_id='5f3c6f3503764d01ba8ae2681b04e659',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:41:09 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-b74eece5-ead3-4186-8cf8-bb531e5f1366 tempest-CreateVolumesFromImageTest-1957600402 None] Creating volume e835c855-3536-4793-ad0b-325748d22f85 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:41:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b74eece5-ead3-4186-8cf8-bb531e5f1366 tempest-CreateVolumesFromImageTest-1957600402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:41:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b74eece5-ead3-4186-8cf8-bb531e5f1366 tempest-CreateVolumesFromImageTest-1957600402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:41:09 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b74eece5-ead3-4186-8cf8-bb531e5f1366 tempest-CreateVolumesFromImageTest-1957600402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:41:09 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b74eece5-ead3-4186-8cf8-bb531e5f1366 tempest-CreateVolumesFromImageTest-1957600402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:41:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b74eece5-ead3-4186-8cf8-bb531e5f1366 tempest-CreateVolumesFromImageTest-1957600402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:41:09 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b74eece5-ead3-4186-8cf8-bb531e5f1366 tempest-CreateVolumesFromImageTest-1957600402 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:41:09 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-b74eece5-ead3-4186-8cf8-bb531e5f1366 tempest-CreateVolumesFromImageTest-1957600402 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:41:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b74eece5-ead3-4186-8cf8-bb531e5f1366 tempest-CreateVolumesFromImageTest-1957600402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e835c855-3536-4793-ad0b-325748d22f85 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:41:09 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c95c04b6-d2f9-473e-8eec-346405f9770a tempest-CreateVolumesFromImageTest-1957600402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee4682bc-1b76-441d-a9cd-619c15d38bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-001b2f91-bcfd-417f-b661-968b2ea8cdb1', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:41:09 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c95c04b6-d2f9-473e-8eec-346405f9770a tempest-CreateVolumesFromImageTest-1957600402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c2e4ae5-d8dd-46eb-aad1-49fc82afa453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:09 devstack sudo[94837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e835c855-3536-4793-ad0b-325748d22f85 1073741824 Jul 08 18:41:09 devstack sudo[94837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:41:09 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-c95c04b6-d2f9-473e-8eec-346405f9770a tempest-CreateVolumesFromImageTest-1957600402 None] Volume volume-001b2f91-bcfd-417f-b661-968b2ea8cdb1 (001b2f91-bcfd-417f-b661-968b2ea8cdb1): created successfully Jul 08 18:41:09 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c95c04b6-d2f9-473e-8eec-346405f9770a tempest-CreateVolumesFromImageTest-1957600402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c2e4ae5-d8dd-46eb-aad1-49fc82afa453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:41:09 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c95c04b6-d2f9-473e-8eec-346405f9770a tempest-CreateVolumesFromImageTest-1957600402 None] Flow 'volume_create_manager' (484d2822-0caf-4669-a3ee-d158b0d1a405) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:41:09 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-c95c04b6-d2f9-473e-8eec-346405f9770a tempest-CreateVolumesFromImageTest-1957600402 None] Created volume successfully. Jul 08 18:41:10 devstack sudo[94837]: pam_unix(sudo:session): session closed for user root Jul 08 18:41:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b74eece5-ead3-4186-8cf8-bb531e5f1366 tempest-CreateVolumesFromImageTest-1957600402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e835c855-3536-4793-ad0b-325748d22f85 1073741824" returned: 0 in 0.906s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:41:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b74eece5-ead3-4186-8cf8-bb531e5f1366 tempest-CreateVolumesFromImageTest-1957600402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e835c855-3536-4793-ad0b-325748d22f85 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:41:10 devstack sudo[94843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e835c855-3536-4793-ad0b-325748d22f85 Jul 08 18:41:10 devstack sudo[94843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:41:11 devstack sudo[94843]: pam_unix(sudo:session): session closed for user root Jul 08 18:41:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b74eece5-ead3-4186-8cf8-bb531e5f1366 tempest-CreateVolumesFromImageTest-1957600402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e835c855-3536-4793-ad0b-325748d22f85" returned: 0 in 0.724s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:41:11 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b74eece5-ead3-4186-8cf8-bb531e5f1366 tempest-CreateVolumesFromImageTest-1957600402 None] <== create_volume: return (1675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:41:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b74eece5-ead3-4186-8cf8-bb531e5f1366 tempest-CreateVolumesFromImageTest-1957600402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.679s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:41:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-15917863-cbf8-41e3-a534-f676a31e0030 tempest-CreateVolumesFromImageTest-1957600402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.706s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:41:11 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-15917863-cbf8-41e3-a534-f676a31e0030 tempest-CreateVolumesFromImageTest-1957600402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-479170194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1eee94b-cd07-4d35-8ee9-9b571daeb853,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd9611a1477c454e88d27f87b029d121',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:41:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:41:08Z,use_quota=True,user_id='5f3c6f3503764d01ba8ae2681b04e659',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:41:11 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-15917863-cbf8-41e3-a534-f676a31e0030 tempest-CreateVolumesFromImageTest-1957600402 None] Creating volume b1eee94b-cd07-4d35-8ee9-9b571daeb853 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:41:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-15917863-cbf8-41e3-a534-f676a31e0030 tempest-CreateVolumesFromImageTest-1957600402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:41:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-15917863-cbf8-41e3-a534-f676a31e0030 tempest-CreateVolumesFromImageTest-1957600402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:41:11 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-15917863-cbf8-41e3-a534-f676a31e0030 tempest-CreateVolumesFromImageTest-1957600402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:41:11 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-15917863-cbf8-41e3-a534-f676a31e0030 tempest-CreateVolumesFromImageTest-1957600402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:41:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-15917863-cbf8-41e3-a534-f676a31e0030 tempest-CreateVolumesFromImageTest-1957600402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:41:11 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-15917863-cbf8-41e3-a534-f676a31e0030 tempest-CreateVolumesFromImageTest-1957600402 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:41:11 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-15917863-cbf8-41e3-a534-f676a31e0030 tempest-CreateVolumesFromImageTest-1957600402 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:41:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-15917863-cbf8-41e3-a534-f676a31e0030 tempest-CreateVolumesFromImageTest-1957600402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b1eee94b-cd07-4d35-8ee9-9b571daeb853 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:41:11 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b74eece5-ead3-4186-8cf8-bb531e5f1366 tempest-CreateVolumesFromImageTest-1957600402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (999c9f42-c09b-4d7e-92af-b6e423356166) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e835c855-3536-4793-ad0b-325748d22f85', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:41:11 devstack sudo[94846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b1eee94b-cd07-4d35-8ee9-9b571daeb853 1073741824 Jul 08 18:41:11 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b74eece5-ead3-4186-8cf8-bb531e5f1366 tempest-CreateVolumesFromImageTest-1957600402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c72d33e-5b3f-4f00-ae19-5b0cbe9593fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:11 devstack sudo[94846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:41:11 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-b74eece5-ead3-4186-8cf8-bb531e5f1366 tempest-CreateVolumesFromImageTest-1957600402 None] Volume volume-e835c855-3536-4793-ad0b-325748d22f85 (e835c855-3536-4793-ad0b-325748d22f85): created successfully Jul 08 18:41:11 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b74eece5-ead3-4186-8cf8-bb531e5f1366 tempest-CreateVolumesFromImageTest-1957600402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c72d33e-5b3f-4f00-ae19-5b0cbe9593fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:41:11 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b74eece5-ead3-4186-8cf8-bb531e5f1366 tempest-CreateVolumesFromImageTest-1957600402 None] Flow 'volume_create_manager' (1f0cfc2e-364e-41d6-b2b9-e28008c22499) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:41:11 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-b74eece5-ead3-4186-8cf8-bb531e5f1366 tempest-CreateVolumesFromImageTest-1957600402 None] Created volume successfully. Jul 08 18:41:12 devstack sudo[94846]: pam_unix(sudo:session): session closed for user root Jul 08 18:41:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-15917863-cbf8-41e3-a534-f676a31e0030 tempest-CreateVolumesFromImageTest-1957600402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b1eee94b-cd07-4d35-8ee9-9b571daeb853 1073741824" returned: 0 in 0.892s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:41:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-15917863-cbf8-41e3-a534-f676a31e0030 tempest-CreateVolumesFromImageTest-1957600402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b1eee94b-cd07-4d35-8ee9-9b571daeb853 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:41:12 devstack sudo[94852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b1eee94b-cd07-4d35-8ee9-9b571daeb853 Jul 08 18:41:12 devstack sudo[94852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:41:13 devstack sudo[94852]: pam_unix(sudo:session): session closed for user root Jul 08 18:41:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-15917863-cbf8-41e3-a534-f676a31e0030 tempest-CreateVolumesFromImageTest-1957600402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b1eee94b-cd07-4d35-8ee9-9b571daeb853" returned: 0 in 0.706s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:41:13 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-15917863-cbf8-41e3-a534-f676a31e0030 tempest-CreateVolumesFromImageTest-1957600402 None] <== create_volume: return (1665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:41:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-15917863-cbf8-41e3-a534-f676a31e0030 tempest-CreateVolumesFromImageTest-1957600402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.668s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:41:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-e7bfe8ef-780d-4940-8755-dd841e5ffbee tempest-CreateVolumesFromImageTest-1957600402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.969s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:41:13 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-e7bfe8ef-780d-4940-8755-dd841e5ffbee tempest-CreateVolumesFromImageTest-1957600402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-360152274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=804a613d-8152-4b9f-a2bf-697d1f4eacf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd9611a1477c454e88d27f87b029d121',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:41:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:41:08Z,use_quota=True,user_id='5f3c6f3503764d01ba8ae2681b04e659',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:41:13 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-e7bfe8ef-780d-4940-8755-dd841e5ffbee tempest-CreateVolumesFromImageTest-1957600402 None] Creating volume 804a613d-8152-4b9f-a2bf-697d1f4eacf5 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:41:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-e7bfe8ef-780d-4940-8755-dd841e5ffbee tempest-CreateVolumesFromImageTest-1957600402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:41:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-e7bfe8ef-780d-4940-8755-dd841e5ffbee tempest-CreateVolumesFromImageTest-1957600402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:41:13 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-e7bfe8ef-780d-4940-8755-dd841e5ffbee tempest-CreateVolumesFromImageTest-1957600402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:41:13 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-e7bfe8ef-780d-4940-8755-dd841e5ffbee tempest-CreateVolumesFromImageTest-1957600402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:41:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-e7bfe8ef-780d-4940-8755-dd841e5ffbee tempest-CreateVolumesFromImageTest-1957600402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:41:13 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-e7bfe8ef-780d-4940-8755-dd841e5ffbee tempest-CreateVolumesFromImageTest-1957600402 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:41:13 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-e7bfe8ef-780d-4940-8755-dd841e5ffbee tempest-CreateVolumesFromImageTest-1957600402 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:41:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e7bfe8ef-780d-4940-8755-dd841e5ffbee tempest-CreateVolumesFromImageTest-1957600402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-804a613d-8152-4b9f-a2bf-697d1f4eacf5 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:41:13 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-15917863-cbf8-41e3-a534-f676a31e0030 tempest-CreateVolumesFromImageTest-1957600402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8627310d-7b34-4e10-923c-f6850e627df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1eee94b-cd07-4d35-8ee9-9b571daeb853', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:41:13 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-15917863-cbf8-41e3-a534-f676a31e0030 tempest-CreateVolumesFromImageTest-1957600402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (888b3ba2-7879-46e0-96bb-696ecb0733be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:13 devstack sudo[94857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-804a613d-8152-4b9f-a2bf-697d1f4eacf5 1073741824 Jul 08 18:41:13 devstack sudo[94857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:41:13 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-15917863-cbf8-41e3-a534-f676a31e0030 tempest-CreateVolumesFromImageTest-1957600402 None] Volume volume-b1eee94b-cd07-4d35-8ee9-9b571daeb853 (b1eee94b-cd07-4d35-8ee9-9b571daeb853): created successfully Jul 08 18:41:13 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-15917863-cbf8-41e3-a534-f676a31e0030 tempest-CreateVolumesFromImageTest-1957600402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (888b3ba2-7879-46e0-96bb-696ecb0733be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:41:13 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-15917863-cbf8-41e3-a534-f676a31e0030 tempest-CreateVolumesFromImageTest-1957600402 None] Flow 'volume_create_manager' (9186c17d-d045-4c02-a497-b5ec1115afc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:41:13 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-15917863-cbf8-41e3-a534-f676a31e0030 tempest-CreateVolumesFromImageTest-1957600402 None] Created volume successfully. Jul 08 18:41:13 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2206522-8fff-4c28-93bc-ec68484a99c5 tempest-AttachVolumeNegativeTest-1161175669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:41:13 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d2206522-8fff-4c28-93bc-ec68484a99c5 tempest-AttachVolumeNegativeTest-1161175669 None] Flow 'volume_create_manager' (e4031017-77e4-4247-88f4-d773a5a504e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:41:13 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d2206522-8fff-4c28-93bc-ec68484a99c5 tempest-AttachVolumeNegativeTest-1161175669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e44a71f-21cd-4d70-a3f0-4ce6279f4b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:13 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d2206522-8fff-4c28-93bc-ec68484a99c5 tempest-AttachVolumeNegativeTest-1161175669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e44a71f-21cd-4d70-a3f0-4ce6279f4b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2055649161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b4dca61-9469-4232-bec8-c9e0bd88ebec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='035c4dfd607044478d3458ed4f58e3a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:41:14Z,use_quota=True,user_id='543e2e6506b348a1a7caf34ac9ee1346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:41:14 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d2206522-8fff-4c28-93bc-ec68484a99c5 tempest-AttachVolumeNegativeTest-1161175669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7f664c2-c211-437c-b979-b90d3058b34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:14 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d2206522-8fff-4c28-93bc-ec68484a99c5 tempest-AttachVolumeNegativeTest-1161175669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7f664c2-c211-437c-b979-b90d3058b34b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:41:14 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d2206522-8fff-4c28-93bc-ec68484a99c5 tempest-AttachVolumeNegativeTest-1161175669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b5cd22c-3a69-4b7c-8959-f681d0b70e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:14 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d2206522-8fff-4c28-93bc-ec68484a99c5 tempest-AttachVolumeNegativeTest-1161175669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b5cd22c-3a69-4b7c-8959-f681d0b70e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b4dca61-9469-4232-bec8-c9e0bd88ebec', 'volume_name': 'volume-0b4dca61-9469-4232-bec8-c9e0bd88ebec', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:41:14 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d2206522-8fff-4c28-93bc-ec68484a99c5 tempest-AttachVolumeNegativeTest-1161175669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee64dd68-acb9-4a28-8f00-6583af3a2356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:14 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d2206522-8fff-4c28-93bc-ec68484a99c5 tempest-AttachVolumeNegativeTest-1161175669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee64dd68-acb9-4a28-8f00-6583af3a2356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:41:14 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d2206522-8fff-4c28-93bc-ec68484a99c5 tempest-AttachVolumeNegativeTest-1161175669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76517043-a0e5-4bc3-8b41-b56c07bf5435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:14 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-d2206522-8fff-4c28-93bc-ec68484a99c5 tempest-AttachVolumeNegativeTest-1161175669 None] Volume 0b4dca61-9469-4232-bec8-c9e0bd88ebec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b4dca61-9469-4232-bec8-c9e0bd88ebec', 'volume_size': 1} Jul 08 18:41:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-d2206522-8fff-4c28-93bc-ec68484a99c5 tempest-AttachVolumeNegativeTest-1161175669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:41:14 devstack sudo[94857]: pam_unix(sudo:session): session closed for user root Jul 08 18:41:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e7bfe8ef-780d-4940-8755-dd841e5ffbee tempest-CreateVolumesFromImageTest-1957600402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-804a613d-8152-4b9f-a2bf-697d1f4eacf5 1073741824" returned: 0 in 0.968s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:41:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e7bfe8ef-780d-4940-8755-dd841e5ffbee tempest-CreateVolumesFromImageTest-1957600402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-804a613d-8152-4b9f-a2bf-697d1f4eacf5 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:41:14 devstack sudo[94863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-804a613d-8152-4b9f-a2bf-697d1f4eacf5 Jul 08 18:41:14 devstack sudo[94863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:41:14 devstack sudo[94863]: pam_unix(sudo:session): session closed for user root Jul 08 18:41:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e7bfe8ef-780d-4940-8755-dd841e5ffbee tempest-CreateVolumesFromImageTest-1957600402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-804a613d-8152-4b9f-a2bf-697d1f4eacf5" returned: 0 in 0.672s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:41:14 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-e7bfe8ef-780d-4940-8755-dd841e5ffbee tempest-CreateVolumesFromImageTest-1957600402 None] <== create_volume: return (1679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:41:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-e7bfe8ef-780d-4940-8755-dd841e5ffbee tempest-CreateVolumesFromImageTest-1957600402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.683s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:41:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-d2206522-8fff-4c28-93bc-ec68484a99c5 tempest-AttachVolumeNegativeTest-1161175669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.782s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:41:14 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-d2206522-8fff-4c28-93bc-ec68484a99c5 tempest-AttachVolumeNegativeTest-1161175669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2055649161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b4dca61-9469-4232-bec8-c9e0bd88ebec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='035c4dfd607044478d3458ed4f58e3a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:41:14Z,use_quota=True,user_id='543e2e6506b348a1a7caf34ac9ee1346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:41:14 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-d2206522-8fff-4c28-93bc-ec68484a99c5 tempest-AttachVolumeNegativeTest-1161175669 None] Creating volume 0b4dca61-9469-4232-bec8-c9e0bd88ebec {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:41:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-d2206522-8fff-4c28-93bc-ec68484a99c5 tempest-AttachVolumeNegativeTest-1161175669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:41:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-d2206522-8fff-4c28-93bc-ec68484a99c5 tempest-AttachVolumeNegativeTest-1161175669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:41:14 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-d2206522-8fff-4c28-93bc-ec68484a99c5 tempest-AttachVolumeNegativeTest-1161175669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:41:14 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-d2206522-8fff-4c28-93bc-ec68484a99c5 tempest-AttachVolumeNegativeTest-1161175669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:41:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-d2206522-8fff-4c28-93bc-ec68484a99c5 tempest-AttachVolumeNegativeTest-1161175669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:41:14 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-d2206522-8fff-4c28-93bc-ec68484a99c5 tempest-AttachVolumeNegativeTest-1161175669 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:41:14 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-d2206522-8fff-4c28-93bc-ec68484a99c5 tempest-AttachVolumeNegativeTest-1161175669 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:41:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d2206522-8fff-4c28-93bc-ec68484a99c5 tempest-AttachVolumeNegativeTest-1161175669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0b4dca61-9469-4232-bec8-c9e0bd88ebec 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:41:14 devstack sudo[94866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0b4dca61-9469-4232-bec8-c9e0bd88ebec 1073741824 Jul 08 18:41:14 devstack sudo[94866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:41:14 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e7bfe8ef-780d-4940-8755-dd841e5ffbee tempest-CreateVolumesFromImageTest-1957600402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78318e44-3073-47eb-930f-6714871dbf89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-804a613d-8152-4b9f-a2bf-697d1f4eacf5', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:41:14 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e7bfe8ef-780d-4940-8755-dd841e5ffbee tempest-CreateVolumesFromImageTest-1957600402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89ca18fd-24cf-418b-9894-0494b75bc40d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:14 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-e7bfe8ef-780d-4940-8755-dd841e5ffbee tempest-CreateVolumesFromImageTest-1957600402 None] Volume volume-804a613d-8152-4b9f-a2bf-697d1f4eacf5 (804a613d-8152-4b9f-a2bf-697d1f4eacf5): created successfully Jul 08 18:41:14 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e7bfe8ef-780d-4940-8755-dd841e5ffbee tempest-CreateVolumesFromImageTest-1957600402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89ca18fd-24cf-418b-9894-0494b75bc40d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:41:14 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e7bfe8ef-780d-4940-8755-dd841e5ffbee tempest-CreateVolumesFromImageTest-1957600402 None] Flow 'volume_create_manager' (16efbd0d-0918-4e39-9c97-3b1461e47319) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:41:14 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-e7bfe8ef-780d-4940-8755-dd841e5ffbee tempest-CreateVolumesFromImageTest-1957600402 None] Created volume successfully. Jul 08 18:41:15 devstack sudo[94866]: pam_unix(sudo:session): session closed for user root Jul 08 18:41:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d2206522-8fff-4c28-93bc-ec68484a99c5 tempest-AttachVolumeNegativeTest-1161175669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0b4dca61-9469-4232-bec8-c9e0bd88ebec 1073741824" returned: 0 in 0.873s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:41:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d2206522-8fff-4c28-93bc-ec68484a99c5 tempest-AttachVolumeNegativeTest-1161175669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0b4dca61-9469-4232-bec8-c9e0bd88ebec {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:41:15 devstack sudo[94879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0b4dca61-9469-4232-bec8-c9e0bd88ebec Jul 08 18:41:15 devstack sudo[94879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:41:15 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9f7e1775-9394-432d-9237-bf37731bd073 tempest-CreateVolumesFromImageTest-1957600402 None] Acquiring lock "cinder-804a613d-8152-4b9f-a2bf-697d1f4eacf5-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:41:15 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9f7e1775-9394-432d-9237-bf37731bd073 tempest-CreateVolumesFromImageTest-1957600402 None] Lock "cinder-804a613d-8152-4b9f-a2bf-697d1f4eacf5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:41:15 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9f7e1775-9394-432d-9237-bf37731bd073 tempest-CreateVolumesFromImageTest-1957600402 None] Acquiring lock "cinder-quobyte-804a613d-8152-4b9f-a2bf-697d1f4eacf5" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:41:16 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9f7e1775-9394-432d-9237-bf37731bd073 tempest-CreateVolumesFromImageTest-1957600402 None] Lock "cinder-quobyte-804a613d-8152-4b9f-a2bf-697d1f4eacf5" acquired by "delete_volume" :: waited 0.014s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:41:16 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[aece11e4-3afe-48ee-ad46-96a98393947a]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:41:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9f7e1775-9394-432d-9237-bf37731bd073 tempest-CreateVolumesFromImageTest-1957600402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-804a613d-8152-4b9f-a2bf-697d1f4eacf5 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:41:16 devstack sudo[94881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-804a613d-8152-4b9f-a2bf-697d1f4eacf5 Jul 08 18:41:16 devstack sudo[94881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:41:16 devstack sudo[94879]: pam_unix(sudo:session): session closed for user root Jul 08 18:41:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d2206522-8fff-4c28-93bc-ec68484a99c5 tempest-AttachVolumeNegativeTest-1161175669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0b4dca61-9469-4232-bec8-c9e0bd88ebec" returned: 0 in 0.685s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:41:16 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-d2206522-8fff-4c28-93bc-ec68484a99c5 tempest-AttachVolumeNegativeTest-1161175669 None] <== create_volume: return (1599ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:41:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-d2206522-8fff-4c28-93bc-ec68484a99c5 tempest-AttachVolumeNegativeTest-1161175669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.603s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:41:16 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d2206522-8fff-4c28-93bc-ec68484a99c5 tempest-AttachVolumeNegativeTest-1161175669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76517043-a0e5-4bc3-8b41-b56c07bf5435) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b4dca61-9469-4232-bec8-c9e0bd88ebec', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:41:16 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d2206522-8fff-4c28-93bc-ec68484a99c5 tempest-AttachVolumeNegativeTest-1161175669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1494713b-4776-49ef-a180-cae3f491facb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:16 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-d2206522-8fff-4c28-93bc-ec68484a99c5 tempest-AttachVolumeNegativeTest-1161175669 None] Volume volume-0b4dca61-9469-4232-bec8-c9e0bd88ebec (0b4dca61-9469-4232-bec8-c9e0bd88ebec): created successfully Jul 08 18:41:16 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d2206522-8fff-4c28-93bc-ec68484a99c5 tempest-AttachVolumeNegativeTest-1161175669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1494713b-4776-49ef-a180-cae3f491facb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:41:16 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d2206522-8fff-4c28-93bc-ec68484a99c5 tempest-AttachVolumeNegativeTest-1161175669 None] Flow 'volume_create_manager' (e4031017-77e4-4247-88f4-d773a5a504e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:41:16 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-d2206522-8fff-4c28-93bc-ec68484a99c5 tempest-AttachVolumeNegativeTest-1161175669 None] Created volume successfully. Jul 08 18:41:16 devstack sudo[94881]: pam_unix(sudo:session): session closed for user root Jul 08 18:41:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9f7e1775-9394-432d-9237-bf37731bd073 tempest-CreateVolumesFromImageTest-1957600402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-804a613d-8152-4b9f-a2bf-697d1f4eacf5" returned: 0 in 0.790s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:41:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9f7e1775-9394-432d-9237-bf37731bd073 tempest-CreateVolumesFromImageTest-1957600402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-804a613d-8152-4b9f-a2bf-697d1f4eacf5 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:41:16 devstack sudo[94887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-804a613d-8152-4b9f-a2bf-697d1f4eacf5 Jul 08 18:41:16 devstack sudo[94887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:41:17 devstack sudo[94887]: pam_unix(sudo:session): session closed for user root Jul 08 18:41:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9f7e1775-9394-432d-9237-bf37731bd073 tempest-CreateVolumesFromImageTest-1957600402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-804a613d-8152-4b9f-a2bf-697d1f4eacf5" returned: 0 in 0.725s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:41:17 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9f7e1775-9394-432d-9237-bf37731bd073 tempest-CreateVolumesFromImageTest-1957600402 None] Lock "cinder-quobyte-804a613d-8152-4b9f-a2bf-697d1f4eacf5" released by "delete_volume" :: held 1.557s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:41:17 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-9f7e1775-9394-432d-9237-bf37731bd073 tempest-CreateVolumesFromImageTest-1957600402 None] Created reservations ['a39586b3-ddeb-4c56-99ac-b1e14577fcb0', '7e1a18ca-f68d-4537-b9dc-b4fdd895193e', 'cbe21550-1158-426b-a13f-80299b08cee9', '6fc4b2df-68f3-4b19-9506-fe91aa89830b'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:41:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-9f7e1775-9394-432d-9237-bf37731bd073 tempest-CreateVolumesFromImageTest-1957600402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:41:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-9f7e1775-9394-432d-9237-bf37731bd073 tempest-CreateVolumesFromImageTest-1957600402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:41:17 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-9f7e1775-9394-432d-9237-bf37731bd073 tempest-CreateVolumesFromImageTest-1957600402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:41:17 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-9f7e1775-9394-432d-9237-bf37731bd073 tempest-CreateVolumesFromImageTest-1957600402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:41:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-9f7e1775-9394-432d-9237-bf37731bd073 tempest-CreateVolumesFromImageTest-1957600402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:41:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9f7e1775-9394-432d-9237-bf37731bd073 tempest-CreateVolumesFromImageTest-1957600402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:41:17 devstack sudo[94898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:41:17 devstack sudo[94898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:41:18 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-aee4b323-3f14-42e9-bf26-f1e7b8ca3cfb tempest-CreateVolumesFromImageTest-1957600402 None] Acquiring lock "cinder-b1eee94b-cd07-4d35-8ee9-9b571daeb853-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:41:18 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-aee4b323-3f14-42e9-bf26-f1e7b8ca3cfb tempest-CreateVolumesFromImageTest-1957600402 None] Lock "cinder-b1eee94b-cd07-4d35-8ee9-9b571daeb853-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:41:18 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-aee4b323-3f14-42e9-bf26-f1e7b8ca3cfb tempest-CreateVolumesFromImageTest-1957600402 None] Acquiring lock "cinder-quobyte-b1eee94b-cd07-4d35-8ee9-9b571daeb853" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:41:18 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-aee4b323-3f14-42e9-bf26-f1e7b8ca3cfb tempest-CreateVolumesFromImageTest-1957600402 None] Lock "cinder-quobyte-b1eee94b-cd07-4d35-8ee9-9b571daeb853" acquired by "delete_volume" :: waited 0.020s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:41:18 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d28745-95ab-41b1-8e8a-64a147022056]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:41:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-aee4b323-3f14-42e9-bf26-f1e7b8ca3cfb tempest-CreateVolumesFromImageTest-1957600402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b1eee94b-cd07-4d35-8ee9-9b571daeb853 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:41:18 devstack sudo[94898]: pam_unix(sudo:session): session closed for user root Jul 08 18:41:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9f7e1775-9394-432d-9237-bf37731bd073 tempest-CreateVolumesFromImageTest-1957600402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.727s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:41:18 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-9f7e1775-9394-432d-9237-bf37731bd073 tempest-CreateVolumesFromImageTest-1957600402 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:41:18 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-9f7e1775-9394-432d-9237-bf37731bd073 tempest-CreateVolumesFromImageTest-1957600402 None] Deleted volume successfully. Jul 08 18:41:18 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9f7e1775-9394-432d-9237-bf37731bd073 tempest-CreateVolumesFromImageTest-1957600402 None] Lock "cinder-804a613d-8152-4b9f-a2bf-697d1f4eacf5-delete_volume" released by "delete_volume" :: held 2.513s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:41:18 devstack sudo[94901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b1eee94b-cd07-4d35-8ee9-9b571daeb853 Jul 08 18:41:18 devstack sudo[94901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:41:19 devstack sudo[94901]: pam_unix(sudo:session): session closed for user root Jul 08 18:41:19 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-aee4b323-3f14-42e9-bf26-f1e7b8ca3cfb tempest-CreateVolumesFromImageTest-1957600402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b1eee94b-cd07-4d35-8ee9-9b571daeb853" returned: 0 in 0.900s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:41:19 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-aee4b323-3f14-42e9-bf26-f1e7b8ca3cfb tempest-CreateVolumesFromImageTest-1957600402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b1eee94b-cd07-4d35-8ee9-9b571daeb853 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:41:19 devstack sudo[94907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b1eee94b-cd07-4d35-8ee9-9b571daeb853 Jul 08 18:41:19 devstack sudo[94907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:41:20 devstack sudo[94907]: pam_unix(sudo:session): session closed for user root Jul 08 18:41:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-aee4b323-3f14-42e9-bf26-f1e7b8ca3cfb tempest-CreateVolumesFromImageTest-1957600402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b1eee94b-cd07-4d35-8ee9-9b571daeb853" returned: 0 in 0.848s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:41:20 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-aee4b323-3f14-42e9-bf26-f1e7b8ca3cfb tempest-CreateVolumesFromImageTest-1957600402 None] Lock "cinder-quobyte-b1eee94b-cd07-4d35-8ee9-9b571daeb853" released by "delete_volume" :: held 1.807s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:41:20 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-aee4b323-3f14-42e9-bf26-f1e7b8ca3cfb tempest-CreateVolumesFromImageTest-1957600402 None] Created reservations ['081b3e4e-1e51-4c5e-9eff-4191f9daa902', 'c0dacbdd-7455-45a7-9edf-83007284d475', '1b78fded-be0d-4631-8c3c-9ec08ad8e153', 'c1b1d883-f45b-42af-abe9-d7d2a9432f89'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:41:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-e910d9bc-2bfc-4ce2-93a8-8e373bcf9fdb req-01e53bf5-3ebb-4ddf-9f75-79ccb6964157 tempest-AttachVolumeNegativeTest-1161175669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:41:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-e910d9bc-2bfc-4ce2-93a8-8e373bcf9fdb req-01e53bf5-3ebb-4ddf-9f75-79ccb6964157 tempest-AttachVolumeNegativeTest-1161175669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:41:20 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[036f744e-56eb-42ab-a661-15de93387b09]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:41:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-e910d9bc-2bfc-4ce2-93a8-8e373bcf9fdb req-01e53bf5-3ebb-4ddf-9f75-79ccb6964157 tempest-AttachVolumeNegativeTest-1161175669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0b4dca61-9469-4232-bec8-c9e0bd88ebec {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:41:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-aee4b323-3f14-42e9-bf26-f1e7b8ca3cfb tempest-CreateVolumesFromImageTest-1957600402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:41:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-aee4b323-3f14-42e9-bf26-f1e7b8ca3cfb tempest-CreateVolumesFromImageTest-1957600402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:41:20 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-aee4b323-3f14-42e9-bf26-f1e7b8ca3cfb tempest-CreateVolumesFromImageTest-1957600402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:41:20 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-aee4b323-3f14-42e9-bf26-f1e7b8ca3cfb tempest-CreateVolumesFromImageTest-1957600402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:41:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-aee4b323-3f14-42e9-bf26-f1e7b8ca3cfb tempest-CreateVolumesFromImageTest-1957600402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:41:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-aee4b323-3f14-42e9-bf26-f1e7b8ca3cfb tempest-CreateVolumesFromImageTest-1957600402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:41:20 devstack sudo[94923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:41:20 devstack sudo[94923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:41:20 devstack sudo[94922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0b4dca61-9469-4232-bec8-c9e0bd88ebec Jul 08 18:41:20 devstack sudo[94922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:41:20 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-2e37f661-9483-4753-b2e4-6e32ab881b69 tempest-CreateVolumesFromImageTest-1957600402 None] Acquiring lock "cinder-e835c855-3536-4793-ad0b-325748d22f85-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:41:20 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-2e37f661-9483-4753-b2e4-6e32ab881b69 tempest-CreateVolumesFromImageTest-1957600402 None] Lock "cinder-e835c855-3536-4793-ad0b-325748d22f85-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:41:20 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-2e37f661-9483-4753-b2e4-6e32ab881b69 tempest-CreateVolumesFromImageTest-1957600402 None] Acquiring lock "cinder-quobyte-e835c855-3536-4793-ad0b-325748d22f85" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:41:20 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-2e37f661-9483-4753-b2e4-6e32ab881b69 tempest-CreateVolumesFromImageTest-1957600402 None] Lock "cinder-quobyte-e835c855-3536-4793-ad0b-325748d22f85" acquired by "delete_volume" :: waited 0.024s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:41:20 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a4de4c-7acf-49de-a936-5a87b4ef44e6]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:41:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2e37f661-9483-4753-b2e4-6e32ab881b69 tempest-CreateVolumesFromImageTest-1957600402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e835c855-3536-4793-ad0b-325748d22f85 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:41:20 devstack sudo[94926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e835c855-3536-4793-ad0b-325748d22f85 Jul 08 18:41:20 devstack sudo[94926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:41:21 devstack sudo[94922]: pam_unix(sudo:session): session closed for user root Jul 08 18:41:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-e910d9bc-2bfc-4ce2-93a8-8e373bcf9fdb req-01e53bf5-3ebb-4ddf-9f75-79ccb6964157 tempest-AttachVolumeNegativeTest-1161175669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0b4dca61-9469-4232-bec8-c9e0bd88ebec" returned: 0 in 0.908s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:41:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-e910d9bc-2bfc-4ce2-93a8-8e373bcf9fdb req-01e53bf5-3ebb-4ddf-9f75-79ccb6964157 tempest-AttachVolumeNegativeTest-1161175669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.949s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:41:21 devstack sudo[94923]: pam_unix(sudo:session): session closed for user root Jul 08 18:41:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-aee4b323-3f14-42e9-bf26-f1e7b8ca3cfb tempest-CreateVolumesFromImageTest-1957600402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.858s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:41:21 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-aee4b323-3f14-42e9-bf26-f1e7b8ca3cfb tempest-CreateVolumesFromImageTest-1957600402 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:41:21 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-aee4b323-3f14-42e9-bf26-f1e7b8ca3cfb tempest-CreateVolumesFromImageTest-1957600402 None] Deleted volume successfully. Jul 08 18:41:21 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-aee4b323-3f14-42e9-bf26-f1e7b8ca3cfb tempest-CreateVolumesFromImageTest-1957600402 None] Lock "cinder-b1eee94b-cd07-4d35-8ee9-9b571daeb853-delete_volume" released by "delete_volume" :: held 3.016s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:41:21 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-e910d9bc-2bfc-4ce2-93a8-8e373bcf9fdb req-01e53bf5-3ebb-4ddf-9f75-79ccb6964157 tempest-AttachVolumeNegativeTest-1161175669 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2', 'name': 'volume-0b4dca61-9469-4232-bec8-c9e0bd88ebec', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ef5179af-562a-45ad-9d67-d7124eb63fb9', 'enforce_multipath': True} {{(pid=86873) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 18:41:21 devstack cinder-volume[86873]: INFO cinder.volume.manager [req-e910d9bc-2bfc-4ce2-93a8-8e373bcf9fdb req-01e53bf5-3ebb-4ddf-9f75-79ccb6964157 tempest-AttachVolumeNegativeTest-1161175669 None] attachment_update completed successfully. Jul 08 18:41:21 devstack sudo[94926]: pam_unix(sudo:session): session closed for user root Jul 08 18:41:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2e37f661-9483-4753-b2e4-6e32ab881b69 tempest-CreateVolumesFromImageTest-1957600402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e835c855-3536-4793-ad0b-325748d22f85" returned: 0 in 0.845s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:41:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2e37f661-9483-4753-b2e4-6e32ab881b69 tempest-CreateVolumesFromImageTest-1957600402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e835c855-3536-4793-ad0b-325748d22f85 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:41:21 devstack sudo[94936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e835c855-3536-4793-ad0b-325748d22f85 Jul 08 18:41:21 devstack sudo[94936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:41:21 devstack cinder-volume[86873]: INFO cinder.volume.manager [req-063e0d7f-fae4-4747-acc2-76f96c3c8473 req-d008fe75-f5d5-412b-88c7-3e94b3024494 tempest-TestMinimumBasicScenario-1335437034 None] Terminate volume connection completed successfully. Jul 08 18:41:21 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-063e0d7f-fae4-4747-acc2-76f96c3c8473 req-d008fe75-f5d5-412b-88c7-3e94b3024494 tempest-TestMinimumBasicScenario-1335437034 None] Deleting attachment 60466609-6264-4c56-a7da-7eb64224e149. {{(pid=86873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 18:41:22 devstack sudo[94936]: pam_unix(sudo:session): session closed for user root Jul 08 18:41:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2e37f661-9483-4753-b2e4-6e32ab881b69 tempest-CreateVolumesFromImageTest-1957600402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e835c855-3536-4793-ad0b-325748d22f85" returned: 0 in 0.884s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:41:22 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-2e37f661-9483-4753-b2e4-6e32ab881b69 tempest-CreateVolumesFromImageTest-1957600402 None] Lock "cinder-quobyte-e835c855-3536-4793-ad0b-325748d22f85" released by "delete_volume" :: held 1.788s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:41:22 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-2e37f661-9483-4753-b2e4-6e32ab881b69 tempest-CreateVolumesFromImageTest-1957600402 None] Created reservations ['84a62c20-925d-4a67-9d77-0b4e2bca2eef', '5020bd1c-3481-47e1-8e51-6a505d28d724', '19cc2760-c4a1-4add-bade-7931a0e48f4b', '015c032c-73dc-484c-b217-8a265b5e2328'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:41:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-2e37f661-9483-4753-b2e4-6e32ab881b69 tempest-CreateVolumesFromImageTest-1957600402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:41:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-2e37f661-9483-4753-b2e4-6e32ab881b69 tempest-CreateVolumesFromImageTest-1957600402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:41:22 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-2e37f661-9483-4753-b2e4-6e32ab881b69 tempest-CreateVolumesFromImageTest-1957600402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:41:22 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-2e37f661-9483-4753-b2e4-6e32ab881b69 tempest-CreateVolumesFromImageTest-1957600402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:41:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-2e37f661-9483-4753-b2e4-6e32ab881b69 tempest-CreateVolumesFromImageTest-1957600402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:41:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2e37f661-9483-4753-b2e4-6e32ab881b69 tempest-CreateVolumesFromImageTest-1957600402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:41:22 devstack sudo[94944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:41:22 devstack sudo[94944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:41:22 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6a29afa3-1b55-4ccd-864d-70934d2f3253 tempest-CreateVolumesFromImageTest-1957600402 None] Acquiring lock "cinder-001b2f91-bcfd-417f-b661-968b2ea8cdb1-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:41:22 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6a29afa3-1b55-4ccd-864d-70934d2f3253 tempest-CreateVolumesFromImageTest-1957600402 None] Lock "cinder-001b2f91-bcfd-417f-b661-968b2ea8cdb1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:41:22 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6a29afa3-1b55-4ccd-864d-70934d2f3253 tempest-CreateVolumesFromImageTest-1957600402 None] Acquiring lock "cinder-quobyte-001b2f91-bcfd-417f-b661-968b2ea8cdb1" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:41:22 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6a29afa3-1b55-4ccd-864d-70934d2f3253 tempest-CreateVolumesFromImageTest-1957600402 None] Lock "cinder-quobyte-001b2f91-bcfd-417f-b661-968b2ea8cdb1" acquired by "delete_volume" :: waited 0.020s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:41:22 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[87491e00-2faf-4a31-b312-6cd15974a340]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:41:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6a29afa3-1b55-4ccd-864d-70934d2f3253 tempest-CreateVolumesFromImageTest-1957600402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-001b2f91-bcfd-417f-b661-968b2ea8cdb1 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:41:23 devstack sudo[94946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-001b2f91-bcfd-417f-b661-968b2ea8cdb1 Jul 08 18:41:23 devstack sudo[94946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:41:23 devstack sudo[94944]: pam_unix(sudo:session): session closed for user root Jul 08 18:41:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2e37f661-9483-4753-b2e4-6e32ab881b69 tempest-CreateVolumesFromImageTest-1957600402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.830s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:41:23 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-2e37f661-9483-4753-b2e4-6e32ab881b69 tempest-CreateVolumesFromImageTest-1957600402 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:41:23 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-2e37f661-9483-4753-b2e4-6e32ab881b69 tempest-CreateVolumesFromImageTest-1957600402 None] Deleted volume successfully. Jul 08 18:41:23 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-2e37f661-9483-4753-b2e4-6e32ab881b69 tempest-CreateVolumesFromImageTest-1957600402 None] Lock "cinder-e835c855-3536-4793-ad0b-325748d22f85-delete_volume" released by "delete_volume" :: held 2.876s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:41:23 devstack sudo[94946]: pam_unix(sudo:session): session closed for user root Jul 08 18:41:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6a29afa3-1b55-4ccd-864d-70934d2f3253 tempest-CreateVolumesFromImageTest-1957600402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-001b2f91-bcfd-417f-b661-968b2ea8cdb1" returned: 0 in 0.875s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:41:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6a29afa3-1b55-4ccd-864d-70934d2f3253 tempest-CreateVolumesFromImageTest-1957600402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-001b2f91-bcfd-417f-b661-968b2ea8cdb1 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:41:23 devstack sudo[94952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-001b2f91-bcfd-417f-b661-968b2ea8cdb1 Jul 08 18:41:23 devstack sudo[94952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:41:23 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-fb5e3326-3b50-4e93-a3a0-01baa65e5586 tempest-TestMinimumBasicScenario-1335437034 None] Acquiring lock "cinder-3cc87414-83b6-411f-932a-c88d6236e18c-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:41:23 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-fb5e3326-3b50-4e93-a3a0-01baa65e5586 tempest-TestMinimumBasicScenario-1335437034 None] Lock "cinder-3cc87414-83b6-411f-932a-c88d6236e18c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:41:23 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:SELECT=72,cinder:INSERT=20,cinder:UPDATE=82,cinder:DELETE=5 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:41:23 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-fb5e3326-3b50-4e93-a3a0-01baa65e5586 tempest-TestMinimumBasicScenario-1335437034 None] Acquiring lock "cinder-quobyte-3cc87414-83b6-411f-932a-c88d6236e18c" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:41:23 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-fb5e3326-3b50-4e93-a3a0-01baa65e5586 tempest-TestMinimumBasicScenario-1335437034 None] Lock "cinder-quobyte-3cc87414-83b6-411f-932a-c88d6236e18c" acquired by "delete_volume" :: waited 0.020s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:41:23 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf186ce-d845-43db-bf50-fc84cef6eae5]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:41:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-fb5e3326-3b50-4e93-a3a0-01baa65e5586 tempest-TestMinimumBasicScenario-1335437034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3cc87414-83b6-411f-932a-c88d6236e18c {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:41:24 devstack sudo[94954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3cc87414-83b6-411f-932a-c88d6236e18c Jul 08 18:41:24 devstack sudo[94954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:41:24 devstack sudo[94952]: pam_unix(sudo:session): session closed for user root Jul 08 18:41:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6a29afa3-1b55-4ccd-864d-70934d2f3253 tempest-CreateVolumesFromImageTest-1957600402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-001b2f91-bcfd-417f-b661-968b2ea8cdb1" returned: 0 in 0.742s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:41:24 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6a29afa3-1b55-4ccd-864d-70934d2f3253 tempest-CreateVolumesFromImageTest-1957600402 None] Lock "cinder-quobyte-001b2f91-bcfd-417f-b661-968b2ea8cdb1" released by "delete_volume" :: held 1.684s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:41:24 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-6a29afa3-1b55-4ccd-864d-70934d2f3253 tempest-CreateVolumesFromImageTest-1957600402 None] Created reservations ['127e9c50-6555-4c27-aca0-f6e3957b0d89', '331da383-07a2-405d-9a49-3aae20958267', '6219fb2c-e8c6-4701-9991-ede47d5f1f46', '3d4d6523-3b61-419f-b279-156f4b4ec163'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:41:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6a29afa3-1b55-4ccd-864d-70934d2f3253 tempest-CreateVolumesFromImageTest-1957600402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:41:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6a29afa3-1b55-4ccd-864d-70934d2f3253 tempest-CreateVolumesFromImageTest-1957600402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:41:24 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-6a29afa3-1b55-4ccd-864d-70934d2f3253 tempest-CreateVolumesFromImageTest-1957600402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:41:24 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-6a29afa3-1b55-4ccd-864d-70934d2f3253 tempest-CreateVolumesFromImageTest-1957600402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:41:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6a29afa3-1b55-4ccd-864d-70934d2f3253 tempest-CreateVolumesFromImageTest-1957600402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:41:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6a29afa3-1b55-4ccd-864d-70934d2f3253 tempest-CreateVolumesFromImageTest-1957600402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:41:24 devstack sudo[94961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:41:24 devstack sudo[94961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:41:24 devstack sudo[94954]: pam_unix(sudo:session): session closed for user root Jul 08 18:41:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-fb5e3326-3b50-4e93-a3a0-01baa65e5586 tempest-TestMinimumBasicScenario-1335437034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3cc87414-83b6-411f-932a-c88d6236e18c" returned: 0 in 0.821s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:41:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-fb5e3326-3b50-4e93-a3a0-01baa65e5586 tempest-TestMinimumBasicScenario-1335437034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3cc87414-83b6-411f-932a-c88d6236e18c {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:41:24 devstack sudo[94963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3cc87414-83b6-411f-932a-c88d6236e18c Jul 08 18:41:24 devstack sudo[94963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:41:25 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-1928bc6c-55d9-433d-990e-80321cc86f39 tempest-CreateVolumesFromImageTest-1957600402 None] Acquiring lock "cinder-8fbff77a-223d-4970-b924-76b2670cc80e-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:41:25 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-1928bc6c-55d9-433d-990e-80321cc86f39 tempest-CreateVolumesFromImageTest-1957600402 None] Lock "cinder-8fbff77a-223d-4970-b924-76b2670cc80e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:41:25 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-1928bc6c-55d9-433d-990e-80321cc86f39 tempest-CreateVolumesFromImageTest-1957600402 None] Acquiring lock "cinder-quobyte-8fbff77a-223d-4970-b924-76b2670cc80e" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:41:25 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-1928bc6c-55d9-433d-990e-80321cc86f39 tempest-CreateVolumesFromImageTest-1957600402 None] Lock "cinder-quobyte-8fbff77a-223d-4970-b924-76b2670cc80e" acquired by "delete_volume" :: waited 0.026s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:41:25 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[6697fab8-cc86-460c-a38b-05b3d3628238]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:41:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1928bc6c-55d9-433d-990e-80321cc86f39 tempest-CreateVolumesFromImageTest-1957600402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8fbff77a-223d-4970-b924-76b2670cc80e {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:41:25 devstack sudo[94967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8fbff77a-223d-4970-b924-76b2670cc80e Jul 08 18:41:25 devstack sudo[94967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:41:25 devstack sudo[94961]: pam_unix(sudo:session): session closed for user root Jul 08 18:41:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6a29afa3-1b55-4ccd-864d-70934d2f3253 tempest-CreateVolumesFromImageTest-1957600402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.868s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:41:25 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-6a29afa3-1b55-4ccd-864d-70934d2f3253 tempest-CreateVolumesFromImageTest-1957600402 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:41:25 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-6a29afa3-1b55-4ccd-864d-70934d2f3253 tempest-CreateVolumesFromImageTest-1957600402 None] Deleted volume successfully. Jul 08 18:41:25 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6a29afa3-1b55-4ccd-864d-70934d2f3253 tempest-CreateVolumesFromImageTest-1957600402 None] Lock "cinder-001b2f91-bcfd-417f-b661-968b2ea8cdb1-delete_volume" released by "delete_volume" :: held 2.809s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:41:25 devstack sudo[94963]: pam_unix(sudo:session): session closed for user root Jul 08 18:41:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-fb5e3326-3b50-4e93-a3a0-01baa65e5586 tempest-TestMinimumBasicScenario-1335437034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3cc87414-83b6-411f-932a-c88d6236e18c" returned: 0 in 0.861s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:41:25 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-fb5e3326-3b50-4e93-a3a0-01baa65e5586 tempest-TestMinimumBasicScenario-1335437034 None] Lock "cinder-quobyte-3cc87414-83b6-411f-932a-c88d6236e18c" released by "delete_volume" :: held 1.743s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:41:25 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-fb5e3326-3b50-4e93-a3a0-01baa65e5586 tempest-TestMinimumBasicScenario-1335437034 None] Created reservations ['e5ca5e8b-321d-4e85-ac67-1f34e051a32c', 'ea6dce32-7705-4bdd-8126-cca46fc569c6', '6528d7b0-db33-47b2-9b33-2a13c748a908', 'bef7d3b6-d238-443e-a72b-3742350c1d02'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:41:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-fb5e3326-3b50-4e93-a3a0-01baa65e5586 tempest-TestMinimumBasicScenario-1335437034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:41:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-fb5e3326-3b50-4e93-a3a0-01baa65e5586 tempest-TestMinimumBasicScenario-1335437034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:41:25 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-fb5e3326-3b50-4e93-a3a0-01baa65e5586 tempest-TestMinimumBasicScenario-1335437034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:41:25 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-fb5e3326-3b50-4e93-a3a0-01baa65e5586 tempest-TestMinimumBasicScenario-1335437034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:41:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-fb5e3326-3b50-4e93-a3a0-01baa65e5586 tempest-TestMinimumBasicScenario-1335437034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:41:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-fb5e3326-3b50-4e93-a3a0-01baa65e5586 tempest-TestMinimumBasicScenario-1335437034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:41:25 devstack sudo[94972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:41:25 devstack sudo[94972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:41:26 devstack sudo[94967]: pam_unix(sudo:session): session closed for user root Jul 08 18:41:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1928bc6c-55d9-433d-990e-80321cc86f39 tempest-CreateVolumesFromImageTest-1957600402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8fbff77a-223d-4970-b924-76b2670cc80e" returned: 0 in 0.937s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:41:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1928bc6c-55d9-433d-990e-80321cc86f39 tempest-CreateVolumesFromImageTest-1957600402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8fbff77a-223d-4970-b924-76b2670cc80e {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:41:26 devstack sudo[94977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8fbff77a-223d-4970-b924-76b2670cc80e Jul 08 18:41:26 devstack sudo[94977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:41:26 devstack sudo[94972]: pam_unix(sudo:session): session closed for user root Jul 08 18:41:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-fb5e3326-3b50-4e93-a3a0-01baa65e5586 tempest-TestMinimumBasicScenario-1335437034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.836s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:41:26 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-fb5e3326-3b50-4e93-a3a0-01baa65e5586 tempest-TestMinimumBasicScenario-1335437034 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:41:26 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-fb5e3326-3b50-4e93-a3a0-01baa65e5586 tempest-TestMinimumBasicScenario-1335437034 None] Deleted volume successfully. Jul 08 18:41:26 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-fb5e3326-3b50-4e93-a3a0-01baa65e5586 tempest-TestMinimumBasicScenario-1335437034 None] Lock "cinder-3cc87414-83b6-411f-932a-c88d6236e18c-delete_volume" released by "delete_volume" :: held 2.874s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:41:26 devstack cinder-volume[86873]: INFO cinder.volume.manager [req-1d585927-f57c-436f-b6c5-f78e8a58b1a4 req-0810c63f-1c98-42c9-a599-05de93202646 tempest-AttachVolumeTestJSON-339721191 None] Terminate volume connection completed successfully. Jul 08 18:41:26 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-1d585927-f57c-436f-b6c5-f78e8a58b1a4 req-0810c63f-1c98-42c9-a599-05de93202646 tempest-AttachVolumeTestJSON-339721191 None] Deleting attachment f160e8da-f35d-48ef-b917-710e0543803d. {{(pid=86873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 18:41:26 devstack sudo[94977]: pam_unix(sudo:session): session closed for user root Jul 08 18:41:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1928bc6c-55d9-433d-990e-80321cc86f39 tempest-CreateVolumesFromImageTest-1957600402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8fbff77a-223d-4970-b924-76b2670cc80e" returned: 0 in 0.725s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:41:26 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-1928bc6c-55d9-433d-990e-80321cc86f39 tempest-CreateVolumesFromImageTest-1957600402 None] Lock "cinder-quobyte-8fbff77a-223d-4970-b924-76b2670cc80e" released by "delete_volume" :: held 1.746s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:41:27 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-1928bc6c-55d9-433d-990e-80321cc86f39 tempest-CreateVolumesFromImageTest-1957600402 None] Created reservations ['9614857e-89f7-4dfc-8045-cbee0d17677c', '04be5f0e-00a0-46c9-99c7-0adcd2fe921c', '4ffcc1c6-51d7-4590-8e09-378e5f05c2ac', 'ada8b9a7-454a-4ac6-ae86-10cf83bcf28c'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:41:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1928bc6c-55d9-433d-990e-80321cc86f39 tempest-CreateVolumesFromImageTest-1957600402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:41:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1928bc6c-55d9-433d-990e-80321cc86f39 tempest-CreateVolumesFromImageTest-1957600402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:41:27 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-1928bc6c-55d9-433d-990e-80321cc86f39 tempest-CreateVolumesFromImageTest-1957600402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:41:27 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-1928bc6c-55d9-433d-990e-80321cc86f39 tempest-CreateVolumesFromImageTest-1957600402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:41:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1928bc6c-55d9-433d-990e-80321cc86f39 tempest-CreateVolumesFromImageTest-1957600402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:41:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1928bc6c-55d9-433d-990e-80321cc86f39 tempest-CreateVolumesFromImageTest-1957600402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:41:27 devstack sudo[94983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:41:27 devstack sudo[94983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:41:27 devstack cinder-volume[86873]: INFO cinder.volume.manager [req-642982a1-7bf1-4b7a-8395-81de55b70dc5 req-cd410929-1d65-4ae2-b8b6-bd25e0b1181c tempest-AttachVolumeNegativeTest-1161175669 None] Terminate volume connection completed successfully. Jul 08 18:41:27 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-642982a1-7bf1-4b7a-8395-81de55b70dc5 req-cd410929-1d65-4ae2-b8b6-bd25e0b1181c tempest-AttachVolumeNegativeTest-1161175669 None] Deleting attachment ef5179af-562a-45ad-9d67-d7124eb63fb9. {{(pid=86873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 18:41:27 devstack sudo[94983]: pam_unix(sudo:session): session closed for user root Jul 08 18:41:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1928bc6c-55d9-433d-990e-80321cc86f39 tempest-CreateVolumesFromImageTest-1957600402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.805s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:41:27 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-1928bc6c-55d9-433d-990e-80321cc86f39 tempest-CreateVolumesFromImageTest-1957600402 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:41:27 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-1928bc6c-55d9-433d-990e-80321cc86f39 tempest-CreateVolumesFromImageTest-1957600402 None] Deleted volume successfully. Jul 08 18:41:27 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-1928bc6c-55d9-433d-990e-80321cc86f39 tempest-CreateVolumesFromImageTest-1957600402 None] Lock "cinder-8fbff77a-223d-4970-b924-76b2670cc80e-delete_volume" released by "delete_volume" :: held 2.828s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:41:32 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a435124-20ca-4ab4-92bc-ccee153c5ef5 tempest-VolumeDependencyTests-404164743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:41:32 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6a435124-20ca-4ab4-92bc-ccee153c5ef5 tempest-VolumeDependencyTests-404164743 None] Flow 'volume_create_manager' (6cfae430-abb1-4166-84ca-092a5940eba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:41:32 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6a435124-20ca-4ab4-92bc-ccee153c5ef5 tempest-VolumeDependencyTests-404164743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (084212d9-aa17-4aa6-a8d6-dc2d1e08920a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:32 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6a435124-20ca-4ab4-92bc-ccee153c5ef5 tempest-VolumeDependencyTests-404164743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (084212d9-aa17-4aa6-a8d6-dc2d1e08920a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:41:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1096576622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1301b12-9e2e-4649-9f18-387c244f00bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84277da1687e4205992cb0d036a8a993',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:41:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:41:32Z,use_quota=True,user_id='b5c8ec3e2e9a48d08810244080766040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:41:32 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6a435124-20ca-4ab4-92bc-ccee153c5ef5 tempest-VolumeDependencyTests-404164743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b54d7e69-95f3-4798-b330-057c51fa703f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:32 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6a435124-20ca-4ab4-92bc-ccee153c5ef5 tempest-VolumeDependencyTests-404164743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b54d7e69-95f3-4798-b330-057c51fa703f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:41:32 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6a435124-20ca-4ab4-92bc-ccee153c5ef5 tempest-VolumeDependencyTests-404164743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8dea82d-b0de-495d-8097-302602a05b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:32 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6a435124-20ca-4ab4-92bc-ccee153c5ef5 tempest-VolumeDependencyTests-404164743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8dea82d-b0de-495d-8097-302602a05b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1301b12-9e2e-4649-9f18-387c244f00bb', 'volume_name': 'volume-e1301b12-9e2e-4649-9f18-387c244f00bb', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:41:32 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6a435124-20ca-4ab4-92bc-ccee153c5ef5 tempest-VolumeDependencyTests-404164743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3fd6b6a-32cd-43d2-a5ff-ee380f686e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:32 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6a435124-20ca-4ab4-92bc-ccee153c5ef5 tempest-VolumeDependencyTests-404164743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3fd6b6a-32cd-43d2-a5ff-ee380f686e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:41:32 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6a435124-20ca-4ab4-92bc-ccee153c5ef5 tempest-VolumeDependencyTests-404164743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc4a0f1f-2c02-4399-90c6-e87555056b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:32 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-6a435124-20ca-4ab4-92bc-ccee153c5ef5 tempest-VolumeDependencyTests-404164743 None] Volume e1301b12-9e2e-4649-9f18-387c244f00bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1301b12-9e2e-4649-9f18-387c244f00bb', 'volume_size': 1} Jul 08 18:41:32 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6a435124-20ca-4ab4-92bc-ccee153c5ef5 tempest-VolumeDependencyTests-404164743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:41:32 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6a435124-20ca-4ab4-92bc-ccee153c5ef5 tempest-VolumeDependencyTests-404164743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:41:32 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-6a435124-20ca-4ab4-92bc-ccee153c5ef5 tempest-VolumeDependencyTests-404164743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:41:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1096576622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1301b12-9e2e-4649-9f18-387c244f00bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84277da1687e4205992cb0d036a8a993',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:41:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:41:32Z,use_quota=True,user_id='b5c8ec3e2e9a48d08810244080766040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:41:32 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-6a435124-20ca-4ab4-92bc-ccee153c5ef5 tempest-VolumeDependencyTests-404164743 None] Creating volume e1301b12-9e2e-4649-9f18-387c244f00bb {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:41:32 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6a435124-20ca-4ab4-92bc-ccee153c5ef5 tempest-VolumeDependencyTests-404164743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:41:32 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6a435124-20ca-4ab4-92bc-ccee153c5ef5 tempest-VolumeDependencyTests-404164743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:41:32 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-6a435124-20ca-4ab4-92bc-ccee153c5ef5 tempest-VolumeDependencyTests-404164743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:41:32 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-6a435124-20ca-4ab4-92bc-ccee153c5ef5 tempest-VolumeDependencyTests-404164743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:41:32 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6a435124-20ca-4ab4-92bc-ccee153c5ef5 tempest-VolumeDependencyTests-404164743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:41:32 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-6a435124-20ca-4ab4-92bc-ccee153c5ef5 tempest-VolumeDependencyTests-404164743 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:41:32 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-6a435124-20ca-4ab4-92bc-ccee153c5ef5 tempest-VolumeDependencyTests-404164743 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:41:32 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6a435124-20ca-4ab4-92bc-ccee153c5ef5 tempest-VolumeDependencyTests-404164743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1301b12-9e2e-4649-9f18-387c244f00bb 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:41:32 devstack sudo[95037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1301b12-9e2e-4649-9f18-387c244f00bb 1073741824 Jul 08 18:41:32 devstack sudo[95037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:41:33 devstack sudo[95037]: pam_unix(sudo:session): session closed for user root Jul 08 18:41:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6a435124-20ca-4ab4-92bc-ccee153c5ef5 tempest-VolumeDependencyTests-404164743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1301b12-9e2e-4649-9f18-387c244f00bb 1073741824" returned: 0 in 1.033s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:41:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6a435124-20ca-4ab4-92bc-ccee153c5ef5 tempest-VolumeDependencyTests-404164743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1301b12-9e2e-4649-9f18-387c244f00bb {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:41:33 devstack sudo[95046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1301b12-9e2e-4649-9f18-387c244f00bb Jul 08 18:41:33 devstack sudo[95046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:41:33 devstack sudo[95046]: pam_unix(sudo:session): session closed for user root Jul 08 18:41:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6a435124-20ca-4ab4-92bc-ccee153c5ef5 tempest-VolumeDependencyTests-404164743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1301b12-9e2e-4649-9f18-387c244f00bb" returned: 0 in 0.793s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:41:34 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-6a435124-20ca-4ab4-92bc-ccee153c5ef5 tempest-VolumeDependencyTests-404164743 None] <== create_volume: return (1878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:41:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6a435124-20ca-4ab4-92bc-ccee153c5ef5 tempest-VolumeDependencyTests-404164743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.883s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:41:34 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6a435124-20ca-4ab4-92bc-ccee153c5ef5 tempest-VolumeDependencyTests-404164743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc4a0f1f-2c02-4399-90c6-e87555056b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1301b12-9e2e-4649-9f18-387c244f00bb', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:41:34 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6a435124-20ca-4ab4-92bc-ccee153c5ef5 tempest-VolumeDependencyTests-404164743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ef3ba0a-d4c7-4df8-8158-8081daabf543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:34 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-6a435124-20ca-4ab4-92bc-ccee153c5ef5 tempest-VolumeDependencyTests-404164743 None] Volume volume-e1301b12-9e2e-4649-9f18-387c244f00bb (e1301b12-9e2e-4649-9f18-387c244f00bb): created successfully Jul 08 18:41:34 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6a435124-20ca-4ab4-92bc-ccee153c5ef5 tempest-VolumeDependencyTests-404164743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ef3ba0a-d4c7-4df8-8158-8081daabf543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:41:34 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6a435124-20ca-4ab4-92bc-ccee153c5ef5 tempest-VolumeDependencyTests-404164743 None] Flow 'volume_create_manager' (6cfae430-abb1-4166-84ca-092a5940eba0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:41:34 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-6a435124-20ca-4ab4-92bc-ccee153c5ef5 tempest-VolumeDependencyTests-404164743 None] Created volume successfully. Jul 08 18:41:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f2d8ae85-3477-4b0f-8c82-2fb2613a4acf tempest-VolumeDependencyTests-404164743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:41:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f2d8ae85-3477-4b0f-8c82-2fb2613a4acf tempest-VolumeDependencyTests-404164743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:41:35 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-f2d8ae85-3477-4b0f-8c82-2fb2613a4acf tempest-VolumeDependencyTests-404164743 None] Creating offline snapshot 3e4152fe-91e3-4329-8cf7-d8568a043e2f of volume e1301b12-9e2e-4649-9f18-387c244f00bb {{(pid=86873) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:41:35 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57ef617-a30b-43f8-b8ec-28696a81be14]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:41:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f2d8ae85-3477-4b0f-8c82-2fb2613a4acf tempest-VolumeDependencyTests-404164743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1301b12-9e2e-4649-9f18-387c244f00bb {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:41:35 devstack sudo[95051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1301b12-9e2e-4649-9f18-387c244f00bb Jul 08 18:41:35 devstack sudo[95051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:41:36 devstack sudo[95051]: pam_unix(sudo:session): session closed for user root Jul 08 18:41:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f2d8ae85-3477-4b0f-8c82-2fb2613a4acf tempest-VolumeDependencyTests-404164743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1301b12-9e2e-4649-9f18-387c244f00bb" returned: 0 in 0.968s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:41:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f2d8ae85-3477-4b0f-8c82-2fb2613a4acf tempest-VolumeDependencyTests-404164743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1301b12-9e2e-4649-9f18-387c244f00bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1301b12-9e2e-4649-9f18-387c244f00bb.3e4152fe-91e3-4329-8cf7-d8568a043e2f 1G {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:41:36 devstack sudo[95069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1301b12-9e2e-4649-9f18-387c244f00bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1301b12-9e2e-4649-9f18-387c244f00bb.3e4152fe-91e3-4329-8cf7-d8568a043e2f 1G Jul 08 18:41:36 devstack sudo[95069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:41:37 devstack sudo[95069]: pam_unix(sudo:session): session closed for user root Jul 08 18:41:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f2d8ae85-3477-4b0f-8c82-2fb2613a4acf tempest-VolumeDependencyTests-404164743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1301b12-9e2e-4649-9f18-387c244f00bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1301b12-9e2e-4649-9f18-387c244f00bb.3e4152fe-91e3-4329-8cf7-d8568a043e2f 1G" returned: 0 in 0.940s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:41:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f2d8ae85-3477-4b0f-8c82-2fb2613a4acf tempest-VolumeDependencyTests-404164743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1301b12-9e2e-4649-9f18-387c244f00bb -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1301b12-9e2e-4649-9f18-387c244f00bb.3e4152fe-91e3-4329-8cf7-d8568a043e2f {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:41:37 devstack sudo[95078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1301b12-9e2e-4649-9f18-387c244f00bb -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1301b12-9e2e-4649-9f18-387c244f00bb.3e4152fe-91e3-4329-8cf7-d8568a043e2f Jul 08 18:41:37 devstack sudo[95078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:41:38 devstack sudo[95078]: pam_unix(sudo:session): session closed for user root Jul 08 18:41:38 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f2d8ae85-3477-4b0f-8c82-2fb2613a4acf tempest-VolumeDependencyTests-404164743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1301b12-9e2e-4649-9f18-387c244f00bb -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1301b12-9e2e-4649-9f18-387c244f00bb.3e4152fe-91e3-4329-8cf7-d8568a043e2f" returned: 0 in 0.996s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:41:38 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-f2d8ae85-3477-4b0f-8c82-2fb2613a4acf tempest-VolumeDependencyTests-404164743 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1301b12-9e2e-4649-9f18-387c244f00bb.3e4152fe-91e3-4329-8cf7-d8568a043e2f is being set with open permissions: ugo+rw Jul 08 18:41:38 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f2d8ae85-3477-4b0f-8c82-2fb2613a4acf tempest-VolumeDependencyTests-404164743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1301b12-9e2e-4649-9f18-387c244f00bb.3e4152fe-91e3-4329-8cf7-d8568a043e2f {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:41:38 devstack sudo[95095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1301b12-9e2e-4649-9f18-387c244f00bb.3e4152fe-91e3-4329-8cf7-d8568a043e2f Jul 08 18:41:38 devstack sudo[95095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:41:38 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-db0107f4-255c-4537-b69a-a2bd89df0a7b tempest-AttachVolumeNegativeTest-1161175669 None] Acquiring lock "cinder-0b4dca61-9469-4232-bec8-c9e0bd88ebec-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:41:38 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-db0107f4-255c-4537-b69a-a2bd89df0a7b tempest-AttachVolumeNegativeTest-1161175669 None] Lock "cinder-0b4dca61-9469-4232-bec8-c9e0bd88ebec-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:41:39 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-db0107f4-255c-4537-b69a-a2bd89df0a7b tempest-AttachVolumeNegativeTest-1161175669 None] Acquiring lock "cinder-quobyte-0b4dca61-9469-4232-bec8-c9e0bd88ebec" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:41:39 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-db0107f4-255c-4537-b69a-a2bd89df0a7b tempest-AttachVolumeNegativeTest-1161175669 None] Lock "cinder-quobyte-0b4dca61-9469-4232-bec8-c9e0bd88ebec" acquired by "delete_volume" :: waited 0.020s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:41:39 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3ac59e-0cc9-49f7-bb3f-3ed65abf1ffc]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:41:39 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-db0107f4-255c-4537-b69a-a2bd89df0a7b tempest-AttachVolumeNegativeTest-1161175669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0b4dca61-9469-4232-bec8-c9e0bd88ebec {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:41:39 devstack sudo[95104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0b4dca61-9469-4232-bec8-c9e0bd88ebec Jul 08 18:41:39 devstack sudo[95104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:41:39 devstack sudo[95095]: pam_unix(sudo:session): session closed for user root Jul 08 18:41:39 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f2d8ae85-3477-4b0f-8c82-2fb2613a4acf tempest-VolumeDependencyTests-404164743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1301b12-9e2e-4649-9f18-387c244f00bb.3e4152fe-91e3-4329-8cf7-d8568a043e2f" returned: 0 in 0.907s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:41:39 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f2d8ae85-3477-4b0f-8c82-2fb2613a4acf tempest-VolumeDependencyTests-404164743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1301b12-9e2e-4649-9f18-387c244f00bb.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:41:39 devstack sudo[95116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1301b12-9e2e-4649-9f18-387c244f00bb.info Jul 08 18:41:39 devstack sudo[95116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:41:40 devstack sudo[95104]: pam_unix(sudo:session): session closed for user root Jul 08 18:41:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-db0107f4-255c-4537-b69a-a2bd89df0a7b tempest-AttachVolumeNegativeTest-1161175669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0b4dca61-9469-4232-bec8-c9e0bd88ebec" returned: 0 in 1.589s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:41:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-db0107f4-255c-4537-b69a-a2bd89df0a7b tempest-AttachVolumeNegativeTest-1161175669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0b4dca61-9469-4232-bec8-c9e0bd88ebec {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:41:40 devstack sudo[95176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0b4dca61-9469-4232-bec8-c9e0bd88ebec Jul 08 18:41:40 devstack sudo[95176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:41:40 devstack sudo[95116]: pam_unix(sudo:session): session closed for user root Jul 08 18:41:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f2d8ae85-3477-4b0f-8c82-2fb2613a4acf tempest-VolumeDependencyTests-404164743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1301b12-9e2e-4649-9f18-387c244f00bb.info" returned: 0 in 1.451s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:41:40 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-f2d8ae85-3477-4b0f-8c82-2fb2613a4acf tempest-VolumeDependencyTests-404164743 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1301b12-9e2e-4649-9f18-387c244f00bb.info is being set with open permissions: ugo+rw Jul 08 18:41:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f2d8ae85-3477-4b0f-8c82-2fb2613a4acf tempest-VolumeDependencyTests-404164743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1301b12-9e2e-4649-9f18-387c244f00bb.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:41:40 devstack sudo[95180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1301b12-9e2e-4649-9f18-387c244f00bb.info Jul 08 18:41:41 devstack sudo[95180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:41:41 devstack sudo[95176]: pam_unix(sudo:session): session closed for user root Jul 08 18:41:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-db0107f4-255c-4537-b69a-a2bd89df0a7b tempest-AttachVolumeNegativeTest-1161175669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0b4dca61-9469-4232-bec8-c9e0bd88ebec" returned: 0 in 1.047s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:41:41 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-db0107f4-255c-4537-b69a-a2bd89df0a7b tempest-AttachVolumeNegativeTest-1161175669 None] Lock "cinder-quobyte-0b4dca61-9469-4232-bec8-c9e0bd88ebec" released by "delete_volume" :: held 2.700s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:41:41 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-db0107f4-255c-4537-b69a-a2bd89df0a7b tempest-AttachVolumeNegativeTest-1161175669 None] Created reservations ['958e0ee6-fcc5-4d76-9690-11a1ffd153fd', '73650fe5-0a9e-407f-b289-a7661bdf5250', '1ec0b52e-091e-4d6a-963c-535e04a02ad2', 'c7f94c3d-0e9f-47ef-84e1-3cec849e67de'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:41:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-db0107f4-255c-4537-b69a-a2bd89df0a7b tempest-AttachVolumeNegativeTest-1161175669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:41:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-db0107f4-255c-4537-b69a-a2bd89df0a7b tempest-AttachVolumeNegativeTest-1161175669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:41:41 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-db0107f4-255c-4537-b69a-a2bd89df0a7b tempest-AttachVolumeNegativeTest-1161175669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:41:41 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-db0107f4-255c-4537-b69a-a2bd89df0a7b tempest-AttachVolumeNegativeTest-1161175669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:41:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-db0107f4-255c-4537-b69a-a2bd89df0a7b tempest-AttachVolumeNegativeTest-1161175669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:41:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-db0107f4-255c-4537-b69a-a2bd89df0a7b tempest-AttachVolumeNegativeTest-1161175669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:41:41 devstack sudo[95187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:41:41 devstack sudo[95187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:41:42 devstack sudo[95180]: pam_unix(sudo:session): session closed for user root Jul 08 18:41:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f2d8ae85-3477-4b0f-8c82-2fb2613a4acf tempest-VolumeDependencyTests-404164743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1301b12-9e2e-4649-9f18-387c244f00bb.info" returned: 0 in 1.147s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:41:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f2d8ae85-3477-4b0f-8c82-2fb2613a4acf tempest-VolumeDependencyTests-404164743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.611s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:41:42 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-f2d8ae85-3477-4b0f-8c82-2fb2613a4acf tempest-VolumeDependencyTests-404164743 None] Create snapshot completed successfully Jul 08 18:41:42 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-521d5d7f-5a9a-4d74-ba1c-d79f6e817c9f tempest-AttachVolumeNegativeTest-1161175669 None] Acquiring lock "cinder-deaf735b-3954-4ddb-88a2-7407cb3d1367-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:41:42 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-521d5d7f-5a9a-4d74-ba1c-d79f6e817c9f tempest-AttachVolumeNegativeTest-1161175669 None] Lock "cinder-deaf735b-3954-4ddb-88a2-7407cb3d1367-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:41:42 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-521d5d7f-5a9a-4d74-ba1c-d79f6e817c9f tempest-AttachVolumeNegativeTest-1161175669 None] Acquiring lock "cinder-quobyte-deaf735b-3954-4ddb-88a2-7407cb3d1367" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:41:42 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-521d5d7f-5a9a-4d74-ba1c-d79f6e817c9f tempest-AttachVolumeNegativeTest-1161175669 None] Lock "cinder-quobyte-deaf735b-3954-4ddb-88a2-7407cb3d1367" acquired by "delete_volume" :: waited 0.030s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:41:42 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c70a73b-c08b-49d1-b548-59c63c347a9e]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:41:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-521d5d7f-5a9a-4d74-ba1c-d79f6e817c9f tempest-AttachVolumeNegativeTest-1161175669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-deaf735b-3954-4ddb-88a2-7407cb3d1367 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:41:42 devstack sudo[95193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-deaf735b-3954-4ddb-88a2-7407cb3d1367 Jul 08 18:41:42 devstack sudo[95193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:41:43 devstack sudo[95187]: pam_unix(sudo:session): session closed for user root Jul 08 18:41:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-db0107f4-255c-4537-b69a-a2bd89df0a7b tempest-AttachVolumeNegativeTest-1161175669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 1.177s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:41:43 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-db0107f4-255c-4537-b69a-a2bd89df0a7b tempest-AttachVolumeNegativeTest-1161175669 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:41:43 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-db0107f4-255c-4537-b69a-a2bd89df0a7b tempest-AttachVolumeNegativeTest-1161175669 None] Deleted volume successfully. Jul 08 18:41:43 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-db0107f4-255c-4537-b69a-a2bd89df0a7b tempest-AttachVolumeNegativeTest-1161175669 None] Lock "cinder-0b4dca61-9469-4232-bec8-c9e0bd88ebec-delete_volume" released by "delete_volume" :: held 4.169s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:41:43 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-61601d9f-d19a-46b5-8275-db87194f2731 tempest-VolumeDependencyTests-404164743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:41:44 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-61601d9f-d19a-46b5-8275-db87194f2731 tempest-VolumeDependencyTests-404164743 None] Flow 'volume_create_manager' (542e7949-6d5d-47a9-8824-531e3eb5936f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:41:44 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-61601d9f-d19a-46b5-8275-db87194f2731 tempest-VolumeDependencyTests-404164743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0477bbe9-efc5-46db-b634-0dd955969cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:44 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-61601d9f-d19a-46b5-8275-db87194f2731 tempest-VolumeDependencyTests-404164743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0477bbe9-efc5-46db-b634-0dd955969cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:41:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-584621893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4e01946-bf13-4a21-9272-593dfde74311,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84277da1687e4205992cb0d036a8a993',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:41:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3e4152fe-91e3-4329-8cf7-d8568a043e2f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:41:44Z,use_quota=True,user_id='b5c8ec3e2e9a48d08810244080766040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:41:44 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-61601d9f-d19a-46b5-8275-db87194f2731 tempest-VolumeDependencyTests-404164743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (920332d4-e7bf-4d5f-90ee-d7ce08a823f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:44 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-61601d9f-d19a-46b5-8275-db87194f2731 tempest-VolumeDependencyTests-404164743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (920332d4-e7bf-4d5f-90ee-d7ce08a823f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:41:44 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-61601d9f-d19a-46b5-8275-db87194f2731 tempest-VolumeDependencyTests-404164743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a536c07-efdd-4e13-9a3e-da91dde670a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:44 devstack sudo[95193]: pam_unix(sudo:session): session closed for user root Jul 08 18:41:44 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-61601d9f-d19a-46b5-8275-db87194f2731 tempest-VolumeDependencyTests-404164743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a536c07-efdd-4e13-9a3e-da91dde670a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd4e01946-bf13-4a21-9272-593dfde74311', 'volume_name': 'volume-d4e01946-bf13-4a21-9272-593dfde74311', 'volume_size': 1, 'snapshot_id': '3e4152fe-91e3-4329-8cf7-d8568a043e2f'}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:41:44 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-61601d9f-d19a-46b5-8275-db87194f2731 tempest-VolumeDependencyTests-404164743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da64eb76-0ebe-4b5d-9f8d-836ef7a7bc89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:44 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-61601d9f-d19a-46b5-8275-db87194f2731 tempest-VolumeDependencyTests-404164743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da64eb76-0ebe-4b5d-9f8d-836ef7a7bc89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:41:44 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-61601d9f-d19a-46b5-8275-db87194f2731 tempest-VolumeDependencyTests-404164743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (435ead94-b306-49db-845e-ac9db5d04a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:44 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-61601d9f-d19a-46b5-8275-db87194f2731 tempest-VolumeDependencyTests-404164743 None] Volume d4e01946-bf13-4a21-9272-593dfde74311: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d4e01946-bf13-4a21-9272-593dfde74311', 'volume_size': 1, 'snapshot_id': '3e4152fe-91e3-4329-8cf7-d8568a043e2f'} Jul 08 18:41:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-521d5d7f-5a9a-4d74-ba1c-d79f6e817c9f tempest-AttachVolumeNegativeTest-1161175669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-deaf735b-3954-4ddb-88a2-7407cb3d1367" returned: 0 in 1.299s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:41:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-521d5d7f-5a9a-4d74-ba1c-d79f6e817c9f tempest-AttachVolumeNegativeTest-1161175669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-deaf735b-3954-4ddb-88a2-7407cb3d1367 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:41:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-61601d9f-d19a-46b5-8275-db87194f2731 tempest-VolumeDependencyTests-404164743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:41:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-61601d9f-d19a-46b5-8275-db87194f2731 tempest-VolumeDependencyTests-404164743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:41:44 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-61601d9f-d19a-46b5-8275-db87194f2731 tempest-VolumeDependencyTests-404164743 None] Acquiring lock "cinder-quobyte-3e4152fe-91e3-4329-8cf7-d8568a043e2f-d4e01946-bf13-4a21-9272-593dfde74311" by "_create_volume_from_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:41:44 devstack sudo[95198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-deaf735b-3954-4ddb-88a2-7407cb3d1367 Jul 08 18:41:44 devstack sudo[95198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:41:44 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-61601d9f-d19a-46b5-8275-db87194f2731 tempest-VolumeDependencyTests-404164743 None] Lock "cinder-quobyte-3e4152fe-91e3-4329-8cf7-d8568a043e2f-d4e01946-bf13-4a21-9272-593dfde74311" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:41:44 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-61601d9f-d19a-46b5-8275-db87194f2731 tempest-VolumeDependencyTests-404164743 None] Creating volume d4e01946-bf13-4a21-9272-593dfde74311 from snapshot 3e4152fe-91e3-4329-8cf7-d8568a043e2f {{(pid=86873) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 18:41:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-61601d9f-d19a-46b5-8275-db87194f2731 tempest-VolumeDependencyTests-404164743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:41:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-61601d9f-d19a-46b5-8275-db87194f2731 tempest-VolumeDependencyTests-404164743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:41:44 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-61601d9f-d19a-46b5-8275-db87194f2731 tempest-VolumeDependencyTests-404164743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:41:44 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-61601d9f-d19a-46b5-8275-db87194f2731 tempest-VolumeDependencyTests-404164743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:41:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-61601d9f-d19a-46b5-8275-db87194f2731 tempest-VolumeDependencyTests-404164743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:41:44 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-61601d9f-d19a-46b5-8275-db87194f2731 tempest-VolumeDependencyTests-404164743 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:41:44 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-61601d9f-d19a-46b5-8275-db87194f2731 tempest-VolumeDependencyTests-404164743 None] Acquiring lock "cinder-quobyte-d4e01946-bf13-4a21-9272-593dfde74311" by "_copy_volume_from_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:41:44 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-61601d9f-d19a-46b5-8275-db87194f2731 tempest-VolumeDependencyTests-404164743 None] Lock "cinder-quobyte-d4e01946-bf13-4a21-9272-593dfde74311" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:41:44 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-61601d9f-d19a-46b5-8275-db87194f2731 tempest-VolumeDependencyTests-404164743 None] snapshot: 3e4152fe-91e3-4329-8cf7-d8568a043e2f, volume: d4e01946-bf13-4a21-9272-593dfde74311, {{(pid=86873) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 18:41:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-61601d9f-d19a-46b5-8275-db87194f2731 tempest-VolumeDependencyTests-404164743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:41:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-61601d9f-d19a-46b5-8275-db87194f2731 tempest-VolumeDependencyTests-404164743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:41:44 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-61601d9f-d19a-46b5-8275-db87194f2731 tempest-VolumeDependencyTests-404164743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:41:44 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-61601d9f-d19a-46b5-8275-db87194f2731 tempest-VolumeDependencyTests-404164743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:41:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-61601d9f-d19a-46b5-8275-db87194f2731 tempest-VolumeDependencyTests-404164743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:41:44 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa46839b-c9c9-4461-b1f1-9fc8ca2963fc]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:41:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-61601d9f-d19a-46b5-8275-db87194f2731 tempest-VolumeDependencyTests-404164743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1301b12-9e2e-4649-9f18-387c244f00bb.3e4152fe-91e3-4329-8cf7-d8568a043e2f {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:41:44 devstack sudo[95200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1301b12-9e2e-4649-9f18-387c244f00bb.3e4152fe-91e3-4329-8cf7-d8568a043e2f Jul 08 18:41:44 devstack sudo[95200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:41:45 devstack sudo[95198]: pam_unix(sudo:session): session closed for user root Jul 08 18:41:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-521d5d7f-5a9a-4d74-ba1c-d79f6e817c9f tempest-AttachVolumeNegativeTest-1161175669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-deaf735b-3954-4ddb-88a2-7407cb3d1367" returned: 0 in 1.082s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:41:45 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-521d5d7f-5a9a-4d74-ba1c-d79f6e817c9f tempest-AttachVolumeNegativeTest-1161175669 None] Lock "cinder-quobyte-deaf735b-3954-4ddb-88a2-7407cb3d1367" released by "delete_volume" :: held 2.464s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:41:45 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-521d5d7f-5a9a-4d74-ba1c-d79f6e817c9f tempest-AttachVolumeNegativeTest-1161175669 None] Created reservations ['6ac21b23-4a1a-413c-ba85-d87121669747', 'df9981c8-47bc-44b7-86a4-60b0db056bee', 'd5680598-d1ad-4f7f-9ca8-7330a66a0584', '8bd725f9-d515-4e19-a15a-48059c7843db'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:41:45 devstack sudo[95200]: pam_unix(sudo:session): session closed for user root Jul 08 18:41:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-61601d9f-d19a-46b5-8275-db87194f2731 tempest-VolumeDependencyTests-404164743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1301b12-9e2e-4649-9f18-387c244f00bb.3e4152fe-91e3-4329-8cf7-d8568a043e2f" returned: 0 in 1.013s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:41:45 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-61601d9f-d19a-46b5-8275-db87194f2731 tempest-VolumeDependencyTests-404164743 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1301b12-9e2e-4649-9f18-387c244f00bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:41:45 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-61601d9f-d19a-46b5-8275-db87194f2731 tempest-VolumeDependencyTests-404164743 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1301b12-9e2e-4649-9f18-387c244f00bb {{(pid=86873) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 18:41:45 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-61601d9f-d19a-46b5-8275-db87194f2731 tempest-VolumeDependencyTests-404164743 None] Creating direct copy from snapshot {{(pid=86873) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 18:41:45 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f7982e-f2f8-4956-ae05-3a4de107b3bd]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:41:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-61601d9f-d19a-46b5-8275-db87194f2731 tempest-VolumeDependencyTests-404164743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1301b12-9e2e-4649-9f18-387c244f00bb {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:41:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-521d5d7f-5a9a-4d74-ba1c-d79f6e817c9f tempest-AttachVolumeNegativeTest-1161175669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:41:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-521d5d7f-5a9a-4d74-ba1c-d79f6e817c9f tempest-AttachVolumeNegativeTest-1161175669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:41:45 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-521d5d7f-5a9a-4d74-ba1c-d79f6e817c9f tempest-AttachVolumeNegativeTest-1161175669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:41:45 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-521d5d7f-5a9a-4d74-ba1c-d79f6e817c9f tempest-AttachVolumeNegativeTest-1161175669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:41:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-521d5d7f-5a9a-4d74-ba1c-d79f6e817c9f tempest-AttachVolumeNegativeTest-1161175669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:41:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-521d5d7f-5a9a-4d74-ba1c-d79f6e817c9f tempest-AttachVolumeNegativeTest-1161175669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:41:45 devstack sudo[95207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:41:45 devstack sudo[95207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:41:45 devstack sudo[95206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1301b12-9e2e-4649-9f18-387c244f00bb Jul 08 18:41:45 devstack sudo[95206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:41:46 devstack sudo[95207]: pam_unix(sudo:session): session closed for user root Jul 08 18:41:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-521d5d7f-5a9a-4d74-ba1c-d79f6e817c9f tempest-AttachVolumeNegativeTest-1161175669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.848s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:41:46 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-521d5d7f-5a9a-4d74-ba1c-d79f6e817c9f tempest-AttachVolumeNegativeTest-1161175669 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:41:46 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-521d5d7f-5a9a-4d74-ba1c-d79f6e817c9f tempest-AttachVolumeNegativeTest-1161175669 None] Deleted volume successfully. Jul 08 18:41:46 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-521d5d7f-5a9a-4d74-ba1c-d79f6e817c9f tempest-AttachVolumeNegativeTest-1161175669 None] Lock "cinder-deaf735b-3954-4ddb-88a2-7407cb3d1367-delete_volume" released by "delete_volume" :: held 3.614s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:41:46 devstack sudo[95206]: pam_unix(sudo:session): session closed for user root Jul 08 18:41:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-61601d9f-d19a-46b5-8275-db87194f2731 tempest-VolumeDependencyTests-404164743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1301b12-9e2e-4649-9f18-387c244f00bb" returned: 0 in 1.137s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:41:46 devstack cinder-volume[86873]: DEBUG cinder.utils [None req-61601d9f-d19a-46b5-8275-db87194f2731 tempest-VolumeDependencyTests-404164743 None] Path /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4e01946-bf13-4a21-9272-593dfde74311 not found in is_blk_device check {{(pid=86873) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 18:41:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-61601d9f-d19a-46b5-8275-db87194f2731 tempest-VolumeDependencyTests-404164743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1301b12-9e2e-4649-9f18-387c244f00bb /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4e01946-bf13-4a21-9272-593dfde74311 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:41:46 devstack sudo[95216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1301b12-9e2e-4649-9f18-387c244f00bb /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4e01946-bf13-4a21-9272-593dfde74311 Jul 08 18:41:46 devstack sudo[95216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:41:46 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-3a500cb0-e608-47d6-8221-421d94877a35 tempest-AttachVolumeNegativeTest-1161175669 None] Acquiring lock "cinder-2e7d819f-f030-4ae1-87e0-2be22e91a9a4-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:41:46 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-3a500cb0-e608-47d6-8221-421d94877a35 tempest-AttachVolumeNegativeTest-1161175669 None] Lock "cinder-2e7d819f-f030-4ae1-87e0-2be22e91a9a4-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:41:46 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-3a500cb0-e608-47d6-8221-421d94877a35 tempest-AttachVolumeNegativeTest-1161175669 None] Acquiring lock "cinder-quobyte-2e7d819f-f030-4ae1-87e0-2be22e91a9a4" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:41:46 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-3a500cb0-e608-47d6-8221-421d94877a35 tempest-AttachVolumeNegativeTest-1161175669 None] Lock "cinder-quobyte-2e7d819f-f030-4ae1-87e0-2be22e91a9a4" acquired by "delete_volume" :: waited 0.032s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:41:46 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[862166ec-70f9-46a5-96aa-9e670dd4223e]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:41:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3a500cb0-e608-47d6-8221-421d94877a35 tempest-AttachVolumeNegativeTest-1161175669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2e7d819f-f030-4ae1-87e0-2be22e91a9a4 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:41:46 devstack sudo[95218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2e7d819f-f030-4ae1-87e0-2be22e91a9a4 Jul 08 18:41:46 devstack sudo[95218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:41:48 devstack cinder-volume[86873]: DEBUG oslo_service.periodic_task [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86873) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:41:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:41:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:41:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:41:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:41:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:41:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:41:48 devstack sudo[95233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:41:48 devstack sudo[95233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:41:48 devstack sudo[95218]: pam_unix(sudo:session): session closed for user root Jul 08 18:41:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3a500cb0-e608-47d6-8221-421d94877a35 tempest-AttachVolumeNegativeTest-1161175669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2e7d819f-f030-4ae1-87e0-2be22e91a9a4" returned: 0 in 1.707s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:41:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3a500cb0-e608-47d6-8221-421d94877a35 tempest-AttachVolumeNegativeTest-1161175669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2e7d819f-f030-4ae1-87e0-2be22e91a9a4 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:41:48 devstack sudo[95236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2e7d819f-f030-4ae1-87e0-2be22e91a9a4 Jul 08 18:41:48 devstack sudo[95236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:41:51 devstack sudo[95233]: pam_unix(sudo:session): session closed for user root Jul 08 18:41:51 devstack sudo[95236]: pam_unix(sudo:session): session closed for user root Jul 08 18:41:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3a500cb0-e608-47d6-8221-421d94877a35 tempest-AttachVolumeNegativeTest-1161175669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2e7d819f-f030-4ae1-87e0-2be22e91a9a4" returned: 0 in 2.583s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:41:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 2.806s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:41:51 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:41:51 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-3a500cb0-e608-47d6-8221-421d94877a35 tempest-AttachVolumeNegativeTest-1161175669 None] Lock "cinder-quobyte-2e7d819f-f030-4ae1-87e0-2be22e91a9a4" released by "delete_volume" :: held 4.405s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:41:51 devstack cinder-volume[86873]: DEBUG oslo_service.periodic_task [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running periodic task VolumeManager._thread_info {{(pid=86873) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:41:51 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] thread count: 29 {{(pid=86873) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:41:51 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] thread info: [<_MainThread(MainThread, started 138577734545536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86873) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:41:51 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:UPDATE=102,cinder:SELECT=81,cinder:INSERT=28,cinder:DELETE=7 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:41:51 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-3a500cb0-e608-47d6-8221-421d94877a35 tempest-AttachVolumeNegativeTest-1161175669 None] Created reservations ['571ad2a1-54fe-4b08-91fa-f7833a6088f7', '91176878-36ea-4f2f-b205-ce9d121f7122', 'ea7d5bf8-8f8e-4728-a137-f1dfc21987e0', '3d52df7d-8b7e-47a0-950a-432f42135a50'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:41:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3a500cb0-e608-47d6-8221-421d94877a35 tempest-AttachVolumeNegativeTest-1161175669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:41:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3a500cb0-e608-47d6-8221-421d94877a35 tempest-AttachVolumeNegativeTest-1161175669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:41:51 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-3a500cb0-e608-47d6-8221-421d94877a35 tempest-AttachVolumeNegativeTest-1161175669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:41:51 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-3a500cb0-e608-47d6-8221-421d94877a35 tempest-AttachVolumeNegativeTest-1161175669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:41:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3a500cb0-e608-47d6-8221-421d94877a35 tempest-AttachVolumeNegativeTest-1161175669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:41:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3a500cb0-e608-47d6-8221-421d94877a35 tempest-AttachVolumeNegativeTest-1161175669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:41:51 devstack sudo[95240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:41:51 devstack sudo[95240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:41:53 devstack sudo[95240]: pam_unix(sudo:session): session closed for user root Jul 08 18:41:53 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3a500cb0-e608-47d6-8221-421d94877a35 tempest-AttachVolumeNegativeTest-1161175669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 2.372s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:41:53 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-3a500cb0-e608-47d6-8221-421d94877a35 tempest-AttachVolumeNegativeTest-1161175669 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:41:53 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-3a500cb0-e608-47d6-8221-421d94877a35 tempest-AttachVolumeNegativeTest-1161175669 None] Deleted volume successfully. Jul 08 18:41:54 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-3a500cb0-e608-47d6-8221-421d94877a35 tempest-AttachVolumeNegativeTest-1161175669 None] Lock "cinder-2e7d819f-f030-4ae1-87e0-2be22e91a9a4-delete_volume" released by "delete_volume" :: held 7.455s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:41:54 devstack sudo[95216]: pam_unix(sudo:session): session closed for user root Jul 08 18:41:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-61601d9f-d19a-46b5-8275-db87194f2731 tempest-VolumeDependencyTests-404164743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1301b12-9e2e-4649-9f18-387c244f00bb /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4e01946-bf13-4a21-9272-593dfde74311" returned: 0 in 8.264s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:41:54 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3b82b4-32a1-40b2-9a35-be46ff340149]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:41:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-61601d9f-d19a-46b5-8275-db87194f2731 tempest-VolumeDependencyTests-404164743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1301b12-9e2e-4649-9f18-387c244f00bb {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:41:54 devstack sudo[95259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1301b12-9e2e-4649-9f18-387c244f00bb Jul 08 18:41:54 devstack sudo[95259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:41:55 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-374c59e6-2e73-43f0-bd22-8933fa9cabec tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:41:55 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-374c59e6-2e73-43f0-bd22-8933fa9cabec tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Flow 'volume_create_manager' (e7b621d7-8bf7-4711-b004-fff4f6adde5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:41:55 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-374c59e6-2e73-43f0-bd22-8933fa9cabec tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b19aad16-6e61-43e9-99f6-a34102b56cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:55 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-374c59e6-2e73-43f0-bd22-8933fa9cabec tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b19aad16-6e61-43e9-99f6-a34102b56cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1417307284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=644032e8-e91e-453a-ba03-3db70d5fa6ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fa97f0e34454d728a0c28e9ecb2491a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:41:55Z,use_quota=True,user_id='8e5c168ab53e460cb74b72445fc6f2c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:41:55 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-374c59e6-2e73-43f0-bd22-8933fa9cabec tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf08bf7a-e574-44ad-a01d-19db2defc23d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:55 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-374c59e6-2e73-43f0-bd22-8933fa9cabec tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf08bf7a-e574-44ad-a01d-19db2defc23d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:41:55 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-374c59e6-2e73-43f0-bd22-8933fa9cabec tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d103f70e-6f4b-420f-96f9-2e0709a6f888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:55 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-374c59e6-2e73-43f0-bd22-8933fa9cabec tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d103f70e-6f4b-420f-96f9-2e0709a6f888) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '644032e8-e91e-453a-ba03-3db70d5fa6ae', 'volume_name': 'volume-644032e8-e91e-453a-ba03-3db70d5fa6ae', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:41:55 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-374c59e6-2e73-43f0-bd22-8933fa9cabec tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9928ada8-1c67-4696-a4f7-00ef871c6066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:55 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-374c59e6-2e73-43f0-bd22-8933fa9cabec tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9928ada8-1c67-4696-a4f7-00ef871c6066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:41:55 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-374c59e6-2e73-43f0-bd22-8933fa9cabec tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (684d5477-8179-438d-9653-f14ddadb368b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:55 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-374c59e6-2e73-43f0-bd22-8933fa9cabec tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Volume 644032e8-e91e-453a-ba03-3db70d5fa6ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-644032e8-e91e-453a-ba03-3db70d5fa6ae', 'volume_size': 1} Jul 08 18:41:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-374c59e6-2e73-43f0-bd22-8933fa9cabec tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:41:55 devstack sudo[95259]: pam_unix(sudo:session): session closed for user root Jul 08 18:41:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-61601d9f-d19a-46b5-8275-db87194f2731 tempest-VolumeDependencyTests-404164743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1301b12-9e2e-4649-9f18-387c244f00bb" returned: 0 in 1.062s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:41:55 devstack cinder-volume[86873]: DEBUG cinder.image.image_utils [None req-61601d9f-d19a-46b5-8275-db87194f2731 tempest-VolumeDependencyTests-404164743 None] Image conversion details: src /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1301b12-9e2e-4649-9f18-387c244f00bb, size 1024.00 MB, duration 8.26 sec, destination /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4e01946-bf13-4a21-9272-593dfde74311 {{(pid=86873) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:41:55 devstack cinder-volume[86873]: INFO cinder.image.image_utils [None req-61601d9f-d19a-46b5-8275-db87194f2731 tempest-VolumeDependencyTests-404164743 None] Converted 1024.00 MB image at 123.90 MB/s Jul 08 18:41:55 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-61601d9f-d19a-46b5-8275-db87194f2731 tempest-VolumeDependencyTests-404164743 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4e01946-bf13-4a21-9272-593dfde74311 is being set with open permissions: ugo+rw Jul 08 18:41:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-61601d9f-d19a-46b5-8275-db87194f2731 tempest-VolumeDependencyTests-404164743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4e01946-bf13-4a21-9272-593dfde74311 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:41:55 devstack sudo[95268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4e01946-bf13-4a21-9272-593dfde74311 Jul 08 18:41:55 devstack sudo[95268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:41:56 devstack sudo[95268]: pam_unix(sudo:session): session closed for user root Jul 08 18:41:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-61601d9f-d19a-46b5-8275-db87194f2731 tempest-VolumeDependencyTests-404164743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4e01946-bf13-4a21-9272-593dfde74311" returned: 0 in 0.763s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:41:56 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-61601d9f-d19a-46b5-8275-db87194f2731 tempest-VolumeDependencyTests-404164743 None] Lock "cinder-quobyte-d4e01946-bf13-4a21-9272-593dfde74311" released by "_copy_volume_from_snapshot" :: held 12.404s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:41:56 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-61601d9f-d19a-46b5-8275-db87194f2731 tempest-VolumeDependencyTests-404164743 None] Lock "cinder-quobyte-3e4152fe-91e3-4329-8cf7-d8568a043e2f-d4e01946-bf13-4a21-9272-593dfde74311" released by "_create_volume_from_snapshot" :: held 12.462s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:41:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-61601d9f-d19a-46b5-8275-db87194f2731 tempest-VolumeDependencyTests-404164743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.485s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:41:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-374c59e6-2e73-43f0-bd22-8933fa9cabec tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.166s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:41:56 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-374c59e6-2e73-43f0-bd22-8933fa9cabec tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1417307284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=644032e8-e91e-453a-ba03-3db70d5fa6ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fa97f0e34454d728a0c28e9ecb2491a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:41:55Z,use_quota=True,user_id='8e5c168ab53e460cb74b72445fc6f2c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:41:56 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-374c59e6-2e73-43f0-bd22-8933fa9cabec tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Creating volume 644032e8-e91e-453a-ba03-3db70d5fa6ae {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:41:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-374c59e6-2e73-43f0-bd22-8933fa9cabec tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:41:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-374c59e6-2e73-43f0-bd22-8933fa9cabec tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:41:56 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-374c59e6-2e73-43f0-bd22-8933fa9cabec tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:41:56 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-374c59e6-2e73-43f0-bd22-8933fa9cabec tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:41:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-374c59e6-2e73-43f0-bd22-8933fa9cabec tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:41:56 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-374c59e6-2e73-43f0-bd22-8933fa9cabec tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:41:56 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-374c59e6-2e73-43f0-bd22-8933fa9cabec tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:41:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-374c59e6-2e73-43f0-bd22-8933fa9cabec tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-644032e8-e91e-453a-ba03-3db70d5fa6ae 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:41:56 devstack sudo[95272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-644032e8-e91e-453a-ba03-3db70d5fa6ae 1073741824 Jul 08 18:41:56 devstack sudo[95272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:41:56 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-61601d9f-d19a-46b5-8275-db87194f2731 tempest-VolumeDependencyTests-404164743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (435ead94-b306-49db-845e-ac9db5d04a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4e01946-bf13-4a21-9272-593dfde74311', 'volume_size': 1, 'snapshot_id': '3e4152fe-91e3-4329-8cf7-d8568a043e2f'}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:41:56 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-61601d9f-d19a-46b5-8275-db87194f2731 tempest-VolumeDependencyTests-404164743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33d9fc0c-b7b3-4c0a-8f18-187e9d82ff8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:56 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-61601d9f-d19a-46b5-8275-db87194f2731 tempest-VolumeDependencyTests-404164743 None] Volume volume-d4e01946-bf13-4a21-9272-593dfde74311 (d4e01946-bf13-4a21-9272-593dfde74311): created successfully Jul 08 18:41:56 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-61601d9f-d19a-46b5-8275-db87194f2731 tempest-VolumeDependencyTests-404164743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33d9fc0c-b7b3-4c0a-8f18-187e9d82ff8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:41:56 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-61601d9f-d19a-46b5-8275-db87194f2731 tempest-VolumeDependencyTests-404164743 None] Flow 'volume_create_manager' (542e7949-6d5d-47a9-8824-531e3eb5936f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:41:56 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-61601d9f-d19a-46b5-8275-db87194f2731 tempest-VolumeDependencyTests-404164743 None] Created volume successfully. Jul 08 18:41:57 devstack sudo[95272]: pam_unix(sudo:session): session closed for user root Jul 08 18:41:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-374c59e6-2e73-43f0-bd22-8933fa9cabec tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-644032e8-e91e-453a-ba03-3db70d5fa6ae 1073741824" returned: 0 in 0.839s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:41:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-374c59e6-2e73-43f0-bd22-8933fa9cabec tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-644032e8-e91e-453a-ba03-3db70d5fa6ae {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:41:57 devstack sudo[95278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-644032e8-e91e-453a-ba03-3db70d5fa6ae Jul 08 18:41:57 devstack sudo[95278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:41:57 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-5c4c284d-b1f9-424e-acaa-6362462fcedd tempest-VolumeDependencyTests-404164743 None] Acquiring lock "cinder-3e4152fe-91e3-4329-8cf7-d8568a043e2f-delete_snapshot" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:41:57 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-5c4c284d-b1f9-424e-acaa-6362462fcedd tempest-VolumeDependencyTests-404164743 None] Lock "cinder-3e4152fe-91e3-4329-8cf7-d8568a043e2f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:41:57 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-5c4c284d-b1f9-424e-acaa-6362462fcedd tempest-VolumeDependencyTests-404164743 None] Acquiring lock "cinder-quobyte-e1301b12-9e2e-4649-9f18-387c244f00bb" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:41:57 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-5c4c284d-b1f9-424e-acaa-6362462fcedd tempest-VolumeDependencyTests-404164743 None] Lock "cinder-quobyte-e1301b12-9e2e-4649-9f18-387c244f00bb" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:41:57 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-5c4c284d-b1f9-424e-acaa-6362462fcedd tempest-VolumeDependencyTests-404164743 None] Acquiring lock "cinder-quobyte-3e4152fe-91e3-4329-8cf7-d8568a043e2f" by "_delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:41:57 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-5c4c284d-b1f9-424e-acaa-6362462fcedd tempest-VolumeDependencyTests-404164743 None] Lock "cinder-quobyte-3e4152fe-91e3-4329-8cf7-d8568a043e2f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:41:57 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-5c4c284d-b1f9-424e-acaa-6362462fcedd tempest-VolumeDependencyTests-404164743 None] Deleting offline snapshot 3e4152fe-91e3-4329-8cf7-d8568a043e2f of volume e1301b12-9e2e-4649-9f18-387c244f00bb {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:41:57 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-5c4c284d-b1f9-424e-acaa-6362462fcedd tempest-VolumeDependencyTests-404164743 None] snapshot_file for this snap is: volume-e1301b12-9e2e-4649-9f18-387c244f00bb.3e4152fe-91e3-4329-8cf7-d8568a043e2f {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:41:57 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb991844-0f87-4123-bb3d-c1276c5e3ebe]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:41:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5c4c284d-b1f9-424e-acaa-6362462fcedd tempest-VolumeDependencyTests-404164743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1301b12-9e2e-4649-9f18-387c244f00bb.3e4152fe-91e3-4329-8cf7-d8568a043e2f {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:41:58 devstack sudo[95280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1301b12-9e2e-4649-9f18-387c244f00bb.3e4152fe-91e3-4329-8cf7-d8568a043e2f Jul 08 18:41:58 devstack sudo[95280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:41:58 devstack sudo[95278]: pam_unix(sudo:session): session closed for user root Jul 08 18:41:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-374c59e6-2e73-43f0-bd22-8933fa9cabec tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-644032e8-e91e-453a-ba03-3db70d5fa6ae" returned: 0 in 0.794s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:41:58 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-374c59e6-2e73-43f0-bd22-8933fa9cabec tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] <== create_volume: return (1673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:41:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-374c59e6-2e73-43f0-bd22-8933fa9cabec tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.675s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:41:58 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-374c59e6-2e73-43f0-bd22-8933fa9cabec tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (684d5477-8179-438d-9653-f14ddadb368b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-644032e8-e91e-453a-ba03-3db70d5fa6ae', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:41:58 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-374c59e6-2e73-43f0-bd22-8933fa9cabec tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15bfe024-3489-46db-bee8-fada3262f84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:58 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-374c59e6-2e73-43f0-bd22-8933fa9cabec tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Volume volume-644032e8-e91e-453a-ba03-3db70d5fa6ae (644032e8-e91e-453a-ba03-3db70d5fa6ae): created successfully Jul 08 18:41:58 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-374c59e6-2e73-43f0-bd22-8933fa9cabec tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15bfe024-3489-46db-bee8-fada3262f84e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:41:58 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-374c59e6-2e73-43f0-bd22-8933fa9cabec tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Flow 'volume_create_manager' (e7b621d7-8bf7-4711-b004-fff4f6adde5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:41:58 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-374c59e6-2e73-43f0-bd22-8933fa9cabec tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Created volume successfully. Jul 08 18:41:58 devstack sudo[95280]: pam_unix(sudo:session): session closed for user root Jul 08 18:41:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5c4c284d-b1f9-424e-acaa-6362462fcedd tempest-VolumeDependencyTests-404164743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1301b12-9e2e-4649-9f18-387c244f00bb.3e4152fe-91e3-4329-8cf7-d8568a043e2f" returned: 0 in 1.035s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:41:58 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-5c4c284d-b1f9-424e-acaa-6362462fcedd tempest-VolumeDependencyTests-404164743 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1301b12-9e2e-4649-9f18-387c244f00bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:41:59 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf161fc-39f4-4e98-abc5-32cb46667d50]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:41:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5c4c284d-b1f9-424e-acaa-6362462fcedd tempest-VolumeDependencyTests-404164743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1301b12-9e2e-4649-9f18-387c244f00bb {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:41:59 devstack sudo[95322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1301b12-9e2e-4649-9f18-387c244f00bb Jul 08 18:41:59 devstack sudo[95322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:41:59 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5f56868-751c-4059-a916-154ea83fdd25 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:41:59 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e5f56868-751c-4059-a916-154ea83fdd25 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Flow 'volume_create_manager' (693eaff6-4fd9-4f7e-8767-e41b98ea62a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:41:59 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e5f56868-751c-4059-a916-154ea83fdd25 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52cccf39-a609-4652-bc6b-a41ccaced674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:59 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e5f56868-751c-4059-a916-154ea83fdd25 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52cccf39-a609-4652-bc6b-a41ccaced674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:41:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-653282786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd116989-243b-4852-b44b-43f98c364453,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fa97f0e34454d728a0c28e9ecb2491a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:41:59Z,use_quota=True,user_id='8e5c168ab53e460cb74b72445fc6f2c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:41:59 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e5f56868-751c-4059-a916-154ea83fdd25 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bf8909b-76bf-4fab-a3d4-238f1b368e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:59 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e5f56868-751c-4059-a916-154ea83fdd25 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bf8909b-76bf-4fab-a3d4-238f1b368e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:41:59 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e5f56868-751c-4059-a916-154ea83fdd25 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fff3f4e2-c32e-4ae3-b91d-d6b706b37f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:59 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e5f56868-751c-4059-a916-154ea83fdd25 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fff3f4e2-c32e-4ae3-b91d-d6b706b37f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd116989-243b-4852-b44b-43f98c364453', 'volume_name': 'volume-fd116989-243b-4852-b44b-43f98c364453', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:41:59 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e5f56868-751c-4059-a916-154ea83fdd25 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c964505e-99cd-4943-827a-1ce85286518e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:59 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e5f56868-751c-4059-a916-154ea83fdd25 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c964505e-99cd-4943-827a-1ce85286518e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:41:59 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e5f56868-751c-4059-a916-154ea83fdd25 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e6f4423-3a3f-477e-a190-5566e1aa48aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:59 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-e5f56868-751c-4059-a916-154ea83fdd25 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Volume fd116989-243b-4852-b44b-43f98c364453: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd116989-243b-4852-b44b-43f98c364453', 'volume_size': 1} Jul 08 18:41:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-e5f56868-751c-4059-a916-154ea83fdd25 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:41:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-e5f56868-751c-4059-a916-154ea83fdd25 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:41:59 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-e5f56868-751c-4059-a916-154ea83fdd25 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:41:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-653282786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd116989-243b-4852-b44b-43f98c364453,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fa97f0e34454d728a0c28e9ecb2491a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:41:59Z,use_quota=True,user_id='8e5c168ab53e460cb74b72445fc6f2c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:41:59 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-e5f56868-751c-4059-a916-154ea83fdd25 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Creating volume fd116989-243b-4852-b44b-43f98c364453 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:41:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-e5f56868-751c-4059-a916-154ea83fdd25 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:41:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-e5f56868-751c-4059-a916-154ea83fdd25 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:41:59 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-e5f56868-751c-4059-a916-154ea83fdd25 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:41:59 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-e5f56868-751c-4059-a916-154ea83fdd25 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:41:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-e5f56868-751c-4059-a916-154ea83fdd25 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:41:59 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-e5f56868-751c-4059-a916-154ea83fdd25 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:41:59 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-e5f56868-751c-4059-a916-154ea83fdd25 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:41:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e5f56868-751c-4059-a916-154ea83fdd25 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-fd116989-243b-4852-b44b-43f98c364453 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:41:59 devstack sudo[95325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-fd116989-243b-4852-b44b-43f98c364453 1073741824 Jul 08 18:41:59 devstack sudo[95325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:41:59 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed232b5f-870b-467a-8ea2-b1a8a30966ae tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:41:59 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ed232b5f-870b-467a-8ea2-b1a8a30966ae tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Flow 'volume_create_manager' (19e9af94-1ace-4c90-a090-380589651e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:41:59 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ed232b5f-870b-467a-8ea2-b1a8a30966ae tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1b78b71-ba57-4edb-a977-d2af39f44f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:59 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ed232b5f-870b-467a-8ea2-b1a8a30966ae tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1b78b71-ba57-4edb-a977-d2af39f44f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:41:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-824739110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc46e021-2951-4087-87fe-3d632b0ced48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fa97f0e34454d728a0c28e9ecb2491a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:42:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:42:00Z,use_quota=True,user_id='8e5c168ab53e460cb74b72445fc6f2c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:41:59 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ed232b5f-870b-467a-8ea2-b1a8a30966ae tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9227c20-ee44-4f6f-abdc-42144dc02511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:59 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ed232b5f-870b-467a-8ea2-b1a8a30966ae tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9227c20-ee44-4f6f-abdc-42144dc02511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:41:59 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ed232b5f-870b-467a-8ea2-b1a8a30966ae tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (774aff3e-3723-40d9-a8bd-53449e056b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:59 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ed232b5f-870b-467a-8ea2-b1a8a30966ae tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (774aff3e-3723-40d9-a8bd-53449e056b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc46e021-2951-4087-87fe-3d632b0ced48', 'volume_name': 'volume-bc46e021-2951-4087-87fe-3d632b0ced48', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:41:59 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ed232b5f-870b-467a-8ea2-b1a8a30966ae tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f7da823-aa29-49e9-ab11-ca244f6c35a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:59 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ed232b5f-870b-467a-8ea2-b1a8a30966ae tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f7da823-aa29-49e9-ab11-ca244f6c35a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:41:59 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ed232b5f-870b-467a-8ea2-b1a8a30966ae tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18b59b46-5e70-440a-b78c-cb7734752afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:41:59 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-ed232b5f-870b-467a-8ea2-b1a8a30966ae tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Volume bc46e021-2951-4087-87fe-3d632b0ced48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc46e021-2951-4087-87fe-3d632b0ced48', 'volume_size': 1} Jul 08 18:41:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-ed232b5f-870b-467a-8ea2-b1a8a30966ae tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:42:00 devstack sudo[95322]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5c4c284d-b1f9-424e-acaa-6362462fcedd tempest-VolumeDependencyTests-404164743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1301b12-9e2e-4649-9f18-387c244f00bb" returned: 0 in 1.099s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5c4c284d-b1f9-424e-acaa-6362462fcedd tempest-VolumeDependencyTests-404164743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1301b12-9e2e-4649-9f18-387c244f00bb.3e4152fe-91e3-4329-8cf7-d8568a043e2f {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:00 devstack sudo[95331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1301b12-9e2e-4649-9f18-387c244f00bb.3e4152fe-91e3-4329-8cf7-d8568a043e2f Jul 08 18:42:00 devstack sudo[95331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:00 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-65573189-d199-40d9-92c3-bf890a5b72ad tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:42:00 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-65573189-d199-40d9-92c3-bf890a5b72ad tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Flow 'volume_create_manager' (e46b3890-0fd0-4f92-a378-1d21fe07cc5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:42:00 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-65573189-d199-40d9-92c3-bf890a5b72ad tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4257fe99-417a-43b8-9888-1ba0ce22bdad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:00 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-65573189-d199-40d9-92c3-bf890a5b72ad tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4257fe99-417a-43b8-9888-1ba0ce22bdad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:42:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1532792747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10cdd6f0-aaea-4bdd-a3cf-b8aeb0adb73c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fa97f0e34454d728a0c28e9ecb2491a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:42:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:42:00Z,use_quota=True,user_id='8e5c168ab53e460cb74b72445fc6f2c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:00 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-65573189-d199-40d9-92c3-bf890a5b72ad tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37ffddc2-3ab5-4de5-aa3f-083f53f4ebce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:00 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-65573189-d199-40d9-92c3-bf890a5b72ad tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37ffddc2-3ab5-4de5-aa3f-083f53f4ebce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:00 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-65573189-d199-40d9-92c3-bf890a5b72ad tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32af88f1-bcf8-4bd7-9e4a-73c98595350a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:00 devstack sudo[95325]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:00 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-65573189-d199-40d9-92c3-bf890a5b72ad tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32af88f1-bcf8-4bd7-9e4a-73c98595350a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10cdd6f0-aaea-4bdd-a3cf-b8aeb0adb73c', 'volume_name': 'volume-10cdd6f0-aaea-4bdd-a3cf-b8aeb0adb73c', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:00 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-65573189-d199-40d9-92c3-bf890a5b72ad tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af8b2ac9-c0f0-4a03-9607-cf3868dc1b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:00 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-65573189-d199-40d9-92c3-bf890a5b72ad tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af8b2ac9-c0f0-4a03-9607-cf3868dc1b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:00 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-65573189-d199-40d9-92c3-bf890a5b72ad tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (619c9c18-aabc-4c6a-b2e0-e1f6d28ae7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:00 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-65573189-d199-40d9-92c3-bf890a5b72ad tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Volume 10cdd6f0-aaea-4bdd-a3cf-b8aeb0adb73c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10cdd6f0-aaea-4bdd-a3cf-b8aeb0adb73c', 'volume_size': 1} Jul 08 18:42:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-65573189-d199-40d9-92c3-bf890a5b72ad tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:42:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e5f56868-751c-4059-a916-154ea83fdd25 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-fd116989-243b-4852-b44b-43f98c364453 1073741824" returned: 0 in 1.515s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e5f56868-751c-4059-a916-154ea83fdd25 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-fd116989-243b-4852-b44b-43f98c364453 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:01 devstack sudo[95337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-fd116989-243b-4852-b44b-43f98c364453 Jul 08 18:42:01 devstack sudo[95337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:01 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f323b79-106b-4ffd-9a0d-6543e9583bcf tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:42:01 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3f323b79-106b-4ffd-9a0d-6543e9583bcf tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Flow 'volume_create_manager' (b2e0e751-eca1-4065-8286-ac0557707428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:42:01 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3f323b79-106b-4ffd-9a0d-6543e9583bcf tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d46d1a6-562c-45f0-bf46-ec3a514cf2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:01 devstack sudo[95331]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:01 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3f323b79-106b-4ffd-9a0d-6543e9583bcf tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d46d1a6-562c-45f0-bf46-ec3a514cf2ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1520462288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18a4554a-172d-4e8a-b7fe-dc4bb9bf9230,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fa97f0e34454d728a0c28e9ecb2491a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:42:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:42:01Z,use_quota=True,user_id='8e5c168ab53e460cb74b72445fc6f2c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:01 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3f323b79-106b-4ffd-9a0d-6543e9583bcf tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (200f1f05-7dc4-411c-b015-8235ba3d3269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:01 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3f323b79-106b-4ffd-9a0d-6543e9583bcf tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (200f1f05-7dc4-411c-b015-8235ba3d3269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:01 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3f323b79-106b-4ffd-9a0d-6543e9583bcf tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1c6fa0a-6f8f-432d-8fc7-e930c23c21b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:01 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3f323b79-106b-4ffd-9a0d-6543e9583bcf tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1c6fa0a-6f8f-432d-8fc7-e930c23c21b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18a4554a-172d-4e8a-b7fe-dc4bb9bf9230', 'volume_name': 'volume-18a4554a-172d-4e8a-b7fe-dc4bb9bf9230', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:01 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3f323b79-106b-4ffd-9a0d-6543e9583bcf tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6791455c-7abb-433b-ad75-4bf8e3d12cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:01 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3f323b79-106b-4ffd-9a0d-6543e9583bcf tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6791455c-7abb-433b-ad75-4bf8e3d12cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:01 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3f323b79-106b-4ffd-9a0d-6543e9583bcf tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d9cfcf3-6643-4fd4-a85b-6fe4c775ff53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:01 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-3f323b79-106b-4ffd-9a0d-6543e9583bcf tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Volume 18a4554a-172d-4e8a-b7fe-dc4bb9bf9230: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18a4554a-172d-4e8a-b7fe-dc4bb9bf9230', 'volume_size': 1} Jul 08 18:42:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3f323b79-106b-4ffd-9a0d-6543e9583bcf tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:42:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5c4c284d-b1f9-424e-acaa-6362462fcedd tempest-VolumeDependencyTests-404164743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1301b12-9e2e-4649-9f18-387c244f00bb.3e4152fe-91e3-4329-8cf7-d8568a043e2f" returned: 0 in 1.425s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5c4c284d-b1f9-424e-acaa-6362462fcedd tempest-VolumeDependencyTests-404164743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1301b12-9e2e-4649-9f18-387c244f00bb.3e4152fe-91e3-4329-8cf7-d8568a043e2f {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:01 devstack sudo[95343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1301b12-9e2e-4649-9f18-387c244f00bb.3e4152fe-91e3-4329-8cf7-d8568a043e2f Jul 08 18:42:01 devstack sudo[95343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:01 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-c04e049e-2da9-49d2-b11d-cdc7bfeba495 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:42:01 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c04e049e-2da9-49d2-b11d-cdc7bfeba495 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Flow 'volume_create_manager' (1e13679d-1006-4a68-b143-e241a336ed8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:42:01 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c04e049e-2da9-49d2-b11d-cdc7bfeba495 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a37a3cb5-8e7b-4311-bb7e-2e1f0fd75953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:01 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c04e049e-2da9-49d2-b11d-cdc7bfeba495 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a37a3cb5-8e7b-4311-bb7e-2e1f0fd75953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1510284102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13e8f1f9-06f8-42b4-9a3a-51d622fb092f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fa97f0e34454d728a0c28e9ecb2491a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:42:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:42:02Z,use_quota=True,user_id='8e5c168ab53e460cb74b72445fc6f2c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:01 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c04e049e-2da9-49d2-b11d-cdc7bfeba495 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33b06242-031e-4735-ac69-edb80f4c2f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:01 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c04e049e-2da9-49d2-b11d-cdc7bfeba495 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33b06242-031e-4735-ac69-edb80f4c2f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:01 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c04e049e-2da9-49d2-b11d-cdc7bfeba495 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89524afb-2759-4b94-8628-49a53e7f0e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:01 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c04e049e-2da9-49d2-b11d-cdc7bfeba495 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89524afb-2759-4b94-8628-49a53e7f0e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13e8f1f9-06f8-42b4-9a3a-51d622fb092f', 'volume_name': 'volume-13e8f1f9-06f8-42b4-9a3a-51d622fb092f', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:01 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c04e049e-2da9-49d2-b11d-cdc7bfeba495 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0786aeb3-e302-4762-927c-0617c4e10ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:01 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c04e049e-2da9-49d2-b11d-cdc7bfeba495 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0786aeb3-e302-4762-927c-0617c4e10ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:01 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c04e049e-2da9-49d2-b11d-cdc7bfeba495 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac865477-5310-4eb0-a715-66e1679ec7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:01 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-c04e049e-2da9-49d2-b11d-cdc7bfeba495 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Volume 13e8f1f9-06f8-42b4-9a3a-51d622fb092f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13e8f1f9-06f8-42b4-9a3a-51d622fb092f', 'volume_size': 1} Jul 08 18:42:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c04e049e-2da9-49d2-b11d-cdc7bfeba495 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:42:02 devstack sudo[95337]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e5f56868-751c-4059-a916-154ea83fdd25 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-fd116989-243b-4852-b44b-43f98c364453" returned: 0 in 1.034s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:02 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-e5f56868-751c-4059-a916-154ea83fdd25 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] <== create_volume: return (2647ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:42:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-e5f56868-751c-4059-a916-154ea83fdd25 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.649s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:42:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-ed232b5f-870b-467a-8ea2-b1a8a30966ae tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.160s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:42:02 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-ed232b5f-870b-467a-8ea2-b1a8a30966ae tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:41:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-824739110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc46e021-2951-4087-87fe-3d632b0ced48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fa97f0e34454d728a0c28e9ecb2491a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:42:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:42:00Z,use_quota=True,user_id='8e5c168ab53e460cb74b72445fc6f2c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:42:02 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-ed232b5f-870b-467a-8ea2-b1a8a30966ae tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Creating volume bc46e021-2951-4087-87fe-3d632b0ced48 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:42:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-ed232b5f-870b-467a-8ea2-b1a8a30966ae tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:42:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-ed232b5f-870b-467a-8ea2-b1a8a30966ae tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:42:02 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-ed232b5f-870b-467a-8ea2-b1a8a30966ae tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:42:02 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-ed232b5f-870b-467a-8ea2-b1a8a30966ae tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:42:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-ed232b5f-870b-467a-8ea2-b1a8a30966ae tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:42:02 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-ed232b5f-870b-467a-8ea2-b1a8a30966ae tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:42:02 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-ed232b5f-870b-467a-8ea2-b1a8a30966ae tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:42:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ed232b5f-870b-467a-8ea2-b1a8a30966ae tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bc46e021-2951-4087-87fe-3d632b0ced48 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:02 devstack sudo[95347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bc46e021-2951-4087-87fe-3d632b0ced48 1073741824 Jul 08 18:42:02 devstack sudo[95347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e5f56868-751c-4059-a916-154ea83fdd25 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e6f4423-3a3f-477e-a190-5566e1aa48aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd116989-243b-4852-b44b-43f98c364453', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e5f56868-751c-4059-a916-154ea83fdd25 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31981ff0-9d16-4df1-b264-79c170395c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:02 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-e5f56868-751c-4059-a916-154ea83fdd25 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Volume volume-fd116989-243b-4852-b44b-43f98c364453 (fd116989-243b-4852-b44b-43f98c364453): created successfully Jul 08 18:42:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e5f56868-751c-4059-a916-154ea83fdd25 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31981ff0-9d16-4df1-b264-79c170395c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e5f56868-751c-4059-a916-154ea83fdd25 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Flow 'volume_create_manager' (693eaff6-4fd9-4f7e-8767-e41b98ea62a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:42:02 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-e5f56868-751c-4059-a916-154ea83fdd25 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Created volume successfully. Jul 08 18:42:02 devstack sudo[95343]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5c4c284d-b1f9-424e-acaa-6362462fcedd tempest-VolumeDependencyTests-404164743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1301b12-9e2e-4649-9f18-387c244f00bb.3e4152fe-91e3-4329-8cf7-d8568a043e2f" returned: 0 in 0.837s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:02 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-5c4c284d-b1f9-424e-acaa-6362462fcedd tempest-VolumeDependencyTests-404164743 None] Lock "cinder-quobyte-3e4152fe-91e3-4329-8cf7-d8568a043e2f" released by "_delete_snapshot" :: held 4.543s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:42:02 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-5c4c284d-b1f9-424e-acaa-6362462fcedd tempest-VolumeDependencyTests-404164743 None] Lock "cinder-quobyte-e1301b12-9e2e-4649-9f18-387c244f00bb" released by "delete_snapshot" :: held 4.573s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:42:02 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-5c4c284d-b1f9-424e-acaa-6362462fcedd tempest-VolumeDependencyTests-404164743 None] Created reservations ['408cec2f-1c82-4898-a503-09725c0c9ec4', 'c6aba87d-e904-4cd3-8b7a-6a5bcb48953a', '04d35e29-7e88-4623-996a-4ba7b6b90be6', 'fe8be525-1a77-4089-a93d-997af9433fcc'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:42:02 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-5c4c284d-b1f9-424e-acaa-6362462fcedd tempest-VolumeDependencyTests-404164743 None] Delete snapshot completed successfully. Jul 08 18:42:02 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-5c4c284d-b1f9-424e-acaa-6362462fcedd tempest-VolumeDependencyTests-404164743 None] Lock "cinder-3e4152fe-91e3-4329-8cf7-d8568a043e2f-delete_snapshot" released by "delete_snapshot" :: held 4.748s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:42:03 devstack sudo[95347]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ed232b5f-870b-467a-8ea2-b1a8a30966ae tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bc46e021-2951-4087-87fe-3d632b0ced48 1073741824" returned: 0 in 0.982s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ed232b5f-870b-467a-8ea2-b1a8a30966ae tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bc46e021-2951-4087-87fe-3d632b0ced48 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:03 devstack sudo[95359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bc46e021-2951-4087-87fe-3d632b0ced48 Jul 08 18:42:03 devstack sudo[95359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:03 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6f75b70b-d4d5-4c5c-8b9f-7600755c3655 tempest-VolumeDependencyTests-404164743 None] Acquiring lock "cinder-e1301b12-9e2e-4649-9f18-387c244f00bb-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:42:03 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6f75b70b-d4d5-4c5c-8b9f-7600755c3655 tempest-VolumeDependencyTests-404164743 None] Lock "cinder-e1301b12-9e2e-4649-9f18-387c244f00bb-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:42:03 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6f75b70b-d4d5-4c5c-8b9f-7600755c3655 tempest-VolumeDependencyTests-404164743 None] Acquiring lock "cinder-quobyte-e1301b12-9e2e-4649-9f18-387c244f00bb" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:42:03 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6f75b70b-d4d5-4c5c-8b9f-7600755c3655 tempest-VolumeDependencyTests-404164743 None] Lock "cinder-quobyte-e1301b12-9e2e-4649-9f18-387c244f00bb" acquired by "delete_volume" :: waited 0.018s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:42:03 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[08508e2f-a3a1-4788-abeb-221d83abade5]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:42:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6f75b70b-d4d5-4c5c-8b9f-7600755c3655 tempest-VolumeDependencyTests-404164743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1301b12-9e2e-4649-9f18-387c244f00bb {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:03 devstack sudo[95361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1301b12-9e2e-4649-9f18-387c244f00bb Jul 08 18:42:03 devstack sudo[95361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:03 devstack sudo[95359]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ed232b5f-870b-467a-8ea2-b1a8a30966ae tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bc46e021-2951-4087-87fe-3d632b0ced48" returned: 0 in 0.730s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:03 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-ed232b5f-870b-467a-8ea2-b1a8a30966ae tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] <== create_volume: return (1766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:42:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-ed232b5f-870b-467a-8ea2-b1a8a30966ae tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.771s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:42:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-65573189-d199-40d9-92c3-bf890a5b72ad tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.906s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:42:03 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-65573189-d199-40d9-92c3-bf890a5b72ad tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:42:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1532792747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10cdd6f0-aaea-4bdd-a3cf-b8aeb0adb73c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fa97f0e34454d728a0c28e9ecb2491a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:42:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:42:00Z,use_quota=True,user_id='8e5c168ab53e460cb74b72445fc6f2c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:42:03 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-65573189-d199-40d9-92c3-bf890a5b72ad tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Creating volume 10cdd6f0-aaea-4bdd-a3cf-b8aeb0adb73c {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:42:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-65573189-d199-40d9-92c3-bf890a5b72ad tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:42:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-65573189-d199-40d9-92c3-bf890a5b72ad tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:42:03 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-65573189-d199-40d9-92c3-bf890a5b72ad tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:42:03 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-65573189-d199-40d9-92c3-bf890a5b72ad tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:42:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-65573189-d199-40d9-92c3-bf890a5b72ad tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:42:03 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-65573189-d199-40d9-92c3-bf890a5b72ad tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:42:03 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-65573189-d199-40d9-92c3-bf890a5b72ad tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:42:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-65573189-d199-40d9-92c3-bf890a5b72ad tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-10cdd6f0-aaea-4bdd-a3cf-b8aeb0adb73c 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ed232b5f-870b-467a-8ea2-b1a8a30966ae tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18b59b46-5e70-440a-b78c-cb7734752afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc46e021-2951-4087-87fe-3d632b0ced48', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ed232b5f-870b-467a-8ea2-b1a8a30966ae tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f72828b-4e58-472b-8a5b-328b2f026c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:03 devstack sudo[95366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-10cdd6f0-aaea-4bdd-a3cf-b8aeb0adb73c 1073741824 Jul 08 18:42:03 devstack sudo[95366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:03 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-ed232b5f-870b-467a-8ea2-b1a8a30966ae tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Volume volume-bc46e021-2951-4087-87fe-3d632b0ced48 (bc46e021-2951-4087-87fe-3d632b0ced48): created successfully Jul 08 18:42:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ed232b5f-870b-467a-8ea2-b1a8a30966ae tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f72828b-4e58-472b-8a5b-328b2f026c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ed232b5f-870b-467a-8ea2-b1a8a30966ae tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Flow 'volume_create_manager' (19e9af94-1ace-4c90-a090-380589651e3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:42:03 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-ed232b5f-870b-467a-8ea2-b1a8a30966ae tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Created volume successfully. Jul 08 18:42:04 devstack sudo[95361]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6f75b70b-d4d5-4c5c-8b9f-7600755c3655 tempest-VolumeDependencyTests-404164743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1301b12-9e2e-4649-9f18-387c244f00bb" returned: 0 in 0.949s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6f75b70b-d4d5-4c5c-8b9f-7600755c3655 tempest-VolumeDependencyTests-404164743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1301b12-9e2e-4649-9f18-387c244f00bb {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:04 devstack sudo[95371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1301b12-9e2e-4649-9f18-387c244f00bb Jul 08 18:42:04 devstack sudo[95371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:05 devstack sudo[95366]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-65573189-d199-40d9-92c3-bf890a5b72ad tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-10cdd6f0-aaea-4bdd-a3cf-b8aeb0adb73c 1073741824" returned: 0 in 1.172s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-65573189-d199-40d9-92c3-bf890a5b72ad tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-10cdd6f0-aaea-4bdd-a3cf-b8aeb0adb73c {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:05 devstack sudo[95378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-10cdd6f0-aaea-4bdd-a3cf-b8aeb0adb73c Jul 08 18:42:05 devstack sudo[95378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:05 devstack sudo[95371]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6f75b70b-d4d5-4c5c-8b9f-7600755c3655 tempest-VolumeDependencyTests-404164743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1301b12-9e2e-4649-9f18-387c244f00bb" returned: 0 in 0.856s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:05 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6f75b70b-d4d5-4c5c-8b9f-7600755c3655 tempest-VolumeDependencyTests-404164743 None] Lock "cinder-quobyte-e1301b12-9e2e-4649-9f18-387c244f00bb" released by "delete_volume" :: held 1.918s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:42:05 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-6f75b70b-d4d5-4c5c-8b9f-7600755c3655 tempest-VolumeDependencyTests-404164743 None] Created reservations ['765b59ad-1577-4ce5-93ac-63c02155cd58', '4cdca420-5a4c-4498-94a8-26c1dbad26b7', '571df027-620b-4f9f-ae22-f876bcfa4f42', 'f86201f3-4c2a-4f79-8c44-5f051ff8f02a'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:42:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6f75b70b-d4d5-4c5c-8b9f-7600755c3655 tempest-VolumeDependencyTests-404164743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:42:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6f75b70b-d4d5-4c5c-8b9f-7600755c3655 tempest-VolumeDependencyTests-404164743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:42:05 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-6f75b70b-d4d5-4c5c-8b9f-7600755c3655 tempest-VolumeDependencyTests-404164743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:42:05 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-6f75b70b-d4d5-4c5c-8b9f-7600755c3655 tempest-VolumeDependencyTests-404164743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:42:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6f75b70b-d4d5-4c5c-8b9f-7600755c3655 tempest-VolumeDependencyTests-404164743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:42:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6f75b70b-d4d5-4c5c-8b9f-7600755c3655 tempest-VolumeDependencyTests-404164743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:05 devstack sudo[95380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:42:05 devstack sudo[95380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:05 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-1268a698-8385-42a8-bdbe-bfe2d062a5e4 tempest-VolumeDependencyTests-404164743 None] Acquiring lock "cinder-d4e01946-bf13-4a21-9272-593dfde74311-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:42:05 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-1268a698-8385-42a8-bdbe-bfe2d062a5e4 tempest-VolumeDependencyTests-404164743 None] Lock "cinder-d4e01946-bf13-4a21-9272-593dfde74311-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:42:05 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-1268a698-8385-42a8-bdbe-bfe2d062a5e4 tempest-VolumeDependencyTests-404164743 None] Acquiring lock "cinder-quobyte-d4e01946-bf13-4a21-9272-593dfde74311" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:42:05 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-1268a698-8385-42a8-bdbe-bfe2d062a5e4 tempest-VolumeDependencyTests-404164743 None] Lock "cinder-quobyte-d4e01946-bf13-4a21-9272-593dfde74311" acquired by "delete_volume" :: waited 0.039s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:42:05 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f13a28-df4f-45ae-9182-e3e847480c6b]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:42:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1268a698-8385-42a8-bdbe-bfe2d062a5e4 tempest-VolumeDependencyTests-404164743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4e01946-bf13-4a21-9272-593dfde74311 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:05 devstack sudo[95388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4e01946-bf13-4a21-9272-593dfde74311 Jul 08 18:42:05 devstack sudo[95388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:05 devstack sudo[95378]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-65573189-d199-40d9-92c3-bf890a5b72ad tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-10cdd6f0-aaea-4bdd-a3cf-b8aeb0adb73c" returned: 0 in 0.877s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:05 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-65573189-d199-40d9-92c3-bf890a5b72ad tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] <== create_volume: return (2115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:42:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-65573189-d199-40d9-92c3-bf890a5b72ad tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.121s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:42:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3f323b79-106b-4ffd-9a0d-6543e9583bcf tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.398s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:42:05 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-3f323b79-106b-4ffd-9a0d-6543e9583bcf tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1520462288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18a4554a-172d-4e8a-b7fe-dc4bb9bf9230,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fa97f0e34454d728a0c28e9ecb2491a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:42:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:42:01Z,use_quota=True,user_id='8e5c168ab53e460cb74b72445fc6f2c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:42:05 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-3f323b79-106b-4ffd-9a0d-6543e9583bcf tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Creating volume 18a4554a-172d-4e8a-b7fe-dc4bb9bf9230 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:42:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3f323b79-106b-4ffd-9a0d-6543e9583bcf tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:42:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3f323b79-106b-4ffd-9a0d-6543e9583bcf tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:42:05 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-3f323b79-106b-4ffd-9a0d-6543e9583bcf tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:42:05 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-3f323b79-106b-4ffd-9a0d-6543e9583bcf tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:42:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3f323b79-106b-4ffd-9a0d-6543e9583bcf tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:42:05 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-3f323b79-106b-4ffd-9a0d-6543e9583bcf tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:42:05 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-3f323b79-106b-4ffd-9a0d-6543e9583bcf tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:42:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3f323b79-106b-4ffd-9a0d-6543e9583bcf tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-18a4554a-172d-4e8a-b7fe-dc4bb9bf9230 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:06 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-65573189-d199-40d9-92c3-bf890a5b72ad tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (619c9c18-aabc-4c6a-b2e0-e1f6d28ae7d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10cdd6f0-aaea-4bdd-a3cf-b8aeb0adb73c', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:06 devstack sudo[95391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-18a4554a-172d-4e8a-b7fe-dc4bb9bf9230 1073741824 Jul 08 18:42:06 devstack sudo[95391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:06 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-65573189-d199-40d9-92c3-bf890a5b72ad tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (471c104f-fe5f-4c1e-a4f7-b1fb6f04f6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:06 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-65573189-d199-40d9-92c3-bf890a5b72ad tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Volume volume-10cdd6f0-aaea-4bdd-a3cf-b8aeb0adb73c (10cdd6f0-aaea-4bdd-a3cf-b8aeb0adb73c): created successfully Jul 08 18:42:06 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-65573189-d199-40d9-92c3-bf890a5b72ad tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (471c104f-fe5f-4c1e-a4f7-b1fb6f04f6ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:06 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-65573189-d199-40d9-92c3-bf890a5b72ad tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Flow 'volume_create_manager' (e46b3890-0fd0-4f92-a378-1d21fe07cc5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:42:06 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-65573189-d199-40d9-92c3-bf890a5b72ad tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Created volume successfully. Jul 08 18:42:06 devstack sudo[95380]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6f75b70b-d4d5-4c5c-8b9f-7600755c3655 tempest-VolumeDependencyTests-404164743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.974s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:06 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-6f75b70b-d4d5-4c5c-8b9f-7600755c3655 tempest-VolumeDependencyTests-404164743 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:42:06 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-6f75b70b-d4d5-4c5c-8b9f-7600755c3655 tempest-VolumeDependencyTests-404164743 None] Deleted volume successfully. Jul 08 18:42:06 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6f75b70b-d4d5-4c5c-8b9f-7600755c3655 tempest-VolumeDependencyTests-404164743 None] Lock "cinder-e1301b12-9e2e-4649-9f18-387c244f00bb-delete_volume" released by "delete_volume" :: held 3.183s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:42:06 devstack sudo[95388]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1268a698-8385-42a8-bdbe-bfe2d062a5e4 tempest-VolumeDependencyTests-404164743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4e01946-bf13-4a21-9272-593dfde74311" returned: 0 in 1.257s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1268a698-8385-42a8-bdbe-bfe2d062a5e4 tempest-VolumeDependencyTests-404164743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4e01946-bf13-4a21-9272-593dfde74311 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:07 devstack sudo[95417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4e01946-bf13-4a21-9272-593dfde74311 Jul 08 18:42:07 devstack sudo[95417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:07 devstack sudo[95391]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3f323b79-106b-4ffd-9a0d-6543e9583bcf tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-18a4554a-172d-4e8a-b7fe-dc4bb9bf9230 1073741824" returned: 0 in 1.301s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3f323b79-106b-4ffd-9a0d-6543e9583bcf tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-18a4554a-172d-4e8a-b7fe-dc4bb9bf9230 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:07 devstack sudo[95421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-18a4554a-172d-4e8a-b7fe-dc4bb9bf9230 Jul 08 18:42:07 devstack sudo[95421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:07 devstack sudo[95417]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1268a698-8385-42a8-bdbe-bfe2d062a5e4 tempest-VolumeDependencyTests-404164743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4e01946-bf13-4a21-9272-593dfde74311" returned: 0 in 0.843s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:07 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-1268a698-8385-42a8-bdbe-bfe2d062a5e4 tempest-VolumeDependencyTests-404164743 None] Lock "cinder-quobyte-d4e01946-bf13-4a21-9272-593dfde74311" released by "delete_volume" :: held 2.194s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:42:07 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-1268a698-8385-42a8-bdbe-bfe2d062a5e4 tempest-VolumeDependencyTests-404164743 None] Created reservations ['f9303f86-c91a-443d-8659-ec77155cfceb', '1093709a-b2af-40dd-b820-59acd1df3cf4', '39135744-e9fb-41a2-8da0-113fd88d2974', '3db92ff3-d323-43c0-bf5c-40389e8eae90'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:42:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1268a698-8385-42a8-bdbe-bfe2d062a5e4 tempest-VolumeDependencyTests-404164743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:42:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1268a698-8385-42a8-bdbe-bfe2d062a5e4 tempest-VolumeDependencyTests-404164743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:42:08 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-1268a698-8385-42a8-bdbe-bfe2d062a5e4 tempest-VolumeDependencyTests-404164743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:42:08 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-1268a698-8385-42a8-bdbe-bfe2d062a5e4 tempest-VolumeDependencyTests-404164743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:42:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1268a698-8385-42a8-bdbe-bfe2d062a5e4 tempest-VolumeDependencyTests-404164743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:42:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1268a698-8385-42a8-bdbe-bfe2d062a5e4 tempest-VolumeDependencyTests-404164743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:08 devstack sudo[95426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:42:08 devstack sudo[95426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:08 devstack sudo[95421]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3f323b79-106b-4ffd-9a0d-6543e9583bcf tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-18a4554a-172d-4e8a-b7fe-dc4bb9bf9230" returned: 0 in 0.944s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:08 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-3f323b79-106b-4ffd-9a0d-6543e9583bcf tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] <== create_volume: return (2338ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:42:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3f323b79-106b-4ffd-9a0d-6543e9583bcf tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.343s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:42:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c04e049e-2da9-49d2-b11d-cdc7bfeba495 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.378s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:42:08 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c04e049e-2da9-49d2-b11d-cdc7bfeba495 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1510284102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13e8f1f9-06f8-42b4-9a3a-51d622fb092f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fa97f0e34454d728a0c28e9ecb2491a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:42:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:42:02Z,use_quota=True,user_id='8e5c168ab53e460cb74b72445fc6f2c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:42:08 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-c04e049e-2da9-49d2-b11d-cdc7bfeba495 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Creating volume 13e8f1f9-06f8-42b4-9a3a-51d622fb092f {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:42:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c04e049e-2da9-49d2-b11d-cdc7bfeba495 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:42:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c04e049e-2da9-49d2-b11d-cdc7bfeba495 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:42:08 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c04e049e-2da9-49d2-b11d-cdc7bfeba495 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:42:08 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c04e049e-2da9-49d2-b11d-cdc7bfeba495 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:42:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c04e049e-2da9-49d2-b11d-cdc7bfeba495 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:42:08 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c04e049e-2da9-49d2-b11d-cdc7bfeba495 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:42:08 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-c04e049e-2da9-49d2-b11d-cdc7bfeba495 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:42:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c04e049e-2da9-49d2-b11d-cdc7bfeba495 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-13e8f1f9-06f8-42b4-9a3a-51d622fb092f 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:08 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3f323b79-106b-4ffd-9a0d-6543e9583bcf tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d9cfcf3-6643-4fd4-a85b-6fe4c775ff53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18a4554a-172d-4e8a-b7fe-dc4bb9bf9230', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:08 devstack sudo[95430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-13e8f1f9-06f8-42b4-9a3a-51d622fb092f 1073741824 Jul 08 18:42:08 devstack sudo[95430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:08 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3f323b79-106b-4ffd-9a0d-6543e9583bcf tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (536296c8-fc46-42aa-af00-256c75209bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:08 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-3f323b79-106b-4ffd-9a0d-6543e9583bcf tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Volume volume-18a4554a-172d-4e8a-b7fe-dc4bb9bf9230 (18a4554a-172d-4e8a-b7fe-dc4bb9bf9230): created successfully Jul 08 18:42:08 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3f323b79-106b-4ffd-9a0d-6543e9583bcf tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (536296c8-fc46-42aa-af00-256c75209bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:08 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3f323b79-106b-4ffd-9a0d-6543e9583bcf tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Flow 'volume_create_manager' (b2e0e751-eca1-4065-8286-ac0557707428) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:42:08 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-3f323b79-106b-4ffd-9a0d-6543e9583bcf tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Created volume successfully. Jul 08 18:42:08 devstack sudo[95426]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1268a698-8385-42a8-bdbe-bfe2d062a5e4 tempest-VolumeDependencyTests-404164743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.872s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:08 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-1268a698-8385-42a8-bdbe-bfe2d062a5e4 tempest-VolumeDependencyTests-404164743 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:42:08 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-1268a698-8385-42a8-bdbe-bfe2d062a5e4 tempest-VolumeDependencyTests-404164743 None] Deleted volume successfully. Jul 08 18:42:08 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-1268a698-8385-42a8-bdbe-bfe2d062a5e4 tempest-VolumeDependencyTests-404164743 None] Lock "cinder-d4e01946-bf13-4a21-9272-593dfde74311-delete_volume" released by "delete_volume" :: held 3.421s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:42:09 devstack sudo[95430]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c04e049e-2da9-49d2-b11d-cdc7bfeba495 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-13e8f1f9-06f8-42b4-9a3a-51d622fb092f 1073741824" returned: 0 in 1.125s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c04e049e-2da9-49d2-b11d-cdc7bfeba495 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-13e8f1f9-06f8-42b4-9a3a-51d622fb092f {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:09 devstack sudo[95437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-13e8f1f9-06f8-42b4-9a3a-51d622fb092f Jul 08 18:42:09 devstack sudo[95437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:10 devstack sudo[95437]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c04e049e-2da9-49d2-b11d-cdc7bfeba495 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-13e8f1f9-06f8-42b4-9a3a-51d622fb092f" returned: 0 in 0.834s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:10 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c04e049e-2da9-49d2-b11d-cdc7bfeba495 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] <== create_volume: return (2015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:42:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c04e049e-2da9-49d2-b11d-cdc7bfeba495 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.020s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:42:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c04e049e-2da9-49d2-b11d-cdc7bfeba495 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac865477-5310-4eb0-a715-66e1679ec7b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13e8f1f9-06f8-42b4-9a3a-51d622fb092f', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c04e049e-2da9-49d2-b11d-cdc7bfeba495 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0e5ce9f-15d3-48a5-a9b5-098cfbe7e8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:10 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-c04e049e-2da9-49d2-b11d-cdc7bfeba495 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Volume volume-13e8f1f9-06f8-42b4-9a3a-51d622fb092f (13e8f1f9-06f8-42b4-9a3a-51d622fb092f): created successfully Jul 08 18:42:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c04e049e-2da9-49d2-b11d-cdc7bfeba495 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0e5ce9f-15d3-48a5-a9b5-098cfbe7e8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c04e049e-2da9-49d2-b11d-cdc7bfeba495 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Flow 'volume_create_manager' (1e13679d-1006-4a68-b143-e241a336ed8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:42:10 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-c04e049e-2da9-49d2-b11d-cdc7bfeba495 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Created volume successfully. Jul 08 18:42:10 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-922cab24-399b-4690-848e-0d08fa9a7f8a tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Acquiring lock "cinder-13e8f1f9-06f8-42b4-9a3a-51d622fb092f-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:42:10 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-922cab24-399b-4690-848e-0d08fa9a7f8a tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Lock "cinder-13e8f1f9-06f8-42b4-9a3a-51d622fb092f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:42:10 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-922cab24-399b-4690-848e-0d08fa9a7f8a tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Acquiring lock "cinder-quobyte-13e8f1f9-06f8-42b4-9a3a-51d622fb092f" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:42:11 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-922cab24-399b-4690-848e-0d08fa9a7f8a tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Lock "cinder-quobyte-13e8f1f9-06f8-42b4-9a3a-51d622fb092f" acquired by "delete_volume" :: waited 0.020s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:42:11 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[0930142f-ea74-4ce7-982e-3a5c9645a5bb]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:42:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-922cab24-399b-4690-848e-0d08fa9a7f8a tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-13e8f1f9-06f8-42b4-9a3a-51d622fb092f {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:11 devstack sudo[95441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-13e8f1f9-06f8-42b4-9a3a-51d622fb092f Jul 08 18:42:11 devstack sudo[95441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:11 devstack sudo[95441]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-922cab24-399b-4690-848e-0d08fa9a7f8a tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-13e8f1f9-06f8-42b4-9a3a-51d622fb092f" returned: 0 in 0.862s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-922cab24-399b-4690-848e-0d08fa9a7f8a tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-13e8f1f9-06f8-42b4-9a3a-51d622fb092f {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:11 devstack sudo[95446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-13e8f1f9-06f8-42b4-9a3a-51d622fb092f Jul 08 18:42:11 devstack sudo[95446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:12 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-c44d5b67-e1b5-4b43-a6ba-1983f3b6f7da tempest-VolumeQuotasNegativeTestJSON-239718686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:42:12 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c44d5b67-e1b5-4b43-a6ba-1983f3b6f7da tempest-VolumeQuotasNegativeTestJSON-239718686 None] Flow 'volume_create_manager' (a1799ec2-71b5-41a7-9913-f51ccf5fa56c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:42:12 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c44d5b67-e1b5-4b43-a6ba-1983f3b6f7da tempest-VolumeQuotasNegativeTestJSON-239718686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8662f959-bf91-4031-8995-03e4feb22a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:12 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c44d5b67-e1b5-4b43-a6ba-1983f3b6f7da tempest-VolumeQuotasNegativeTestJSON-239718686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8662f959-bf91-4031-8995-03e4feb22a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1562026189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eac39fc-3b9b-4696-bd91-15df5d2f8e7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49c19191028e4feabe33cf3707e14f21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:42:12Z,use_quota=True,user_id='be3ade2a1a3044388e91ba8c6322f2fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:12 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c44d5b67-e1b5-4b43-a6ba-1983f3b6f7da tempest-VolumeQuotasNegativeTestJSON-239718686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6959b327-466a-4e6d-973b-bc2a31d6f7d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:12 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c44d5b67-e1b5-4b43-a6ba-1983f3b6f7da tempest-VolumeQuotasNegativeTestJSON-239718686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6959b327-466a-4e6d-973b-bc2a31d6f7d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:12 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c44d5b67-e1b5-4b43-a6ba-1983f3b6f7da tempest-VolumeQuotasNegativeTestJSON-239718686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f195778-447a-4119-bc99-8ddde450c33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:12 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c44d5b67-e1b5-4b43-a6ba-1983f3b6f7da tempest-VolumeQuotasNegativeTestJSON-239718686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f195778-447a-4119-bc99-8ddde450c33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0eac39fc-3b9b-4696-bd91-15df5d2f8e7c', 'volume_name': 'volume-0eac39fc-3b9b-4696-bd91-15df5d2f8e7c', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:12 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c44d5b67-e1b5-4b43-a6ba-1983f3b6f7da tempest-VolumeQuotasNegativeTestJSON-239718686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd2f38e6-af79-4a12-b686-d656754d79d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:12 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c44d5b67-e1b5-4b43-a6ba-1983f3b6f7da tempest-VolumeQuotasNegativeTestJSON-239718686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd2f38e6-af79-4a12-b686-d656754d79d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:12 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c44d5b67-e1b5-4b43-a6ba-1983f3b6f7da tempest-VolumeQuotasNegativeTestJSON-239718686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edb827dc-ad6b-4991-ad24-8e8415fa5e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:12 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-c44d5b67-e1b5-4b43-a6ba-1983f3b6f7da tempest-VolumeQuotasNegativeTestJSON-239718686 None] Volume 0eac39fc-3b9b-4696-bd91-15df5d2f8e7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0eac39fc-3b9b-4696-bd91-15df5d2f8e7c', 'volume_size': 1} Jul 08 18:42:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c44d5b67-e1b5-4b43-a6ba-1983f3b6f7da tempest-VolumeQuotasNegativeTestJSON-239718686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:42:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c44d5b67-e1b5-4b43-a6ba-1983f3b6f7da tempest-VolumeQuotasNegativeTestJSON-239718686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:42:12 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c44d5b67-e1b5-4b43-a6ba-1983f3b6f7da tempest-VolumeQuotasNegativeTestJSON-239718686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1562026189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eac39fc-3b9b-4696-bd91-15df5d2f8e7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49c19191028e4feabe33cf3707e14f21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:42:12Z,use_quota=True,user_id='be3ade2a1a3044388e91ba8c6322f2fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:42:12 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-c44d5b67-e1b5-4b43-a6ba-1983f3b6f7da tempest-VolumeQuotasNegativeTestJSON-239718686 None] Creating volume 0eac39fc-3b9b-4696-bd91-15df5d2f8e7c {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:42:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c44d5b67-e1b5-4b43-a6ba-1983f3b6f7da tempest-VolumeQuotasNegativeTestJSON-239718686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:42:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c44d5b67-e1b5-4b43-a6ba-1983f3b6f7da tempest-VolumeQuotasNegativeTestJSON-239718686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:42:12 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c44d5b67-e1b5-4b43-a6ba-1983f3b6f7da tempest-VolumeQuotasNegativeTestJSON-239718686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:42:12 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c44d5b67-e1b5-4b43-a6ba-1983f3b6f7da tempest-VolumeQuotasNegativeTestJSON-239718686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:42:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c44d5b67-e1b5-4b43-a6ba-1983f3b6f7da tempest-VolumeQuotasNegativeTestJSON-239718686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:42:12 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c44d5b67-e1b5-4b43-a6ba-1983f3b6f7da tempest-VolumeQuotasNegativeTestJSON-239718686 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:42:12 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-c44d5b67-e1b5-4b43-a6ba-1983f3b6f7da tempest-VolumeQuotasNegativeTestJSON-239718686 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:42:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c44d5b67-e1b5-4b43-a6ba-1983f3b6f7da tempest-VolumeQuotasNegativeTestJSON-239718686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0eac39fc-3b9b-4696-bd91-15df5d2f8e7c 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:12 devstack sudo[95450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0eac39fc-3b9b-4696-bd91-15df5d2f8e7c 1073741824 Jul 08 18:42:12 devstack sudo[95450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:12 devstack sudo[95446]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-922cab24-399b-4690-848e-0d08fa9a7f8a tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-13e8f1f9-06f8-42b4-9a3a-51d622fb092f" returned: 0 in 0.935s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:12 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-922cab24-399b-4690-848e-0d08fa9a7f8a tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Lock "cinder-quobyte-13e8f1f9-06f8-42b4-9a3a-51d622fb092f" released by "delete_volume" :: held 1.870s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:42:12 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-922cab24-399b-4690-848e-0d08fa9a7f8a tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Created reservations ['270bfc78-976f-4fe2-a525-cebd0d9525c0', '94ce0bf8-0136-4e8b-857b-d23bdd8f6067', '17bac053-9915-45b9-b83d-6d438305b5a3', '2f867287-5865-49dd-a489-6a3921887002'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:42:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-922cab24-399b-4690-848e-0d08fa9a7f8a tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:42:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-922cab24-399b-4690-848e-0d08fa9a7f8a tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:42:13 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-922cab24-399b-4690-848e-0d08fa9a7f8a tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:42:13 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-922cab24-399b-4690-848e-0d08fa9a7f8a tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:42:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-922cab24-399b-4690-848e-0d08fa9a7f8a tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:42:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-922cab24-399b-4690-848e-0d08fa9a7f8a tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:13 devstack sudo[95452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:42:13 devstack sudo[95452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:13 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-f8a43d4b-d363-400e-8345-3f5f41a34053 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Acquiring lock "cinder-18a4554a-172d-4e8a-b7fe-dc4bb9bf9230-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:42:13 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-f8a43d4b-d363-400e-8345-3f5f41a34053 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Lock "cinder-18a4554a-172d-4e8a-b7fe-dc4bb9bf9230-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:42:13 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-f8a43d4b-d363-400e-8345-3f5f41a34053 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Acquiring lock "cinder-quobyte-18a4554a-172d-4e8a-b7fe-dc4bb9bf9230" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:42:13 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-f8a43d4b-d363-400e-8345-3f5f41a34053 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Lock "cinder-quobyte-18a4554a-172d-4e8a-b7fe-dc4bb9bf9230" acquired by "delete_volume" :: waited 0.025s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:42:13 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2fa4ec-261b-4bea-9e8a-f9078662b1ad]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:42:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f8a43d4b-d363-400e-8345-3f5f41a34053 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-18a4554a-172d-4e8a-b7fe-dc4bb9bf9230 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:13 devstack sudo[95457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-18a4554a-172d-4e8a-b7fe-dc4bb9bf9230 Jul 08 18:42:13 devstack sudo[95457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:13 devstack sudo[95450]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c44d5b67-e1b5-4b43-a6ba-1983f3b6f7da tempest-VolumeQuotasNegativeTestJSON-239718686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0eac39fc-3b9b-4696-bd91-15df5d2f8e7c 1073741824" returned: 0 in 1.210s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c44d5b67-e1b5-4b43-a6ba-1983f3b6f7da tempest-VolumeQuotasNegativeTestJSON-239718686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0eac39fc-3b9b-4696-bd91-15df5d2f8e7c {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:13 devstack sudo[95452]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-922cab24-399b-4690-848e-0d08fa9a7f8a tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.958s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:13 devstack sudo[95461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0eac39fc-3b9b-4696-bd91-15df5d2f8e7c Jul 08 18:42:14 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-922cab24-399b-4690-848e-0d08fa9a7f8a tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:42:14 devstack sudo[95461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:14 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-922cab24-399b-4690-848e-0d08fa9a7f8a tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Deleted volume successfully. Jul 08 18:42:14 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-922cab24-399b-4690-848e-0d08fa9a7f8a tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Lock "cinder-13e8f1f9-06f8-42b4-9a3a-51d622fb092f-delete_volume" released by "delete_volume" :: held 3.112s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:42:14 devstack sudo[95457]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f8a43d4b-d363-400e-8345-3f5f41a34053 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-18a4554a-172d-4e8a-b7fe-dc4bb9bf9230" returned: 0 in 1.254s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f8a43d4b-d363-400e-8345-3f5f41a34053 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-18a4554a-172d-4e8a-b7fe-dc4bb9bf9230 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:14 devstack sudo[95461]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c44d5b67-e1b5-4b43-a6ba-1983f3b6f7da tempest-VolumeQuotasNegativeTestJSON-239718686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0eac39fc-3b9b-4696-bd91-15df5d2f8e7c" returned: 0 in 0.865s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:14 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c44d5b67-e1b5-4b43-a6ba-1983f3b6f7da tempest-VolumeQuotasNegativeTestJSON-239718686 None] <== create_volume: return (2152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:42:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c44d5b67-e1b5-4b43-a6ba-1983f3b6f7da tempest-VolumeQuotasNegativeTestJSON-239718686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.160s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:42:14 devstack sudo[95467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-18a4554a-172d-4e8a-b7fe-dc4bb9bf9230 Jul 08 18:42:14 devstack sudo[95467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:14 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c44d5b67-e1b5-4b43-a6ba-1983f3b6f7da tempest-VolumeQuotasNegativeTestJSON-239718686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edb827dc-ad6b-4991-ad24-8e8415fa5e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0eac39fc-3b9b-4696-bd91-15df5d2f8e7c', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:14 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c44d5b67-e1b5-4b43-a6ba-1983f3b6f7da tempest-VolumeQuotasNegativeTestJSON-239718686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4747cd7-cea2-4999-b24a-e09789c851c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:14 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-c44d5b67-e1b5-4b43-a6ba-1983f3b6f7da tempest-VolumeQuotasNegativeTestJSON-239718686 None] Volume volume-0eac39fc-3b9b-4696-bd91-15df5d2f8e7c (0eac39fc-3b9b-4696-bd91-15df5d2f8e7c): created successfully Jul 08 18:42:14 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c44d5b67-e1b5-4b43-a6ba-1983f3b6f7da tempest-VolumeQuotasNegativeTestJSON-239718686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4747cd7-cea2-4999-b24a-e09789c851c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:14 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c44d5b67-e1b5-4b43-a6ba-1983f3b6f7da tempest-VolumeQuotasNegativeTestJSON-239718686 None] Flow 'volume_create_manager' (a1799ec2-71b5-41a7-9913-f51ccf5fa56c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:42:14 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-c44d5b67-e1b5-4b43-a6ba-1983f3b6f7da tempest-VolumeQuotasNegativeTestJSON-239718686 None] Created volume successfully. Jul 08 18:42:15 devstack sudo[95467]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f8a43d4b-d363-400e-8345-3f5f41a34053 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-18a4554a-172d-4e8a-b7fe-dc4bb9bf9230" returned: 0 in 0.767s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:15 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-f8a43d4b-d363-400e-8345-3f5f41a34053 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Lock "cinder-quobyte-18a4554a-172d-4e8a-b7fe-dc4bb9bf9230" released by "delete_volume" :: held 2.076s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:42:15 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-f8a43d4b-d363-400e-8345-3f5f41a34053 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Created reservations ['86dd0438-6ce2-4799-84bb-4309804734e9', '1a64fa9d-20a4-4756-ae4d-5cba6b30e008', '8f1e74c0-aa7e-4334-b0a6-59aabd11d434', '139efbac-f683-4ef5-a11f-eb43bc63650e'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:42:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f8a43d4b-d363-400e-8345-3f5f41a34053 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:42:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f8a43d4b-d363-400e-8345-3f5f41a34053 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:42:15 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-f8a43d4b-d363-400e-8345-3f5f41a34053 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:42:15 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-f8a43d4b-d363-400e-8345-3f5f41a34053 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:42:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f8a43d4b-d363-400e-8345-3f5f41a34053 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:42:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f8a43d4b-d363-400e-8345-3f5f41a34053 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:15 devstack sudo[95476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:42:15 devstack sudo[95476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:16 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:42:16 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] Flow 'volume_create_manager' (e2491f9a-bb03-4815-a594-ae35b9711e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:42:16 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fce03313-c531-4977-b15b-005ef025af7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:16 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fce03313-c531-4977-b15b-005ef025af7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:42:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f30366b-9ee2-45e6-9baa-5cd4471ed65d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4e280fb2cb2481a8eb38bb47f46691d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:42:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:42:16Z,use_quota=True,user_id='7d1555821b884d209586b86d1b6ef6fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:16 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd545e6f-0f7c-4690-aff3-c98ca4850f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:16 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd545e6f-0f7c-4690-aff3-c98ca4850f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:16 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b174f0a5-deae-4e60-aaf2-146e0b1a8b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:16 devstack cinder-volume[86873]: DEBUG cinder.image.glance [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] Creating Keystone auth plugin from conf {{(pid=86873) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 18:42:16 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b174f0a5-deae-4e60-aaf2-146e0b1a8b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8f30366b-9ee2-45e6-9baa-5cd4471ed65d', 'volume_name': 'volume-8f30366b-9ee2-45e6-9baa-5cd4471ed65d', 'volume_size': 1, 'image_id': 'c611e097-7c9b-43b5-b812-800b66625cdf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c611e097-7c9b-43b5-b812-800b66625cdf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0506760ab4d4eb42d697b1e7db2b2f91', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b4e280fb2cb2481a8eb38bb47f46691d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b3ea9292064b28c981f56e0f24a1591be122e4445d02dafd606cc61f8d16fc4595c2bd05f238891f07c081314dd46674854a1a877c205cfa907348350bb486e5', 'id': 'c611e097-7c9b-43b5-b812-800b66625cdf', 'created_at': datetime.datetime(2026, 7, 8, 16, 42, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 42, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c611e097-7c9b-43b5-b812-800b66625cdf/file', 'properties': {}}, 'image_service': }' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:16 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffe51f4f-6c1f-4535-a3e3-95378cdf905b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:16 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffe51f4f-6c1f-4535-a3e3-95378cdf905b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:16 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (179ae1d9-e9af-4574-ab08-4662a6f0017e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:16 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] Volume 8f30366b-9ee2-45e6-9baa-5cd4471ed65d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8f30366b-9ee2-45e6-9baa-5cd4471ed65d', 'volume_size': 1, 'image_id': 'c611e097-7c9b-43b5-b812-800b66625cdf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c611e097-7c9b-43b5-b812-800b66625cdf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0506760ab4d4eb42d697b1e7db2b2f91', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b4e280fb2cb2481a8eb38bb47f46691d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b3ea9292064b28c981f56e0f24a1591be122e4445d02dafd606cc61f8d16fc4595c2bd05f238891f07c081314dd46674854a1a877c205cfa907348350bb486e5', 'id': 'c611e097-7c9b-43b5-b812-800b66625cdf', 'created_at': datetime.datetime(2026, 7, 8, 16, 42, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 42, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c611e097-7c9b-43b5-b812-800b66625cdf/file', 'properties': {}}, 'image_service': } Jul 08 18:42:16 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] Trying to clone 8f30366b-9ee2-45e6-9baa-5cd4471ed65d from image c611e097-7c9b-43b5-b812-800b66625cdf at location (None, [{'url': 'file:///opt/stack/data/glance/images/c611e097-7c9b-43b5-b812-800b66625cdf', 'metadata': {}}]). {{(pid=86873) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 18:42:16 devstack cinder-volume[86873]: DEBUG cinder.image.image_utils [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c611e097-7c9b-43b5-b812-800b66625cdf_u37pug9adevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86873) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 18:42:16 devstack cinder-volume[86873]: INFO cinder.image.image_utils [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] Image download 0.00 MB at 0.00 MB/s Jul 08 18:42:16 devstack sudo[95476]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f8a43d4b-d363-400e-8345-3f5f41a34053 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.882s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:16 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-f8a43d4b-d363-400e-8345-3f5f41a34053 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:42:16 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-f8a43d4b-d363-400e-8345-3f5f41a34053 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Deleted volume successfully. Jul 08 18:42:16 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d37523-c286-4e05-a298-6bf6aa8b6224]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:42:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c611e097-7c9b-43b5-b812-800b66625cdf_u37pug9adevstack@QuobyteHD {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:16 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-f8a43d4b-d363-400e-8345-3f5f41a34053 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Lock "cinder-18a4554a-172d-4e8a-b7fe-dc4bb9bf9230-delete_volume" released by "delete_volume" :: held 3.294s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:42:16 devstack sudo[95479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c611e097-7c9b-43b5-b812-800b66625cdf_u37pug9adevstack@QuobyteHD Jul 08 18:42:16 devstack sudo[95479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:16 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-dc7450db-7fd2-42f8-a563-d1de02949399 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Acquiring lock "cinder-10cdd6f0-aaea-4bdd-a3cf-b8aeb0adb73c-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:42:16 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-dc7450db-7fd2-42f8-a563-d1de02949399 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Lock "cinder-10cdd6f0-aaea-4bdd-a3cf-b8aeb0adb73c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:42:16 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-dc7450db-7fd2-42f8-a563-d1de02949399 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Acquiring lock "cinder-quobyte-10cdd6f0-aaea-4bdd-a3cf-b8aeb0adb73c" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:42:16 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-dc7450db-7fd2-42f8-a563-d1de02949399 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Lock "cinder-quobyte-10cdd6f0-aaea-4bdd-a3cf-b8aeb0adb73c" acquired by "delete_volume" :: waited 0.021s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:42:16 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d6d211-53a1-4f79-8c19-7fdcbc985581]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:42:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dc7450db-7fd2-42f8-a563-d1de02949399 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-10cdd6f0-aaea-4bdd-a3cf-b8aeb0adb73c {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:17 devstack sudo[95481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-10cdd6f0-aaea-4bdd-a3cf-b8aeb0adb73c Jul 08 18:42:17 devstack sudo[95481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:17 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-dc086be7-b2e2-445c-8377-98065be26c20 tempest-VolumeQuotasNegativeTestJSON-239718686 None] Acquiring lock "cinder-0eac39fc-3b9b-4696-bd91-15df5d2f8e7c-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:42:17 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-dc086be7-b2e2-445c-8377-98065be26c20 tempest-VolumeQuotasNegativeTestJSON-239718686 None] Lock "cinder-0eac39fc-3b9b-4696-bd91-15df5d2f8e7c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:42:17 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-dc086be7-b2e2-445c-8377-98065be26c20 tempest-VolumeQuotasNegativeTestJSON-239718686 None] Acquiring lock "cinder-quobyte-0eac39fc-3b9b-4696-bd91-15df5d2f8e7c" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:42:17 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-dc086be7-b2e2-445c-8377-98065be26c20 tempest-VolumeQuotasNegativeTestJSON-239718686 None] Lock "cinder-quobyte-0eac39fc-3b9b-4696-bd91-15df5d2f8e7c" acquired by "delete_volume" :: waited 0.016s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:42:17 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88cdd94-3f6f-4bcd-acf0-d17334b1ab41]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:42:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dc086be7-b2e2-445c-8377-98065be26c20 tempest-VolumeQuotasNegativeTestJSON-239718686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0eac39fc-3b9b-4696-bd91-15df5d2f8e7c {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:17 devstack sudo[95486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0eac39fc-3b9b-4696-bd91-15df5d2f8e7c Jul 08 18:42:17 devstack sudo[95486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:17 devstack sudo[95479]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c611e097-7c9b-43b5-b812-800b66625cdf_u37pug9adevstack@QuobyteHD" returned: 0 in 1.067s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c611e097-7c9b-43b5-b812-800b66625cdf_u37pug9adevstack@QuobyteHD {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:17 devstack sudo[95490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c611e097-7c9b-43b5-b812-800b66625cdf_u37pug9adevstack@QuobyteHD Jul 08 18:42:17 devstack sudo[95490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:17 devstack sudo[95481]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dc7450db-7fd2-42f8-a563-d1de02949399 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-10cdd6f0-aaea-4bdd-a3cf-b8aeb0adb73c" returned: 0 in 1.031s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dc7450db-7fd2-42f8-a563-d1de02949399 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-10cdd6f0-aaea-4bdd-a3cf-b8aeb0adb73c {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:18 devstack sudo[95495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-10cdd6f0-aaea-4bdd-a3cf-b8aeb0adb73c Jul 08 18:42:18 devstack sudo[95495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:18 devstack sudo[95486]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dc086be7-b2e2-445c-8377-98065be26c20 tempest-VolumeQuotasNegativeTestJSON-239718686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0eac39fc-3b9b-4696-bd91-15df5d2f8e7c" returned: 0 in 0.893s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dc086be7-b2e2-445c-8377-98065be26c20 tempest-VolumeQuotasNegativeTestJSON-239718686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0eac39fc-3b9b-4696-bd91-15df5d2f8e7c {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:18 devstack sudo[95500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0eac39fc-3b9b-4696-bd91-15df5d2f8e7c Jul 08 18:42:18 devstack sudo[95500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:18 devstack sudo[95490]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c611e097-7c9b-43b5-b812-800b66625cdf_u37pug9adevstack@QuobyteHD" returned: 1 in 0.873s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c611e097-7c9b-43b5-b812-800b66625cdf_u37pug9adevstack@QuobyteHD' failed. Not Retrying. {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:42:18 devstack cinder-volume[86873]: DEBUG cinder.image.image_utils [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] Temporary image c611e097-7c9b-43b5-b812-800b66625cdf is fetched for user 7d1555821b884d209586b86d1b6ef6fe. {{(pid=86873) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 18:42:18 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[32de4d09-e7a4-410d-896b-55515b5e0e59]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:42:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c611e097-7c9b-43b5-b812-800b66625cdf_u37pug9adevstack@QuobyteHD {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:18 devstack sudo[95495]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dc7450db-7fd2-42f8-a563-d1de02949399 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-10cdd6f0-aaea-4bdd-a3cf-b8aeb0adb73c" returned: 0 in 0.772s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:18 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-dc7450db-7fd2-42f8-a563-d1de02949399 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Lock "cinder-quobyte-10cdd6f0-aaea-4bdd-a3cf-b8aeb0adb73c" released by "delete_volume" :: held 1.883s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:42:18 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-dc7450db-7fd2-42f8-a563-d1de02949399 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Created reservations ['c130a742-a950-4b64-9990-0923f091d4d2', '8c5c188c-3047-4a96-b07d-87ca6713b7ae', '0dc2ea83-74e5-44b9-9f80-46f4499287d0', 'f9766c45-0a57-4cf8-9617-e91d7a4fe11a'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:42:18 devstack sudo[95506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c611e097-7c9b-43b5-b812-800b66625cdf_u37pug9adevstack@QuobyteHD Jul 08 18:42:18 devstack sudo[95506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-dc7450db-7fd2-42f8-a563-d1de02949399 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:42:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-dc7450db-7fd2-42f8-a563-d1de02949399 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:42:18 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-dc7450db-7fd2-42f8-a563-d1de02949399 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:42:18 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-dc7450db-7fd2-42f8-a563-d1de02949399 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:42:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-dc7450db-7fd2-42f8-a563-d1de02949399 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:42:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dc7450db-7fd2-42f8-a563-d1de02949399 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:18 devstack sudo[95508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:42:18 devstack sudo[95508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:19 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-25955b22-feca-42dd-be5c-ecefb5fd4a95 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Acquiring lock "cinder-bc46e021-2951-4087-87fe-3d632b0ced48-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:42:19 devstack sudo[95500]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:19 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dc086be7-b2e2-445c-8377-98065be26c20 tempest-VolumeQuotasNegativeTestJSON-239718686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0eac39fc-3b9b-4696-bd91-15df5d2f8e7c" returned: 0 in 0.840s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:19 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-25955b22-feca-42dd-be5c-ecefb5fd4a95 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Lock "cinder-bc46e021-2951-4087-87fe-3d632b0ced48-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:42:19 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-dc086be7-b2e2-445c-8377-98065be26c20 tempest-VolumeQuotasNegativeTestJSON-239718686 None] Lock "cinder-quobyte-0eac39fc-3b9b-4696-bd91-15df5d2f8e7c" released by "delete_volume" :: held 1.815s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:42:19 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-25955b22-feca-42dd-be5c-ecefb5fd4a95 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Acquiring lock "cinder-quobyte-bc46e021-2951-4087-87fe-3d632b0ced48" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:42:19 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-dc086be7-b2e2-445c-8377-98065be26c20 tempest-VolumeQuotasNegativeTestJSON-239718686 None] Created reservations ['0bcdf641-f488-41a3-92fe-4ff82f788fa4', 'b1115ef6-848b-4cfe-91f1-59e178beea4e', 'f1905bfe-454d-4df4-833f-a066c9e19673', 'd87f5fbf-af89-46cd-88ad-710f49e1dac0'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:42:19 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-25955b22-feca-42dd-be5c-ecefb5fd4a95 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Lock "cinder-quobyte-bc46e021-2951-4087-87fe-3d632b0ced48" acquired by "delete_volume" :: waited 0.033s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:42:19 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbbcc75d-4aa4-4b28-8ecd-88a3b90d7239]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:42:19 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-25955b22-feca-42dd-be5c-ecefb5fd4a95 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bc46e021-2951-4087-87fe-3d632b0ced48 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:19 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-dc086be7-b2e2-445c-8377-98065be26c20 tempest-VolumeQuotasNegativeTestJSON-239718686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:42:19 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-dc086be7-b2e2-445c-8377-98065be26c20 tempest-VolumeQuotasNegativeTestJSON-239718686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:42:19 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-dc086be7-b2e2-445c-8377-98065be26c20 tempest-VolumeQuotasNegativeTestJSON-239718686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:42:19 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-dc086be7-b2e2-445c-8377-98065be26c20 tempest-VolumeQuotasNegativeTestJSON-239718686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:42:19 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-dc086be7-b2e2-445c-8377-98065be26c20 tempest-VolumeQuotasNegativeTestJSON-239718686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:42:19 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dc086be7-b2e2-445c-8377-98065be26c20 tempest-VolumeQuotasNegativeTestJSON-239718686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:19 devstack sudo[95512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:42:19 devstack sudo[95512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:19 devstack sudo[95511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bc46e021-2951-4087-87fe-3d632b0ced48 Jul 08 18:42:19 devstack sudo[95511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:19 devstack sudo[95506]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:19 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c611e097-7c9b-43b5-b812-800b66625cdf_u37pug9adevstack@QuobyteHD" returned: 0 in 0.925s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:19 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c611e097-7c9b-43b5-b812-800b66625cdf_u37pug9adevstack@QuobyteHD {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:19 devstack sudo[95508]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:19 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dc7450db-7fd2-42f8-a563-d1de02949399 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.814s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:19 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-dc7450db-7fd2-42f8-a563-d1de02949399 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:42:19 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-dc7450db-7fd2-42f8-a563-d1de02949399 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Deleted volume successfully. Jul 08 18:42:19 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-dc7450db-7fd2-42f8-a563-d1de02949399 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Lock "cinder-10cdd6f0-aaea-4bdd-a3cf-b8aeb0adb73c-delete_volume" released by "delete_volume" :: held 2.978s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:42:19 devstack sudo[95518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c611e097-7c9b-43b5-b812-800b66625cdf_u37pug9adevstack@QuobyteHD Jul 08 18:42:19 devstack sudo[95518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:20 devstack sudo[95512]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dc086be7-b2e2-445c-8377-98065be26c20 tempest-VolumeQuotasNegativeTestJSON-239718686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.888s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:20 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-dc086be7-b2e2-445c-8377-98065be26c20 tempest-VolumeQuotasNegativeTestJSON-239718686 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:42:20 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-dc086be7-b2e2-445c-8377-98065be26c20 tempest-VolumeQuotasNegativeTestJSON-239718686 None] Deleted volume successfully. Jul 08 18:42:20 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-dc086be7-b2e2-445c-8377-98065be26c20 tempest-VolumeQuotasNegativeTestJSON-239718686 None] Lock "cinder-0eac39fc-3b9b-4696-bd91-15df5d2f8e7c-delete_volume" released by "delete_volume" :: held 3.011s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:42:20 devstack sudo[95511]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-25955b22-feca-42dd-be5c-ecefb5fd4a95 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bc46e021-2951-4087-87fe-3d632b0ced48" returned: 0 in 1.180s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-25955b22-feca-42dd-be5c-ecefb5fd4a95 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bc46e021-2951-4087-87fe-3d632b0ced48 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:20 devstack sudo[95527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bc46e021-2951-4087-87fe-3d632b0ced48 Jul 08 18:42:20 devstack sudo[95527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:20 devstack sudo[95518]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c611e097-7c9b-43b5-b812-800b66625cdf_u37pug9adevstack@QuobyteHD" returned: 1 in 0.854s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c611e097-7c9b-43b5-b812-800b66625cdf_u37pug9adevstack@QuobyteHD' failed. Not Retrying. {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:42:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:42:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:42:20 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:42:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f30366b-9ee2-45e6-9baa-5cd4471ed65d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4e280fb2cb2481a8eb38bb47f46691d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:42:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:42:16Z,use_quota=True,user_id='7d1555821b884d209586b86d1b6ef6fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:42:20 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] Creating volume 8f30366b-9ee2-45e6-9baa-5cd4471ed65d {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:42:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:42:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:42:20 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:42:20 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:42:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:42:20 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:42:20 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:42:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8f30366b-9ee2-45e6-9baa-5cd4471ed65d 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:20 devstack sudo[95529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8f30366b-9ee2-45e6-9baa-5cd4471ed65d 1073741824 Jul 08 18:42:20 devstack sudo[95529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:21 devstack sudo[95527]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-25955b22-feca-42dd-be5c-ecefb5fd4a95 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bc46e021-2951-4087-87fe-3d632b0ced48" returned: 0 in 0.702s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:21 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-25955b22-feca-42dd-be5c-ecefb5fd4a95 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Lock "cinder-quobyte-bc46e021-2951-4087-87fe-3d632b0ced48" released by "delete_volume" :: held 1.933s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:42:21 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-25955b22-feca-42dd-be5c-ecefb5fd4a95 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Created reservations ['721afa50-3eac-4c82-9544-c9100b32207f', '6295a6de-0870-480e-bf5d-b5e19ccc9082', 'b54aae39-5e95-440f-ab55-ecb689aefc8e', '2ba48d75-632e-437a-a9ad-adc4ea8bb3df'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:42:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-25955b22-feca-42dd-be5c-ecefb5fd4a95 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:42:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-25955b22-feca-42dd-be5c-ecefb5fd4a95 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:42:21 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-25955b22-feca-42dd-be5c-ecefb5fd4a95 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:42:21 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-25955b22-feca-42dd-be5c-ecefb5fd4a95 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:42:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-25955b22-feca-42dd-be5c-ecefb5fd4a95 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:42:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-25955b22-feca-42dd-be5c-ecefb5fd4a95 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:21 devstack sudo[95536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:42:21 devstack sudo[95536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:21 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-2916e5ad-17b4-4f38-928a-88b337e50693 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Acquiring lock "cinder-fd116989-243b-4852-b44b-43f98c364453-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:42:21 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-2916e5ad-17b4-4f38-928a-88b337e50693 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Lock "cinder-fd116989-243b-4852-b44b-43f98c364453-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:42:21 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-2916e5ad-17b4-4f38-928a-88b337e50693 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Acquiring lock "cinder-quobyte-fd116989-243b-4852-b44b-43f98c364453" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:42:21 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-2916e5ad-17b4-4f38-928a-88b337e50693 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Lock "cinder-quobyte-fd116989-243b-4852-b44b-43f98c364453" acquired by "delete_volume" :: waited 0.019s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:42:21 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[786417b5-ce8a-4054-a8db-0cbf6cf829e5]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:42:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2916e5ad-17b4-4f38-928a-88b337e50693 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-fd116989-243b-4852-b44b-43f98c364453 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:21 devstack sudo[95529]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8f30366b-9ee2-45e6-9baa-5cd4471ed65d 1073741824" returned: 0 in 1.158s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8f30366b-9ee2-45e6-9baa-5cd4471ed65d {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:21 devstack sudo[95539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8f30366b-9ee2-45e6-9baa-5cd4471ed65d Jul 08 18:42:21 devstack sudo[95539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:21 devstack sudo[95538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-fd116989-243b-4852-b44b-43f98c364453 Jul 08 18:42:21 devstack sudo[95538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:22 devstack sudo[95536]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-25955b22-feca-42dd-be5c-ecefb5fd4a95 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.810s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:22 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-25955b22-feca-42dd-be5c-ecefb5fd4a95 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:42:22 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-25955b22-feca-42dd-be5c-ecefb5fd4a95 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Deleted volume successfully. Jul 08 18:42:22 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-25955b22-feca-42dd-be5c-ecefb5fd4a95 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Lock "cinder-bc46e021-2951-4087-87fe-3d632b0ced48-delete_volume" released by "delete_volume" :: held 3.073s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:42:22 devstack sudo[95538]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2916e5ad-17b4-4f38-928a-88b337e50693 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-fd116989-243b-4852-b44b-43f98c364453" returned: 0 in 0.954s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2916e5ad-17b4-4f38-928a-88b337e50693 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-fd116989-243b-4852-b44b-43f98c364453 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:22 devstack sudo[95548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-fd116989-243b-4852-b44b-43f98c364453 Jul 08 18:42:22 devstack sudo[95548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:22 devstack sudo[95539]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8f30366b-9ee2-45e6-9baa-5cd4471ed65d" returned: 0 in 1.038s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:22 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] <== create_volume: return (2250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:42:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.254s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:42:22 devstack cinder-volume[86873]: DEBUG cinder.volume.volume_utils [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] Attempting download of c611e097-7c9b-43b5-b812-800b66625cdf ((None, [{'url': 'file:///opt/stack/data/glance/images/c611e097-7c9b-43b5-b812-800b66625cdf', 'metadata': {}}])) to volume 8f30366b-9ee2-45e6-9baa-5cd4471ed65d. {{(pid=86873) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 18:42:22 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a555e88-4a32-4678-81a0-0a76c606ec34]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:42:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c611e097-7c9b-43b5-b812-800b66625cdf_hvrogru3 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:23 devstack sudo[95550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c611e097-7c9b-43b5-b812-800b66625cdf_hvrogru3 Jul 08 18:42:23 devstack sudo[95550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:23 devstack sudo[95548]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2916e5ad-17b4-4f38-928a-88b337e50693 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-fd116989-243b-4852-b44b-43f98c364453" returned: 0 in 0.804s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:23 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-2916e5ad-17b4-4f38-928a-88b337e50693 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Lock "cinder-quobyte-fd116989-243b-4852-b44b-43f98c364453" released by "delete_volume" :: held 1.853s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:42:23 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-2916e5ad-17b4-4f38-928a-88b337e50693 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Created reservations ['6d81e962-abcd-43e2-94cb-b877443dd139', 'b2a751c7-871e-46e1-9b4c-e1ada81a1d02', '2ebbe3a4-3c9c-4c87-a3ba-6832b00b828c', '10290e03-4acc-4009-8b7e-d80cf241ee2f'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:42:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-2916e5ad-17b4-4f38-928a-88b337e50693 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:42:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-2916e5ad-17b4-4f38-928a-88b337e50693 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:42:23 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-2916e5ad-17b4-4f38-928a-88b337e50693 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:42:23 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-2916e5ad-17b4-4f38-928a-88b337e50693 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:42:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-2916e5ad-17b4-4f38-928a-88b337e50693 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:42:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2916e5ad-17b4-4f38-928a-88b337e50693 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:23 devstack sudo[95555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:42:23 devstack sudo[95555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:23 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-615bd53f-e2ce-4baf-8c32-db7048bfaa31 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Acquiring lock "cinder-644032e8-e91e-453a-ba03-3db70d5fa6ae-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:42:23 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-615bd53f-e2ce-4baf-8c32-db7048bfaa31 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Lock "cinder-644032e8-e91e-453a-ba03-3db70d5fa6ae-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:42:23 devstack sudo[95550]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c611e097-7c9b-43b5-b812-800b66625cdf_hvrogru3" returned: 0 in 1.045s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c611e097-7c9b-43b5-b812-800b66625cdf_hvrogru3 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:23 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:SELECT=100,cinder:INSERT=30,cinder:UPDATE=135,cinder:DELETE=14 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:42:24 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-615bd53f-e2ce-4baf-8c32-db7048bfaa31 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Acquiring lock "cinder-quobyte-644032e8-e91e-453a-ba03-3db70d5fa6ae" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:42:24 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-615bd53f-e2ce-4baf-8c32-db7048bfaa31 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Lock "cinder-quobyte-644032e8-e91e-453a-ba03-3db70d5fa6ae" acquired by "delete_volume" :: waited 0.064s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:42:24 devstack sudo[95557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c611e097-7c9b-43b5-b812-800b66625cdf_hvrogru3 Jul 08 18:42:24 devstack sudo[95557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:24 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92b6632-c203-4ba2-818b-388bf9d16e29]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:42:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-615bd53f-e2ce-4baf-8c32-db7048bfaa31 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-644032e8-e91e-453a-ba03-3db70d5fa6ae {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:24 devstack sudo[95559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-644032e8-e91e-453a-ba03-3db70d5fa6ae Jul 08 18:42:24 devstack sudo[95559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:25 devstack sudo[95555]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2916e5ad-17b4-4f38-928a-88b337e50693 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 1.279s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:25 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-2916e5ad-17b4-4f38-928a-88b337e50693 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:42:25 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-2916e5ad-17b4-4f38-928a-88b337e50693 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Deleted volume successfully. Jul 08 18:42:25 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-2916e5ad-17b4-4f38-928a-88b337e50693 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Lock "cinder-fd116989-243b-4852-b44b-43f98c364453-delete_volume" released by "delete_volume" :: held 3.635s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:42:25 devstack sudo[95559]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-615bd53f-e2ce-4baf-8c32-db7048bfaa31 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-644032e8-e91e-453a-ba03-3db70d5fa6ae" returned: 0 in 1.098s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-615bd53f-e2ce-4baf-8c32-db7048bfaa31 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-644032e8-e91e-453a-ba03-3db70d5fa6ae {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:25 devstack sudo[95578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-644032e8-e91e-453a-ba03-3db70d5fa6ae Jul 08 18:42:25 devstack sudo[95578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:25 devstack sudo[95557]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c611e097-7c9b-43b5-b812-800b66625cdf_hvrogru3" returned: 1 in 1.389s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c611e097-7c9b-43b5-b812-800b66625cdf_hvrogru3' failed. Not Retrying. {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:42:25 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb24d06b-bafb-4d75-a5ef-28b8cd5878f0]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:42:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c611e097-7c9b-43b5-b812-800b66625cdf_u37pug9adevstack@QuobyteHD {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:25 devstack sudo[95580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c611e097-7c9b-43b5-b812-800b66625cdf_u37pug9adevstack@QuobyteHD Jul 08 18:42:25 devstack sudo[95580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:26 devstack sudo[95578]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-615bd53f-e2ce-4baf-8c32-db7048bfaa31 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-644032e8-e91e-453a-ba03-3db70d5fa6ae" returned: 0 in 1.000s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:26 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-615bd53f-e2ce-4baf-8c32-db7048bfaa31 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Lock "cinder-quobyte-644032e8-e91e-453a-ba03-3db70d5fa6ae" released by "delete_volume" :: held 2.178s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:42:26 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-615bd53f-e2ce-4baf-8c32-db7048bfaa31 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Created reservations ['dbbb6eca-6fcd-4d54-8245-6ab4872175fc', '894079c5-c541-444d-9383-bb08d610143a', '811fa9b9-410d-42df-88ba-fc922334da80', '84ec3334-866a-486a-93e2-f563458194d2'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:42:26 devstack sudo[95580]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c611e097-7c9b-43b5-b812-800b66625cdf_u37pug9adevstack@QuobyteHD" returned: 0 in 1.035s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c611e097-7c9b-43b5-b812-800b66625cdf_u37pug9adevstack@QuobyteHD {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-615bd53f-e2ce-4baf-8c32-db7048bfaa31 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:42:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-615bd53f-e2ce-4baf-8c32-db7048bfaa31 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:42:26 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-615bd53f-e2ce-4baf-8c32-db7048bfaa31 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:42:26 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-615bd53f-e2ce-4baf-8c32-db7048bfaa31 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:42:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-615bd53f-e2ce-4baf-8c32-db7048bfaa31 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:42:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-615bd53f-e2ce-4baf-8c32-db7048bfaa31 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:26 devstack sudo[95593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:42:26 devstack sudo[95593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:26 devstack sudo[95592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c611e097-7c9b-43b5-b812-800b66625cdf_u37pug9adevstack@QuobyteHD Jul 08 18:42:26 devstack sudo[95592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:27 devstack sudo[95593]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-615bd53f-e2ce-4baf-8c32-db7048bfaa31 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.764s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:27 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-615bd53f-e2ce-4baf-8c32-db7048bfaa31 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:42:27 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-615bd53f-e2ce-4baf-8c32-db7048bfaa31 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Deleted volume successfully. Jul 08 18:42:27 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-6744d929-3772-4e9f-a85f-1f3152679888 tempest-VolumeRetypeWithoutMigrationTest-795621853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:42:27 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6744d929-3772-4e9f-a85f-1f3152679888 tempest-VolumeRetypeWithoutMigrationTest-795621853 None] Flow 'volume_create_manager' (cd6720ab-48d7-4e75-bf32-33762e613fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:42:27 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6744d929-3772-4e9f-a85f-1f3152679888 tempest-VolumeRetypeWithoutMigrationTest-795621853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35eea8fb-62bd-4e5f-8693-63690f004e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:27 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-615bd53f-e2ce-4baf-8c32-db7048bfaa31 tempest-CreateVolumesFromSourceVolumeTest-1658612462 None] Lock "cinder-644032e8-e91e-453a-ba03-3db70d5fa6ae-delete_volume" released by "delete_volume" :: held 3.374s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:42:27 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6744d929-3772-4e9f-a85f-1f3152679888 tempest-VolumeRetypeWithoutMigrationTest-795621853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35eea8fb-62bd-4e5f-8693-63690f004e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:42:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1206428948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1774a3e6-cee2-4e5e-97e2-8512da42dc80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64f20a98007440bebe7bdcc49e512a75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:42:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:42:27Z,use_quota=True,user_id='44c8236cac334ed5bff5863fe7405304',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aac2fd3b-bc0a-40cd-a133-ce44cf82e128),volume_type_id=aac2fd3b-bc0a-40cd-a133-ce44cf82e128)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:27 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6744d929-3772-4e9f-a85f-1f3152679888 tempest-VolumeRetypeWithoutMigrationTest-795621853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e61d303-9b65-41cd-8b8f-ef650c88364b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:27 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6744d929-3772-4e9f-a85f-1f3152679888 tempest-VolumeRetypeWithoutMigrationTest-795621853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e61d303-9b65-41cd-8b8f-ef650c88364b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:27 devstack sudo[95592]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:27 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6744d929-3772-4e9f-a85f-1f3152679888 tempest-VolumeRetypeWithoutMigrationTest-795621853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8698b55-8879-4bce-86cb-dfabcc4ac51e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:27 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6744d929-3772-4e9f-a85f-1f3152679888 tempest-VolumeRetypeWithoutMigrationTest-795621853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8698b55-8879-4bce-86cb-dfabcc4ac51e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1774a3e6-cee2-4e5e-97e2-8512da42dc80', 'volume_name': 'volume-1774a3e6-cee2-4e5e-97e2-8512da42dc80', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:27 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6744d929-3772-4e9f-a85f-1f3152679888 tempest-VolumeRetypeWithoutMigrationTest-795621853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12911c61-e241-4dd0-b2e7-4ed6104cd63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:27 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6744d929-3772-4e9f-a85f-1f3152679888 tempest-VolumeRetypeWithoutMigrationTest-795621853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12911c61-e241-4dd0-b2e7-4ed6104cd63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:27 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6744d929-3772-4e9f-a85f-1f3152679888 tempest-VolumeRetypeWithoutMigrationTest-795621853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e547b148-4f1f-4104-aca0-3f793b2125f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:27 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-6744d929-3772-4e9f-a85f-1f3152679888 tempest-VolumeRetypeWithoutMigrationTest-795621853 None] Volume 1774a3e6-cee2-4e5e-97e2-8512da42dc80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1774a3e6-cee2-4e5e-97e2-8512da42dc80', 'volume_size': 1} Jul 08 18:42:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6744d929-3772-4e9f-a85f-1f3152679888 tempest-VolumeRetypeWithoutMigrationTest-795621853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:42:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6744d929-3772-4e9f-a85f-1f3152679888 tempest-VolumeRetypeWithoutMigrationTest-795621853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:42:27 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-6744d929-3772-4e9f-a85f-1f3152679888 tempest-VolumeRetypeWithoutMigrationTest-795621853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:42:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1206428948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1774a3e6-cee2-4e5e-97e2-8512da42dc80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64f20a98007440bebe7bdcc49e512a75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:42:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:42:27Z,use_quota=True,user_id='44c8236cac334ed5bff5863fe7405304',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aac2fd3b-bc0a-40cd-a133-ce44cf82e128),volume_type_id=aac2fd3b-bc0a-40cd-a133-ce44cf82e128)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:42:27 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-6744d929-3772-4e9f-a85f-1f3152679888 tempest-VolumeRetypeWithoutMigrationTest-795621853 None] Creating volume 1774a3e6-cee2-4e5e-97e2-8512da42dc80 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:42:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6744d929-3772-4e9f-a85f-1f3152679888 tempest-VolumeRetypeWithoutMigrationTest-795621853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:42:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6744d929-3772-4e9f-a85f-1f3152679888 tempest-VolumeRetypeWithoutMigrationTest-795621853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:42:27 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-6744d929-3772-4e9f-a85f-1f3152679888 tempest-VolumeRetypeWithoutMigrationTest-795621853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:42:27 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-6744d929-3772-4e9f-a85f-1f3152679888 tempest-VolumeRetypeWithoutMigrationTest-795621853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:42:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6744d929-3772-4e9f-a85f-1f3152679888 tempest-VolumeRetypeWithoutMigrationTest-795621853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:42:27 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-6744d929-3772-4e9f-a85f-1f3152679888 tempest-VolumeRetypeWithoutMigrationTest-795621853 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:42:27 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-6744d929-3772-4e9f-a85f-1f3152679888 tempest-VolumeRetypeWithoutMigrationTest-795621853 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:42:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6744d929-3772-4e9f-a85f-1f3152679888 tempest-VolumeRetypeWithoutMigrationTest-795621853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-1774a3e6-cee2-4e5e-97e2-8512da42dc80 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c611e097-7c9b-43b5-b812-800b66625cdf_u37pug9adevstack@QuobyteHD" returned: 1 in 1.010s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c611e097-7c9b-43b5-b812-800b66625cdf_u37pug9adevstack@QuobyteHD' failed. Not Retrying. {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:42:27 devstack cinder-volume[86873]: DEBUG cinder.image.image_utils [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] c611e097-7c9b-43b5-b812-800b66625cdf was raw, converting to raw {{(pid=86873) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 18:42:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c611e097-7c9b-43b5-b812-800b66625cdf_u37pug9adevstack@QuobyteHD /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8f30366b-9ee2-45e6-9baa-5cd4471ed65d {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:27 devstack sudo[95600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-1774a3e6-cee2-4e5e-97e2-8512da42dc80 1073741824 Jul 08 18:42:27 devstack sudo[95600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:27 devstack sudo[95601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c611e097-7c9b-43b5-b812-800b66625cdf_u37pug9adevstack@QuobyteHD /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8f30366b-9ee2-45e6-9baa-5cd4471ed65d Jul 08 18:42:27 devstack sudo[95601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:28 devstack sudo[95601]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c611e097-7c9b-43b5-b812-800b66625cdf_u37pug9adevstack@QuobyteHD /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8f30366b-9ee2-45e6-9baa-5cd4471ed65d" returned: 0 in 0.933s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:28 devstack cinder-volume[86873]: DEBUG cinder.image.image_utils [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c611e097-7c9b-43b5-b812-800b66625cdf_u37pug9adevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8f30366b-9ee2-45e6-9baa-5cd4471ed65d {{(pid=86873) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:42:28 devstack cinder-volume[86873]: INFO cinder.image.image_utils [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 18:42:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8f30366b-9ee2-45e6-9baa-5cd4471ed65d 1G {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:28 devstack sudo[95611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8f30366b-9ee2-45e6-9baa-5cd4471ed65d 1G Jul 08 18:42:28 devstack sudo[95611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:28 devstack sudo[95600]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6744d929-3772-4e9f-a85f-1f3152679888 tempest-VolumeRetypeWithoutMigrationTest-795621853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-1774a3e6-cee2-4e5e-97e2-8512da42dc80 1073741824" returned: 0 in 1.071s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6744d929-3772-4e9f-a85f-1f3152679888 tempest-VolumeRetypeWithoutMigrationTest-795621853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-1774a3e6-cee2-4e5e-97e2-8512da42dc80 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:28 devstack sudo[95613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-1774a3e6-cee2-4e5e-97e2-8512da42dc80 Jul 08 18:42:28 devstack sudo[95613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:29 devstack sudo[95611]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8f30366b-9ee2-45e6-9baa-5cd4471ed65d 1G" returned: 0 in 0.846s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:29 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[6457c885-71d9-4b60-9d91-8ff9f129addb]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:42:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8f30366b-9ee2-45e6-9baa-5cd4471ed65d {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:29 devstack sudo[95613]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6744d929-3772-4e9f-a85f-1f3152679888 tempest-VolumeRetypeWithoutMigrationTest-795621853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-1774a3e6-cee2-4e5e-97e2-8512da42dc80" returned: 0 in 0.748s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:29 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-6744d929-3772-4e9f-a85f-1f3152679888 tempest-VolumeRetypeWithoutMigrationTest-795621853 None] <== create_volume: return (1876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:42:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6744d929-3772-4e9f-a85f-1f3152679888 tempest-VolumeRetypeWithoutMigrationTest-795621853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.881s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:42:29 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6744d929-3772-4e9f-a85f-1f3152679888 tempest-VolumeRetypeWithoutMigrationTest-795621853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e547b148-4f1f-4104-aca0-3f793b2125f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1774a3e6-cee2-4e5e-97e2-8512da42dc80', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:29 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6744d929-3772-4e9f-a85f-1f3152679888 tempest-VolumeRetypeWithoutMigrationTest-795621853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa476e86-b808-4685-b6a0-c8848b947911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:29 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-6744d929-3772-4e9f-a85f-1f3152679888 tempest-VolumeRetypeWithoutMigrationTest-795621853 None] Volume volume-1774a3e6-cee2-4e5e-97e2-8512da42dc80 (1774a3e6-cee2-4e5e-97e2-8512da42dc80): created successfully Jul 08 18:42:29 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6744d929-3772-4e9f-a85f-1f3152679888 tempest-VolumeRetypeWithoutMigrationTest-795621853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa476e86-b808-4685-b6a0-c8848b947911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:29 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6744d929-3772-4e9f-a85f-1f3152679888 tempest-VolumeRetypeWithoutMigrationTest-795621853 None] Flow 'volume_create_manager' (cd6720ab-48d7-4e75-bf32-33762e613fec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:42:29 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-6744d929-3772-4e9f-a85f-1f3152679888 tempest-VolumeRetypeWithoutMigrationTest-795621853 None] Created volume successfully. Jul 08 18:42:29 devstack sudo[95619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8f30366b-9ee2-45e6-9baa-5cd4471ed65d Jul 08 18:42:29 devstack sudo[95619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:30 devstack sudo[95619]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8f30366b-9ee2-45e6-9baa-5cd4471ed65d" returned: 0 in 0.899s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8f30366b-9ee2-45e6-9baa-5cd4471ed65d {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:30 devstack sudo[95654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8f30366b-9ee2-45e6-9baa-5cd4471ed65d Jul 08 18:42:30 devstack sudo[95654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-4f43cbb3-a48e-4619-99b9-d166e9ea7e4f tempest-VolumeRetypeWithoutMigrationTest-795621853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:42:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-4f43cbb3-a48e-4619-99b9-d166e9ea7e4f tempest-VolumeRetypeWithoutMigrationTest-795621853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:42:31 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-4f43cbb3-a48e-4619-99b9-d166e9ea7e4f tempest-VolumeRetypeWithoutMigrationTest-795621853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:42:31 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-4f43cbb3-a48e-4619-99b9-d166e9ea7e4f tempest-VolumeRetypeWithoutMigrationTest-795621853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:42:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-4f43cbb3-a48e-4619-99b9-d166e9ea7e4f tempest-VolumeRetypeWithoutMigrationTest-795621853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:42:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-4f43cbb3-a48e-4619-99b9-d166e9ea7e4f tempest-VolumeRetypeWithoutMigrationTest-795621853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:31 devstack sudo[95677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:42:31 devstack sudo[95677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:31 devstack sudo[95654]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8f30366b-9ee2-45e6-9baa-5cd4471ed65d" returned: 1 in 1.068s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8f30366b-9ee2-45e6-9baa-5cd4471ed65d' failed. Not Retrying. {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:42:31 devstack cinder-volume[86873]: DEBUG cinder.volume.volume_utils [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] Downloaded image c611e097-7c9b-43b5-b812-800b66625cdf ((None, [{'url': 'file:///opt/stack/data/glance/images/c611e097-7c9b-43b5-b812-800b66625cdf', 'metadata': {}}])) to volume 8f30366b-9ee2-45e6-9baa-5cd4471ed65d successfully. {{(pid=86873) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 18:42:31 devstack cinder-volume[86873]: DEBUG cinder.image.image_utils [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] Temporary image c611e097-7c9b-43b5-b812-800b66625cdf for user 7d1555821b884d209586b86d1b6ef6fe is deleted. {{(pid=86873) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 18:42:31 devstack cinder-volume[86873]: DEBUG cinder.volume.volume_utils [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] Marking volume 8f30366b-9ee2-45e6-9baa-5cd4471ed65d as bootable. {{(pid=86873) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 18:42:31 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] Copying metadata from image c611e097-7c9b-43b5-b812-800b66625cdf to 8f30366b-9ee2-45e6-9baa-5cd4471ed65d. {{(pid=86873) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 18:42:31 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] Creating volume glance metadata for volume 8f30366b-9ee2-45e6-9baa-5cd4471ed65d backed by image c611e097-7c9b-43b5-b812-800b66625cdf with: {'image_id': 'c611e097-7c9b-43b5-b812-800b66625cdf', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '0506760ab4d4eb42d697b1e7db2b2f91', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86873) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 18:42:31 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (179ae1d9-e9af-4574-ab08-4662a6f0017e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f30366b-9ee2-45e6-9baa-5cd4471ed65d', 'volume_size': 1, 'image_id': 'c611e097-7c9b-43b5-b812-800b66625cdf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c611e097-7c9b-43b5-b812-800b66625cdf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0506760ab4d4eb42d697b1e7db2b2f91', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b4e280fb2cb2481a8eb38bb47f46691d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b3ea9292064b28c981f56e0f24a1591be122e4445d02dafd606cc61f8d16fc4595c2bd05f238891f07c081314dd46674854a1a877c205cfa907348350bb486e5', 'id': 'c611e097-7c9b-43b5-b812-800b66625cdf', 'created_at': datetime.datetime(2026, 7, 8, 16, 42, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 42, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c611e097-7c9b-43b5-b812-800b66625cdf/file', 'properties': {}}, 'image_service': }' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:31 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f9a70c7-038a-41e7-a80b-02d84e457e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:31 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] Volume volume-8f30366b-9ee2-45e6-9baa-5cd4471ed65d (8f30366b-9ee2-45e6-9baa-5cd4471ed65d): created successfully Jul 08 18:42:31 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f9a70c7-038a-41e7-a80b-02d84e457e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:31 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] Flow 'volume_create_manager' (e2491f9a-bb03-4815-a594-ae35b9711e0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:42:31 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-824bf1f1-aafb-4ee8-a469-0578f9b9eeaa tempest-VolumeImageDependencyTests-192005671 None] Created volume successfully. Jul 08 18:42:31 devstack sudo[95677]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-4f43cbb3-a48e-4619-99b9-d166e9ea7e4f tempest-VolumeRetypeWithoutMigrationTest-795621853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.701s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:31 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-4f43cbb3-a48e-4619-99b9-d166e9ea7e4f tempest-VolumeRetypeWithoutMigrationTest-795621853 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:42:31 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-4f43cbb3-a48e-4619-99b9-d166e9ea7e4f tempest-VolumeRetypeWithoutMigrationTest-795621853 None] Retype volume completed successfully. Jul 08 18:42:32 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-58a1bcb1-36d7-4a2f-9811-b204d7645780 tempest-VolumeRetypeWithoutMigrationTest-795621853 None] Acquiring lock "cinder-1774a3e6-cee2-4e5e-97e2-8512da42dc80-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:42:32 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-58a1bcb1-36d7-4a2f-9811-b204d7645780 tempest-VolumeRetypeWithoutMigrationTest-795621853 None] Lock "cinder-1774a3e6-cee2-4e5e-97e2-8512da42dc80-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:42:32 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-58a1bcb1-36d7-4a2f-9811-b204d7645780 tempest-VolumeRetypeWithoutMigrationTest-795621853 None] Acquiring lock "cinder-quobyte-1774a3e6-cee2-4e5e-97e2-8512da42dc80" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:42:32 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-cb112253-1c9c-4bd6-8925-7dd003f325c8 tempest-VolumeImageDependencyTests-192005671 None] Acquiring lock "cinder-8f30366b-9ee2-45e6-9baa-5cd4471ed65d-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:42:32 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-58a1bcb1-36d7-4a2f-9811-b204d7645780 tempest-VolumeRetypeWithoutMigrationTest-795621853 None] Lock "cinder-quobyte-1774a3e6-cee2-4e5e-97e2-8512da42dc80" acquired by "delete_volume" :: waited 0.036s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:42:32 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-cb112253-1c9c-4bd6-8925-7dd003f325c8 tempest-VolumeImageDependencyTests-192005671 None] Lock "cinder-8f30366b-9ee2-45e6-9baa-5cd4471ed65d-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:42:32 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8fe542-2805-4ad3-bcf6-485d60d25cb6]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:42:32 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-58a1bcb1-36d7-4a2f-9811-b204d7645780 tempest-VolumeRetypeWithoutMigrationTest-795621853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-1774a3e6-cee2-4e5e-97e2-8512da42dc80 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:32 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-cb112253-1c9c-4bd6-8925-7dd003f325c8 tempest-VolumeImageDependencyTests-192005671 None] Acquiring lock "cinder-quobyte-8f30366b-9ee2-45e6-9baa-5cd4471ed65d" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:42:32 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-cb112253-1c9c-4bd6-8925-7dd003f325c8 tempest-VolumeImageDependencyTests-192005671 None] Lock "cinder-quobyte-8f30366b-9ee2-45e6-9baa-5cd4471ed65d" acquired by "delete_volume" :: waited 0.028s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:42:32 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef2bab8-625f-45d1-ac1d-dec57c380262]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:42:32 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-cb112253-1c9c-4bd6-8925-7dd003f325c8 tempest-VolumeImageDependencyTests-192005671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8f30366b-9ee2-45e6-9baa-5cd4471ed65d {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:32 devstack sudo[95700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-1774a3e6-cee2-4e5e-97e2-8512da42dc80 Jul 08 18:42:32 devstack sudo[95700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:32 devstack sudo[95703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8f30366b-9ee2-45e6-9baa-5cd4471ed65d Jul 08 18:42:32 devstack sudo[95703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:33 devstack sudo[95700]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-58a1bcb1-36d7-4a2f-9811-b204d7645780 tempest-VolumeRetypeWithoutMigrationTest-795621853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-1774a3e6-cee2-4e5e-97e2-8512da42dc80" returned: 0 in 0.986s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-58a1bcb1-36d7-4a2f-9811-b204d7645780 tempest-VolumeRetypeWithoutMigrationTest-795621853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-1774a3e6-cee2-4e5e-97e2-8512da42dc80 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:33 devstack sudo[95712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-1774a3e6-cee2-4e5e-97e2-8512da42dc80 Jul 08 18:42:33 devstack sudo[95712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:33 devstack sudo[95703]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-cb112253-1c9c-4bd6-8925-7dd003f325c8 tempest-VolumeImageDependencyTests-192005671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8f30366b-9ee2-45e6-9baa-5cd4471ed65d" returned: 0 in 0.882s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-cb112253-1c9c-4bd6-8925-7dd003f325c8 tempest-VolumeImageDependencyTests-192005671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8f30366b-9ee2-45e6-9baa-5cd4471ed65d {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:33 devstack sudo[95714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8f30366b-9ee2-45e6-9baa-5cd4471ed65d Jul 08 18:42:33 devstack sudo[95714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:34 devstack sudo[95712]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-58a1bcb1-36d7-4a2f-9811-b204d7645780 tempest-VolumeRetypeWithoutMigrationTest-795621853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-1774a3e6-cee2-4e5e-97e2-8512da42dc80" returned: 0 in 0.793s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:34 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-58a1bcb1-36d7-4a2f-9811-b204d7645780 tempest-VolumeRetypeWithoutMigrationTest-795621853 None] Lock "cinder-quobyte-1774a3e6-cee2-4e5e-97e2-8512da42dc80" released by "delete_volume" :: held 1.829s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:42:34 devstack cinder-volume[86873]: WARNING cinder.quota [None req-58a1bcb1-36d7-4a2f-9811-b204d7645780 tempest-VolumeRetypeWithoutMigrationTest-795621853 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:42:34 devstack cinder-volume[86873]: WARNING cinder.quota [None req-58a1bcb1-36d7-4a2f-9811-b204d7645780 tempest-VolumeRetypeWithoutMigrationTest-795621853 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:42:34 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-58a1bcb1-36d7-4a2f-9811-b204d7645780 tempest-VolumeRetypeWithoutMigrationTest-795621853 None] Created reservations ['2f667482-ca63-4bb4-80ee-900eb39c071c', '30e402f1-4f29-4eaa-980a-7918b8856aec', '001bda75-55e2-462f-9a4c-72175f1d3089', '1d1a048a-f749-4ac0-8e45-2599cbf83265'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:42:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-58a1bcb1-36d7-4a2f-9811-b204d7645780 tempest-VolumeRetypeWithoutMigrationTest-795621853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:42:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-58a1bcb1-36d7-4a2f-9811-b204d7645780 tempest-VolumeRetypeWithoutMigrationTest-795621853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:42:34 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-58a1bcb1-36d7-4a2f-9811-b204d7645780 tempest-VolumeRetypeWithoutMigrationTest-795621853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:42:34 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-58a1bcb1-36d7-4a2f-9811-b204d7645780 tempest-VolumeRetypeWithoutMigrationTest-795621853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:42:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-58a1bcb1-36d7-4a2f-9811-b204d7645780 tempest-VolumeRetypeWithoutMigrationTest-795621853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:42:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-58a1bcb1-36d7-4a2f-9811-b204d7645780 tempest-VolumeRetypeWithoutMigrationTest-795621853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:34 devstack sudo[95714]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-cb112253-1c9c-4bd6-8925-7dd003f325c8 tempest-VolumeImageDependencyTests-192005671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8f30366b-9ee2-45e6-9baa-5cd4471ed65d" returned: 1 in 0.919s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-cb112253-1c9c-4bd6-8925-7dd003f325c8 tempest-VolumeImageDependencyTests-192005671 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8f30366b-9ee2-45e6-9baa-5cd4471ed65d' failed. Not Retrying. {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:42:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-cb112253-1c9c-4bd6-8925-7dd003f325c8 tempest-VolumeImageDependencyTests-192005671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8f30366b-9ee2-45e6-9baa-5cd4471ed65d {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:34 devstack sudo[95720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:42:34 devstack sudo[95720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:34 devstack sudo[95721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8f30366b-9ee2-45e6-9baa-5cd4471ed65d Jul 08 18:42:34 devstack sudo[95721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:35 devstack sudo[95720]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-58a1bcb1-36d7-4a2f-9811-b204d7645780 tempest-VolumeRetypeWithoutMigrationTest-795621853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 1.074s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:35 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-58a1bcb1-36d7-4a2f-9811-b204d7645780 tempest-VolumeRetypeWithoutMigrationTest-795621853 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:42:35 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-58a1bcb1-36d7-4a2f-9811-b204d7645780 tempest-VolumeRetypeWithoutMigrationTest-795621853 None] Deleted volume successfully. Jul 08 18:42:35 devstack sudo[95721]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-cb112253-1c9c-4bd6-8925-7dd003f325c8 tempest-VolumeImageDependencyTests-192005671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8f30366b-9ee2-45e6-9baa-5cd4471ed65d" returned: 0 in 1.092s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:35 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-cb112253-1c9c-4bd6-8925-7dd003f325c8 tempest-VolumeImageDependencyTests-192005671 None] Lock "cinder-quobyte-8f30366b-9ee2-45e6-9baa-5cd4471ed65d" released by "delete_volume" :: held 2.995s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:42:35 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-58a1bcb1-36d7-4a2f-9811-b204d7645780 tempest-VolumeRetypeWithoutMigrationTest-795621853 None] Lock "cinder-1774a3e6-cee2-4e5e-97e2-8512da42dc80-delete_volume" released by "delete_volume" :: held 3.256s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:42:35 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-cb112253-1c9c-4bd6-8925-7dd003f325c8 tempest-VolumeImageDependencyTests-192005671 None] Created reservations ['5a8230db-f2c0-4652-8c5c-c3763e9baa28', '90178a50-1d2b-4828-8fb4-3576b908be8b', '4d57e507-1ba8-490a-a3b9-0ac3c9d8fb12', '388d4c53-7f14-4d63-8b1f-3f24b1eb78dd'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:42:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-cb112253-1c9c-4bd6-8925-7dd003f325c8 tempest-VolumeImageDependencyTests-192005671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:42:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-cb112253-1c9c-4bd6-8925-7dd003f325c8 tempest-VolumeImageDependencyTests-192005671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:42:35 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-cb112253-1c9c-4bd6-8925-7dd003f325c8 tempest-VolumeImageDependencyTests-192005671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:42:35 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-cb112253-1c9c-4bd6-8925-7dd003f325c8 tempest-VolumeImageDependencyTests-192005671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:42:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-cb112253-1c9c-4bd6-8925-7dd003f325c8 tempest-VolumeImageDependencyTests-192005671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:42:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-cb112253-1c9c-4bd6-8925-7dd003f325c8 tempest-VolumeImageDependencyTests-192005671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:35 devstack sudo[95726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:42:35 devstack sudo[95726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:36 devstack sudo[95726]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-cb112253-1c9c-4bd6-8925-7dd003f325c8 tempest-VolumeImageDependencyTests-192005671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 1.024s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:36 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-cb112253-1c9c-4bd6-8925-7dd003f325c8 tempest-VolumeImageDependencyTests-192005671 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:42:36 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-cb112253-1c9c-4bd6-8925-7dd003f325c8 tempest-VolumeImageDependencyTests-192005671 None] Deleted volume successfully. Jul 08 18:42:36 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-cb112253-1c9c-4bd6-8925-7dd003f325c8 tempest-VolumeImageDependencyTests-192005671 None] Lock "cinder-8f30366b-9ee2-45e6-9baa-5cd4471ed65d-delete_volume" released by "delete_volume" :: held 4.408s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:42:41 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0e8ae24-f9a3-42e6-80be-749d6a51c0a6 tempest-ProjectReaderTests-11105876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:42:41 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f0e8ae24-f9a3-42e6-80be-749d6a51c0a6 tempest-ProjectReaderTests-11105876 None] Flow 'volume_create_manager' (cad94d37-1d93-49c9-8627-16b8bb3b3d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:42:41 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f0e8ae24-f9a3-42e6-80be-749d6a51c0a6 tempest-ProjectReaderTests-11105876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44aa85d1-a21a-498f-9178-34eed214b07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:41 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f0e8ae24-f9a3-42e6-80be-749d6a51c0a6 tempest-ProjectReaderTests-11105876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44aa85d1-a21a-498f-9178-34eed214b07b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-397269134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a886b23c-b1f8-44e1-b5f6-fb9652a6a21a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5178a716ff174cde89a0c6ebdc091b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:42:41Z,use_quota=True,user_id='a1b46fedace14e668e560e3dfebab3a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:41 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f0e8ae24-f9a3-42e6-80be-749d6a51c0a6 tempest-ProjectReaderTests-11105876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8153b3ec-a77f-4b29-bf1b-3d179871e807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:41 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f0e8ae24-f9a3-42e6-80be-749d6a51c0a6 tempest-ProjectReaderTests-11105876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8153b3ec-a77f-4b29-bf1b-3d179871e807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:41 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f0e8ae24-f9a3-42e6-80be-749d6a51c0a6 tempest-ProjectReaderTests-11105876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da94de29-2ea1-4f60-b0d7-3e078dd1429e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:41 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f0e8ae24-f9a3-42e6-80be-749d6a51c0a6 tempest-ProjectReaderTests-11105876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da94de29-2ea1-4f60-b0d7-3e078dd1429e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a886b23c-b1f8-44e1-b5f6-fb9652a6a21a', 'volume_name': 'volume-a886b23c-b1f8-44e1-b5f6-fb9652a6a21a', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:41 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f0e8ae24-f9a3-42e6-80be-749d6a51c0a6 tempest-ProjectReaderTests-11105876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (436a4c2e-5747-4a59-9483-564445d2d79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:41 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f0e8ae24-f9a3-42e6-80be-749d6a51c0a6 tempest-ProjectReaderTests-11105876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (436a4c2e-5747-4a59-9483-564445d2d79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:41 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f0e8ae24-f9a3-42e6-80be-749d6a51c0a6 tempest-ProjectReaderTests-11105876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (176d2506-eb30-4088-85cd-72d92d6768b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:41 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-f0e8ae24-f9a3-42e6-80be-749d6a51c0a6 tempest-ProjectReaderTests-11105876 None] Volume a886b23c-b1f8-44e1-b5f6-fb9652a6a21a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a886b23c-b1f8-44e1-b5f6-fb9652a6a21a', 'volume_size': 1} Jul 08 18:42:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f0e8ae24-f9a3-42e6-80be-749d6a51c0a6 tempest-ProjectReaderTests-11105876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:42:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f0e8ae24-f9a3-42e6-80be-749d6a51c0a6 tempest-ProjectReaderTests-11105876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:42:41 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-f0e8ae24-f9a3-42e6-80be-749d6a51c0a6 tempest-ProjectReaderTests-11105876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-397269134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a886b23c-b1f8-44e1-b5f6-fb9652a6a21a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5178a716ff174cde89a0c6ebdc091b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:42:41Z,use_quota=True,user_id='a1b46fedace14e668e560e3dfebab3a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:42:41 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-f0e8ae24-f9a3-42e6-80be-749d6a51c0a6 tempest-ProjectReaderTests-11105876 None] Creating volume a886b23c-b1f8-44e1-b5f6-fb9652a6a21a {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:42:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f0e8ae24-f9a3-42e6-80be-749d6a51c0a6 tempest-ProjectReaderTests-11105876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:42:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f0e8ae24-f9a3-42e6-80be-749d6a51c0a6 tempest-ProjectReaderTests-11105876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:42:41 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-f0e8ae24-f9a3-42e6-80be-749d6a51c0a6 tempest-ProjectReaderTests-11105876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:42:41 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-f0e8ae24-f9a3-42e6-80be-749d6a51c0a6 tempest-ProjectReaderTests-11105876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:42:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f0e8ae24-f9a3-42e6-80be-749d6a51c0a6 tempest-ProjectReaderTests-11105876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:42:41 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-f0e8ae24-f9a3-42e6-80be-749d6a51c0a6 tempest-ProjectReaderTests-11105876 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:42:41 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-f0e8ae24-f9a3-42e6-80be-749d6a51c0a6 tempest-ProjectReaderTests-11105876 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:42:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f0e8ae24-f9a3-42e6-80be-749d6a51c0a6 tempest-ProjectReaderTests-11105876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-a886b23c-b1f8-44e1-b5f6-fb9652a6a21a 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:41 devstack sudo[95731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-a886b23c-b1f8-44e1-b5f6-fb9652a6a21a 1073741824 Jul 08 18:42:41 devstack sudo[95731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:42 devstack sudo[95731]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f0e8ae24-f9a3-42e6-80be-749d6a51c0a6 tempest-ProjectReaderTests-11105876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-a886b23c-b1f8-44e1-b5f6-fb9652a6a21a 1073741824" returned: 0 in 0.969s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f0e8ae24-f9a3-42e6-80be-749d6a51c0a6 tempest-ProjectReaderTests-11105876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-a886b23c-b1f8-44e1-b5f6-fb9652a6a21a {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:42 devstack sudo[95737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-a886b23c-b1f8-44e1-b5f6-fb9652a6a21a Jul 08 18:42:42 devstack sudo[95737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:43 devstack sudo[95737]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f0e8ae24-f9a3-42e6-80be-749d6a51c0a6 tempest-ProjectReaderTests-11105876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-a886b23c-b1f8-44e1-b5f6-fb9652a6a21a" returned: 0 in 0.795s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:43 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-f0e8ae24-f9a3-42e6-80be-749d6a51c0a6 tempest-ProjectReaderTests-11105876 None] <== create_volume: return (1824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:42:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f0e8ae24-f9a3-42e6-80be-749d6a51c0a6 tempest-ProjectReaderTests-11105876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.827s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:42:43 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f0e8ae24-f9a3-42e6-80be-749d6a51c0a6 tempest-ProjectReaderTests-11105876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (176d2506-eb30-4088-85cd-72d92d6768b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a886b23c-b1f8-44e1-b5f6-fb9652a6a21a', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:43 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f0e8ae24-f9a3-42e6-80be-749d6a51c0a6 tempest-ProjectReaderTests-11105876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (419eccd3-7ddc-46e7-b2ed-00a1c066f285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:43 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-f0e8ae24-f9a3-42e6-80be-749d6a51c0a6 tempest-ProjectReaderTests-11105876 None] Volume volume-a886b23c-b1f8-44e1-b5f6-fb9652a6a21a (a886b23c-b1f8-44e1-b5f6-fb9652a6a21a): created successfully Jul 08 18:42:43 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f0e8ae24-f9a3-42e6-80be-749d6a51c0a6 tempest-ProjectReaderTests-11105876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (419eccd3-7ddc-46e7-b2ed-00a1c066f285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:43 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f0e8ae24-f9a3-42e6-80be-749d6a51c0a6 tempest-ProjectReaderTests-11105876 None] Flow 'volume_create_manager' (cad94d37-1d93-49c9-8627-16b8bb3b3d9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:42:43 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-f0e8ae24-f9a3-42e6-80be-749d6a51c0a6 tempest-ProjectReaderTests-11105876 None] Created volume successfully. Jul 08 18:42:45 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-872f7a3b-4a79-43a5-95f6-8033c9be78d5 tempest-ProjectReaderTests-11105876 None] Acquiring lock "cinder-a886b23c-b1f8-44e1-b5f6-fb9652a6a21a-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:42:45 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-872f7a3b-4a79-43a5-95f6-8033c9be78d5 tempest-ProjectReaderTests-11105876 None] Lock "cinder-a886b23c-b1f8-44e1-b5f6-fb9652a6a21a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:42:45 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-872f7a3b-4a79-43a5-95f6-8033c9be78d5 tempest-ProjectReaderTests-11105876 None] Acquiring lock "cinder-quobyte-a886b23c-b1f8-44e1-b5f6-fb9652a6a21a" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:42:45 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-872f7a3b-4a79-43a5-95f6-8033c9be78d5 tempest-ProjectReaderTests-11105876 None] Lock "cinder-quobyte-a886b23c-b1f8-44e1-b5f6-fb9652a6a21a" acquired by "delete_volume" :: waited 0.029s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:42:45 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15bbc55-a35e-4ec4-9f39-838c17ebc0b4]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:42:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-872f7a3b-4a79-43a5-95f6-8033c9be78d5 tempest-ProjectReaderTests-11105876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-a886b23c-b1f8-44e1-b5f6-fb9652a6a21a {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:45 devstack sudo[95765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-a886b23c-b1f8-44e1-b5f6-fb9652a6a21a Jul 08 18:42:45 devstack sudo[95765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:46 devstack sudo[95765]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-872f7a3b-4a79-43a5-95f6-8033c9be78d5 tempest-ProjectReaderTests-11105876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-a886b23c-b1f8-44e1-b5f6-fb9652a6a21a" returned: 0 in 0.825s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-872f7a3b-4a79-43a5-95f6-8033c9be78d5 tempest-ProjectReaderTests-11105876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-a886b23c-b1f8-44e1-b5f6-fb9652a6a21a {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:46 devstack sudo[95770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-a886b23c-b1f8-44e1-b5f6-fb9652a6a21a Jul 08 18:42:46 devstack sudo[95770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:46 devstack sudo[95770]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-872f7a3b-4a79-43a5-95f6-8033c9be78d5 tempest-ProjectReaderTests-11105876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-a886b23c-b1f8-44e1-b5f6-fb9652a6a21a" returned: 0 in 0.759s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:46 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-872f7a3b-4a79-43a5-95f6-8033c9be78d5 tempest-ProjectReaderTests-11105876 None] Lock "cinder-quobyte-a886b23c-b1f8-44e1-b5f6-fb9652a6a21a" released by "delete_volume" :: held 1.647s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:42:46 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-872f7a3b-4a79-43a5-95f6-8033c9be78d5 tempest-ProjectReaderTests-11105876 None] Created reservations ['bf4e6dc3-0467-4234-91eb-74d7d7613c9b', 'e0109fbb-5554-4291-8dc9-8e0821550949', 'dda88d34-b203-4e40-b151-599bc28087f4', 'e323ef59-e86e-4368-b0ec-bbefdecc941e'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:42:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-872f7a3b-4a79-43a5-95f6-8033c9be78d5 tempest-ProjectReaderTests-11105876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:42:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-872f7a3b-4a79-43a5-95f6-8033c9be78d5 tempest-ProjectReaderTests-11105876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:42:47 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-872f7a3b-4a79-43a5-95f6-8033c9be78d5 tempest-ProjectReaderTests-11105876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:42:47 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-872f7a3b-4a79-43a5-95f6-8033c9be78d5 tempest-ProjectReaderTests-11105876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:42:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-872f7a3b-4a79-43a5-95f6-8033c9be78d5 tempest-ProjectReaderTests-11105876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:42:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-872f7a3b-4a79-43a5-95f6-8033c9be78d5 tempest-ProjectReaderTests-11105876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:47 devstack sudo[95773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:42:47 devstack sudo[95773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:47 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:42:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] Flow 'volume_create_manager' (7bc10cf5-1ee9-4ca9-be9b-2a9883ce1adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:42:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0d97378-3404-4cd3-bc9c-f46f504c6344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0d97378-3404-4cd3-bc9c-f46f504c6344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1156812845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d3a953b-2cc0-45ff-94ca-ab84c954ae1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d965f0a3b4b4448b1029f0299e35d39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:42:47Z,use_quota=True,user_id='98ed70d32e7d4804bad506cc8163d848',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (198b8bc7-df0e-4020-80d3-2bbda1555ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (198b8bc7-df0e-4020-80d3-2bbda1555ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69ab9589-348f-4495-925c-b84709757398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:47 devstack cinder-volume[86873]: DEBUG cinder.image.glance [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] Creating Keystone auth plugin from conf {{(pid=86873) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 18:42:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69ab9589-348f-4495-925c-b84709757398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8d3a953b-2cc0-45ff-94ca-ab84c954ae1c', 'volume_name': 'volume-8d3a953b-2cc0-45ff-94ca-ab84c954ae1c', 'volume_size': 1, 'image_id': '9af8b46e-3f06-4165-9812-4f0470d72624', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9af8b46e-3f06-4165-9812-4f0470d72624', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '14269f30917742408b75240392484938', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9af8b46e-3f06-4165-9812-4f0470d72624', 'created_at': datetime.datetime(2026, 7, 8, 16, 25, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 25, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9af8b46e-3f06-4165-9812-4f0470d72624/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d55093da-5635-4c51-b9ba-5e051942fa76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d55093da-5635-4c51-b9ba-5e051942fa76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dd27995-bfac-427a-993b-cecdf11aeaf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:47 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] Volume 8d3a953b-2cc0-45ff-94ca-ab84c954ae1c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8d3a953b-2cc0-45ff-94ca-ab84c954ae1c', 'volume_size': 1, 'image_id': '9af8b46e-3f06-4165-9812-4f0470d72624', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9af8b46e-3f06-4165-9812-4f0470d72624', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '14269f30917742408b75240392484938', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9af8b46e-3f06-4165-9812-4f0470d72624', 'created_at': datetime.datetime(2026, 7, 8, 16, 25, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 25, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9af8b46e-3f06-4165-9812-4f0470d72624/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 18:42:47 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] Trying to clone 8d3a953b-2cc0-45ff-94ca-ab84c954ae1c from image 9af8b46e-3f06-4165-9812-4f0470d72624 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9af8b46e-3f06-4165-9812-4f0470d72624', 'metadata': {}}]). {{(pid=86873) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 18:42:47 devstack sudo[95773]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-872f7a3b-4a79-43a5-95f6-8033c9be78d5 tempest-ProjectReaderTests-11105876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.709s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:47 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-872f7a3b-4a79-43a5-95f6-8033c9be78d5 tempest-ProjectReaderTests-11105876 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:42:47 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-872f7a3b-4a79-43a5-95f6-8033c9be78d5 tempest-ProjectReaderTests-11105876 None] Deleted volume successfully. Jul 08 18:42:47 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-872f7a3b-4a79-43a5-95f6-8033c9be78d5 tempest-ProjectReaderTests-11105876 None] Lock "cinder-a886b23c-b1f8-44e1-b5f6-fb9652a6a21a-delete_volume" released by "delete_volume" :: held 2.621s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:42:48 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-efb10ab0-8cce-4fdc-8ed0-e6731e637892 tempest-ProjectReaderTests-11105876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:42:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-efb10ab0-8cce-4fdc-8ed0-e6731e637892 tempest-ProjectReaderTests-11105876 None] Flow 'volume_create_manager' (ef6c5d62-1272-4468-a05b-5d98cb1d5068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:42:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-efb10ab0-8cce-4fdc-8ed0-e6731e637892 tempest-ProjectReaderTests-11105876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a098ad05-aec6-4582-a76c-e033526a2a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-efb10ab0-8cce-4fdc-8ed0-e6731e637892 tempest-ProjectReaderTests-11105876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a098ad05-aec6-4582-a76c-e033526a2a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:42:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2018589213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=555a63d3-7333-489b-b17e-2986c27b2971,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5178a716ff174cde89a0c6ebdc091b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:42:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:42:48Z,use_quota=True,user_id='a1b46fedace14e668e560e3dfebab3a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-efb10ab0-8cce-4fdc-8ed0-e6731e637892 tempest-ProjectReaderTests-11105876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d645c59-f000-49a8-90b0-bfab55c5ef7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-efb10ab0-8cce-4fdc-8ed0-e6731e637892 tempest-ProjectReaderTests-11105876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d645c59-f000-49a8-90b0-bfab55c5ef7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-efb10ab0-8cce-4fdc-8ed0-e6731e637892 tempest-ProjectReaderTests-11105876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e8dd89b-78a8-4414-aa83-1731b9dd589f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-efb10ab0-8cce-4fdc-8ed0-e6731e637892 tempest-ProjectReaderTests-11105876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e8dd89b-78a8-4414-aa83-1731b9dd589f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '555a63d3-7333-489b-b17e-2986c27b2971', 'volume_name': 'volume-555a63d3-7333-489b-b17e-2986c27b2971', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-efb10ab0-8cce-4fdc-8ed0-e6731e637892 tempest-ProjectReaderTests-11105876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (421d3e3d-18ef-490c-a5a4-22e2ffc0ae86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-efb10ab0-8cce-4fdc-8ed0-e6731e637892 tempest-ProjectReaderTests-11105876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (421d3e3d-18ef-490c-a5a4-22e2ffc0ae86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-efb10ab0-8cce-4fdc-8ed0-e6731e637892 tempest-ProjectReaderTests-11105876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20b91efa-e5b7-40e6-979c-3958c6f1aa58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:48 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-efb10ab0-8cce-4fdc-8ed0-e6731e637892 tempest-ProjectReaderTests-11105876 None] Volume 555a63d3-7333-489b-b17e-2986c27b2971: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-555a63d3-7333-489b-b17e-2986c27b2971', 'volume_size': 1} Jul 08 18:42:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-efb10ab0-8cce-4fdc-8ed0-e6731e637892 tempest-ProjectReaderTests-11105876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:42:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-efb10ab0-8cce-4fdc-8ed0-e6731e637892 tempest-ProjectReaderTests-11105876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:42:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-efb10ab0-8cce-4fdc-8ed0-e6731e637892 tempest-ProjectReaderTests-11105876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:42:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2018589213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=555a63d3-7333-489b-b17e-2986c27b2971,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5178a716ff174cde89a0c6ebdc091b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:42:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:42:48Z,use_quota=True,user_id='a1b46fedace14e668e560e3dfebab3a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:42:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-efb10ab0-8cce-4fdc-8ed0-e6731e637892 tempest-ProjectReaderTests-11105876 None] Creating volume 555a63d3-7333-489b-b17e-2986c27b2971 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:42:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-efb10ab0-8cce-4fdc-8ed0-e6731e637892 tempest-ProjectReaderTests-11105876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:42:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-efb10ab0-8cce-4fdc-8ed0-e6731e637892 tempest-ProjectReaderTests-11105876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:42:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-efb10ab0-8cce-4fdc-8ed0-e6731e637892 tempest-ProjectReaderTests-11105876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:42:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-efb10ab0-8cce-4fdc-8ed0-e6731e637892 tempest-ProjectReaderTests-11105876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:42:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-efb10ab0-8cce-4fdc-8ed0-e6731e637892 tempest-ProjectReaderTests-11105876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:42:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-efb10ab0-8cce-4fdc-8ed0-e6731e637892 tempest-ProjectReaderTests-11105876 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:42:48 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-efb10ab0-8cce-4fdc-8ed0-e6731e637892 tempest-ProjectReaderTests-11105876 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:42:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-efb10ab0-8cce-4fdc-8ed0-e6731e637892 tempest-ProjectReaderTests-11105876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-555a63d3-7333-489b-b17e-2986c27b2971 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:48 devstack cinder-volume[86873]: DEBUG oslo_service.periodic_task [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86873) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:42:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:42:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:42:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:42:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:42:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:42:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:48 devstack sudo[95777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-555a63d3-7333-489b-b17e-2986c27b2971 1073741824 Jul 08 18:42:48 devstack sudo[95777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:48 devstack sudo[95778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:42:48 devstack sudo[95778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:48 devstack cinder-volume[86873]: DEBUG cinder.image.image_utils [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9af8b46e-3f06-4165-9812-4f0470d72624_vniqm_5xdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86873) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 18:42:48 devstack cinder-volume[86873]: INFO cinder.image.image_utils [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] Image download 20.69 MB at 20.69 MB/s Jul 08 18:42:48 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e0ab4c-8927-486b-b7a0-5ad8dc330aab]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:42:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9af8b46e-3f06-4165-9812-4f0470d72624_vniqm_5xdevstack@QuobyteHD {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:48 devstack sudo[95781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9af8b46e-3f06-4165-9812-4f0470d72624_vniqm_5xdevstack@QuobyteHD Jul 08 18:42:48 devstack sudo[95781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:48 devstack sudo[95778]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.711s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:48 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:42:48 devstack cinder-volume[86873]: DEBUG oslo_service.periodic_task [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running periodic task VolumeManager._thread_info {{(pid=86873) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:42:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] thread count: 29 {{(pid=86873) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:42:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] thread info: [<_MainThread(MainThread, started 138577734545536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86873) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:42:49 devstack sudo[95781]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9af8b46e-3f06-4165-9812-4f0470d72624_vniqm_5xdevstack@QuobyteHD" returned: 0 in 0.749s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:49 devstack cinder-volume[86873]: DEBUG cinder.image.image_utils [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] Temporary image 9af8b46e-3f06-4165-9812-4f0470d72624 is fetched for user 98ed70d32e7d4804bad506cc8163d848. {{(pid=86873) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 18:42:49 devstack sudo[95777]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-efb10ab0-8cce-4fdc-8ed0-e6731e637892 tempest-ProjectReaderTests-11105876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-555a63d3-7333-489b-b17e-2986c27b2971 1073741824" returned: 0 in 0.933s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:49 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a32a3c-4d26-49bd-ad86-919561ca022a]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:42:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9af8b46e-3f06-4165-9812-4f0470d72624_vniqm_5xdevstack@QuobyteHD {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-efb10ab0-8cce-4fdc-8ed0-e6731e637892 tempest-ProjectReaderTests-11105876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-555a63d3-7333-489b-b17e-2986c27b2971 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:49 devstack sudo[95791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-555a63d3-7333-489b-b17e-2986c27b2971 Jul 08 18:42:49 devstack sudo[95791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:49 devstack sudo[95790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9af8b46e-3f06-4165-9812-4f0470d72624_vniqm_5xdevstack@QuobyteHD Jul 08 18:42:49 devstack sudo[95790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:49 devstack sudo[95791]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-efb10ab0-8cce-4fdc-8ed0-e6731e637892 tempest-ProjectReaderTests-11105876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-555a63d3-7333-489b-b17e-2986c27b2971" returned: 0 in 0.700s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:49 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-efb10ab0-8cce-4fdc-8ed0-e6731e637892 tempest-ProjectReaderTests-11105876 None] <== create_volume: return (1696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:42:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-efb10ab0-8cce-4fdc-8ed0-e6731e637892 tempest-ProjectReaderTests-11105876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.699s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:42:49 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-efb10ab0-8cce-4fdc-8ed0-e6731e637892 tempest-ProjectReaderTests-11105876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20b91efa-e5b7-40e6-979c-3958c6f1aa58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-555a63d3-7333-489b-b17e-2986c27b2971', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:49 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-efb10ab0-8cce-4fdc-8ed0-e6731e637892 tempest-ProjectReaderTests-11105876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c235f7ba-ae45-413c-a813-f576e8125884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:49 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-efb10ab0-8cce-4fdc-8ed0-e6731e637892 tempest-ProjectReaderTests-11105876 None] Volume volume-555a63d3-7333-489b-b17e-2986c27b2971 (555a63d3-7333-489b-b17e-2986c27b2971): created successfully Jul 08 18:42:49 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-efb10ab0-8cce-4fdc-8ed0-e6731e637892 tempest-ProjectReaderTests-11105876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c235f7ba-ae45-413c-a813-f576e8125884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:49 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-efb10ab0-8cce-4fdc-8ed0-e6731e637892 tempest-ProjectReaderTests-11105876 None] Flow 'volume_create_manager' (ef6c5d62-1272-4468-a05b-5d98cb1d5068) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:42:49 devstack sudo[95790]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9af8b46e-3f06-4165-9812-4f0470d72624_vniqm_5xdevstack@QuobyteHD" returned: 0 in 0.785s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:42:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:42:49 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1156812845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d3a953b-2cc0-45ff-94ca-ab84c954ae1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d965f0a3b4b4448b1029f0299e35d39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:42:47Z,use_quota=True,user_id='98ed70d32e7d4804bad506cc8163d848',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:42:49 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] Creating volume 8d3a953b-2cc0-45ff-94ca-ab84c954ae1c {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:42:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:42:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:42:49 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:42:49 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:42:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:42:49 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:42:49 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:42:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8d3a953b-2cc0-45ff-94ca-ab84c954ae1c 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:49 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-efb10ab0-8cce-4fdc-8ed0-e6731e637892 tempest-ProjectReaderTests-11105876 None] Created volume successfully. Jul 08 18:42:49 devstack sudo[95798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8d3a953b-2cc0-45ff-94ca-ab84c954ae1c 1073741824 Jul 08 18:42:49 devstack sudo[95798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:50 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-df2d3ce7-0758-4012-badf-f0518f4437e0 tempest-ProjectReaderTests-11105876 None] Acquiring lock "cinder-555a63d3-7333-489b-b17e-2986c27b2971-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:42:50 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-df2d3ce7-0758-4012-badf-f0518f4437e0 tempest-ProjectReaderTests-11105876 None] Lock "cinder-555a63d3-7333-489b-b17e-2986c27b2971-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:42:50 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-df2d3ce7-0758-4012-badf-f0518f4437e0 tempest-ProjectReaderTests-11105876 None] Acquiring lock "cinder-quobyte-555a63d3-7333-489b-b17e-2986c27b2971" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:42:50 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-df2d3ce7-0758-4012-badf-f0518f4437e0 tempest-ProjectReaderTests-11105876 None] Lock "cinder-quobyte-555a63d3-7333-489b-b17e-2986c27b2971" acquired by "delete_volume" :: waited 0.021s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:42:50 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb6d5b9-4f84-4791-a0ec-93be5a473fb6]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:42:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-df2d3ce7-0758-4012-badf-f0518f4437e0 tempest-ProjectReaderTests-11105876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-555a63d3-7333-489b-b17e-2986c27b2971 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:50 devstack sudo[95800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-555a63d3-7333-489b-b17e-2986c27b2971 Jul 08 18:42:50 devstack sudo[95800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:50 devstack sudo[95798]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8d3a953b-2cc0-45ff-94ca-ab84c954ae1c 1073741824" returned: 0 in 0.886s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8d3a953b-2cc0-45ff-94ca-ab84c954ae1c {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:50 devstack sudo[95805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8d3a953b-2cc0-45ff-94ca-ab84c954ae1c Jul 08 18:42:50 devstack sudo[95805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:51 devstack sudo[95800]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-df2d3ce7-0758-4012-badf-f0518f4437e0 tempest-ProjectReaderTests-11105876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-555a63d3-7333-489b-b17e-2986c27b2971" returned: 0 in 0.824s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-df2d3ce7-0758-4012-badf-f0518f4437e0 tempest-ProjectReaderTests-11105876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-555a63d3-7333-489b-b17e-2986c27b2971 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:51 devstack sudo[95810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-555a63d3-7333-489b-b17e-2986c27b2971 Jul 08 18:42:51 devstack sudo[95810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:51 devstack sudo[95805]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8d3a953b-2cc0-45ff-94ca-ab84c954ae1c" returned: 0 in 0.736s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:51 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] <== create_volume: return (1665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:42:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.669s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:42:51 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:INSERT=40,cinder:UPDATE=158,cinder:SELECT=106,cinder:DELETE=13 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:42:51 devstack cinder-volume[86873]: DEBUG cinder.volume.volume_utils [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] Attempting download of 9af8b46e-3f06-4165-9812-4f0470d72624 ((None, [{'url': 'file:///opt/stack/data/glance/images/9af8b46e-3f06-4165-9812-4f0470d72624', 'metadata': {}}])) to volume 8d3a953b-2cc0-45ff-94ca-ab84c954ae1c. {{(pid=86873) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 18:42:51 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b05d639-3821-4750-ace4-d9b2a028dd4b]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:42:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9af8b46e-3f06-4165-9812-4f0470d72624_k2tfm329 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:51 devstack sudo[95814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9af8b46e-3f06-4165-9812-4f0470d72624_k2tfm329 Jul 08 18:42:51 devstack sudo[95814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:51 devstack sudo[95810]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-df2d3ce7-0758-4012-badf-f0518f4437e0 tempest-ProjectReaderTests-11105876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-555a63d3-7333-489b-b17e-2986c27b2971" returned: 0 in 0.705s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:51 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-df2d3ce7-0758-4012-badf-f0518f4437e0 tempest-ProjectReaderTests-11105876 None] Lock "cinder-quobyte-555a63d3-7333-489b-b17e-2986c27b2971" released by "delete_volume" :: held 1.587s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:42:51 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-df2d3ce7-0758-4012-badf-f0518f4437e0 tempest-ProjectReaderTests-11105876 None] Created reservations ['1c229dbb-03df-49c0-8bb2-21c2960a1199', '8f6e24eb-9167-4262-b408-b768be2099e5', '4e90e6f0-7196-4007-a5b8-7ef1b161fde9', 'd3793775-e535-426c-9d95-1180cab0b0f4'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:42:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-df2d3ce7-0758-4012-badf-f0518f4437e0 tempest-ProjectReaderTests-11105876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:42:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-df2d3ce7-0758-4012-badf-f0518f4437e0 tempest-ProjectReaderTests-11105876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:42:51 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-df2d3ce7-0758-4012-badf-f0518f4437e0 tempest-ProjectReaderTests-11105876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:42:51 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-df2d3ce7-0758-4012-badf-f0518f4437e0 tempest-ProjectReaderTests-11105876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:42:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-df2d3ce7-0758-4012-badf-f0518f4437e0 tempest-ProjectReaderTests-11105876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:42:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-df2d3ce7-0758-4012-badf-f0518f4437e0 tempest-ProjectReaderTests-11105876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:51 devstack sudo[95816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:42:51 devstack sudo[95816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:52 devstack sudo[95814]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9af8b46e-3f06-4165-9812-4f0470d72624_k2tfm329" returned: 0 in 0.825s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9af8b46e-3f06-4165-9812-4f0470d72624_k2tfm329 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:52 devstack sudo[95821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9af8b46e-3f06-4165-9812-4f0470d72624_k2tfm329 Jul 08 18:42:52 devstack sudo[95821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:52 devstack sudo[95816]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-df2d3ce7-0758-4012-badf-f0518f4437e0 tempest-ProjectReaderTests-11105876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.819s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:52 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-df2d3ce7-0758-4012-badf-f0518f4437e0 tempest-ProjectReaderTests-11105876 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:42:52 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-df2d3ce7-0758-4012-badf-f0518f4437e0 tempest-ProjectReaderTests-11105876 None] Deleted volume successfully. Jul 08 18:42:52 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-df2d3ce7-0758-4012-badf-f0518f4437e0 tempest-ProjectReaderTests-11105876 None] Lock "cinder-555a63d3-7333-489b-b17e-2986c27b2971-delete_volume" released by "delete_volume" :: held 2.625s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:42:53 devstack sudo[95821]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:53 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9af8b46e-3f06-4165-9812-4f0470d72624_k2tfm329" returned: 1 in 0.898s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:53 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9af8b46e-3f06-4165-9812-4f0470d72624_k2tfm329' failed. Not Retrying. {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:42:53 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[151a1099-d478-4e80-8e87-8b97877e46a5]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:42:53 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9af8b46e-3f06-4165-9812-4f0470d72624_vniqm_5xdevstack@QuobyteHD {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:53 devstack sudo[95827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9af8b46e-3f06-4165-9812-4f0470d72624_vniqm_5xdevstack@QuobyteHD Jul 08 18:42:53 devstack sudo[95827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:54 devstack sudo[95827]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9af8b46e-3f06-4165-9812-4f0470d72624_vniqm_5xdevstack@QuobyteHD" returned: 0 in 0.988s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:54 devstack cinder-volume[86873]: DEBUG cinder.image.image_utils [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] 9af8b46e-3f06-4165-9812-4f0470d72624 was qcow2, converting to raw {{(pid=86873) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 18:42:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9af8b46e-3f06-4165-9812-4f0470d72624_vniqm_5xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8d3a953b-2cc0-45ff-94ca-ab84c954ae1c {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:54 devstack sudo[95837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9af8b46e-3f06-4165-9812-4f0470d72624_vniqm_5xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8d3a953b-2cc0-45ff-94ca-ab84c954ae1c Jul 08 18:42:54 devstack sudo[95837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:56 devstack sudo[95837]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9af8b46e-3f06-4165-9812-4f0470d72624_vniqm_5xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8d3a953b-2cc0-45ff-94ca-ab84c954ae1c" returned: 0 in 2.247s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:56 devstack cinder-volume[86873]: DEBUG cinder.image.image_utils [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9af8b46e-3f06-4165-9812-4f0470d72624_vniqm_5xdevstack@QuobyteHD, size 112.00 MB, duration 2.25 sec, destination /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8d3a953b-2cc0-45ff-94ca-ab84c954ae1c {{(pid=86873) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:42:56 devstack cinder-volume[86873]: INFO cinder.image.image_utils [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] Converted 112.00 MB image at 49.80 MB/s Jul 08 18:42:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8d3a953b-2cc0-45ff-94ca-ab84c954ae1c 1G {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:56 devstack sudo[95852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8d3a953b-2cc0-45ff-94ca-ab84c954ae1c 1G Jul 08 18:42:56 devstack sudo[95852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:57 devstack sudo[95852]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8d3a953b-2cc0-45ff-94ca-ab84c954ae1c 1G" returned: 0 in 0.738s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:57 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a03dcf5-24d3-422c-843d-6a184af21d52]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:42:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8d3a953b-2cc0-45ff-94ca-ab84c954ae1c {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:57 devstack sudo[95859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8d3a953b-2cc0-45ff-94ca-ab84c954ae1c Jul 08 18:42:57 devstack sudo[95859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:57 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-78fdc756-a3e1-4ee9-88b6-73720dd9fb53 tempest-AttachVolumeTestJSON-339721191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:42:57 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-78fdc756-a3e1-4ee9-88b6-73720dd9fb53 tempest-AttachVolumeTestJSON-339721191 None] Flow 'volume_create_manager' (a745994a-4110-43d3-ba4b-f8173bfd8a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:42:57 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-78fdc756-a3e1-4ee9-88b6-73720dd9fb53 tempest-AttachVolumeTestJSON-339721191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce42526e-f18d-48bd-988c-fcb699a21de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:57 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-78fdc756-a3e1-4ee9-88b6-73720dd9fb53 tempest-AttachVolumeTestJSON-339721191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce42526e-f18d-48bd-988c-fcb699a21de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:42:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1747745905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dcf979c-5fe7-437d-be59-b18880bb3a93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca0fb35f852f43cfa610f321cd0c3609',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:42:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:42:58Z,use_quota=True,user_id='a0502d45925349ba9e1ff3abaa2e395f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:57 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-78fdc756-a3e1-4ee9-88b6-73720dd9fb53 tempest-AttachVolumeTestJSON-339721191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50feef02-ebfc-4d5a-8713-92e2eb1c6a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:57 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-78fdc756-a3e1-4ee9-88b6-73720dd9fb53 tempest-AttachVolumeTestJSON-339721191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50feef02-ebfc-4d5a-8713-92e2eb1c6a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:57 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-78fdc756-a3e1-4ee9-88b6-73720dd9fb53 tempest-AttachVolumeTestJSON-339721191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beb2db38-b321-42b5-aa43-9dc86d2b162a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:57 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-78fdc756-a3e1-4ee9-88b6-73720dd9fb53 tempest-AttachVolumeTestJSON-339721191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beb2db38-b321-42b5-aa43-9dc86d2b162a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dcf979c-5fe7-437d-be59-b18880bb3a93', 'volume_name': 'volume-3dcf979c-5fe7-437d-be59-b18880bb3a93', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:57 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-78fdc756-a3e1-4ee9-88b6-73720dd9fb53 tempest-AttachVolumeTestJSON-339721191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d2a9056-2cb6-4ded-971c-ea14edec1d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:57 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-78fdc756-a3e1-4ee9-88b6-73720dd9fb53 tempest-AttachVolumeTestJSON-339721191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d2a9056-2cb6-4ded-971c-ea14edec1d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:57 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-78fdc756-a3e1-4ee9-88b6-73720dd9fb53 tempest-AttachVolumeTestJSON-339721191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b408502-ddc9-4a82-af47-26c43317eebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:57 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-78fdc756-a3e1-4ee9-88b6-73720dd9fb53 tempest-AttachVolumeTestJSON-339721191 None] Volume 3dcf979c-5fe7-437d-be59-b18880bb3a93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dcf979c-5fe7-437d-be59-b18880bb3a93', 'volume_size': 1} Jul 08 18:42:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-78fdc756-a3e1-4ee9-88b6-73720dd9fb53 tempest-AttachVolumeTestJSON-339721191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:42:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-78fdc756-a3e1-4ee9-88b6-73720dd9fb53 tempest-AttachVolumeTestJSON-339721191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:42:57 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-78fdc756-a3e1-4ee9-88b6-73720dd9fb53 tempest-AttachVolumeTestJSON-339721191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:42:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1747745905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dcf979c-5fe7-437d-be59-b18880bb3a93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca0fb35f852f43cfa610f321cd0c3609',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:42:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:42:58Z,use_quota=True,user_id='a0502d45925349ba9e1ff3abaa2e395f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:42:57 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-78fdc756-a3e1-4ee9-88b6-73720dd9fb53 tempest-AttachVolumeTestJSON-339721191 None] Creating volume 3dcf979c-5fe7-437d-be59-b18880bb3a93 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:42:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-78fdc756-a3e1-4ee9-88b6-73720dd9fb53 tempest-AttachVolumeTestJSON-339721191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:42:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-78fdc756-a3e1-4ee9-88b6-73720dd9fb53 tempest-AttachVolumeTestJSON-339721191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:42:57 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-78fdc756-a3e1-4ee9-88b6-73720dd9fb53 tempest-AttachVolumeTestJSON-339721191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:42:57 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-78fdc756-a3e1-4ee9-88b6-73720dd9fb53 tempest-AttachVolumeTestJSON-339721191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:42:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-78fdc756-a3e1-4ee9-88b6-73720dd9fb53 tempest-AttachVolumeTestJSON-339721191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:42:57 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-78fdc756-a3e1-4ee9-88b6-73720dd9fb53 tempest-AttachVolumeTestJSON-339721191 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:42:57 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-78fdc756-a3e1-4ee9-88b6-73720dd9fb53 tempest-AttachVolumeTestJSON-339721191 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:42:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-78fdc756-a3e1-4ee9-88b6-73720dd9fb53 tempest-AttachVolumeTestJSON-339721191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3dcf979c-5fe7-437d-be59-b18880bb3a93 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:57 devstack sudo[95861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3dcf979c-5fe7-437d-be59-b18880bb3a93 1073741824 Jul 08 18:42:57 devstack sudo[95861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:58 devstack sudo[95859]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8d3a953b-2cc0-45ff-94ca-ab84c954ae1c" returned: 0 in 0.933s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8d3a953b-2cc0-45ff-94ca-ab84c954ae1c {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:58 devstack sudo[95865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8d3a953b-2cc0-45ff-94ca-ab84c954ae1c Jul 08 18:42:58 devstack sudo[95865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:58 devstack sudo[95861]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-78fdc756-a3e1-4ee9-88b6-73720dd9fb53 tempest-AttachVolumeTestJSON-339721191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3dcf979c-5fe7-437d-be59-b18880bb3a93 1073741824" returned: 0 in 0.914s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-78fdc756-a3e1-4ee9-88b6-73720dd9fb53 tempest-AttachVolumeTestJSON-339721191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3dcf979c-5fe7-437d-be59-b18880bb3a93 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:58 devstack sudo[95884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3dcf979c-5fe7-437d-be59-b18880bb3a93 Jul 08 18:42:58 devstack sudo[95884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:59 devstack sudo[95865]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8d3a953b-2cc0-45ff-94ca-ab84c954ae1c" returned: 1 in 1.102s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8d3a953b-2cc0-45ff-94ca-ab84c954ae1c' failed. Not Retrying. {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:42:59 devstack cinder-volume[86873]: DEBUG cinder.volume.volume_utils [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] Downloaded image 9af8b46e-3f06-4165-9812-4f0470d72624 ((None, [{'url': 'file:///opt/stack/data/glance/images/9af8b46e-3f06-4165-9812-4f0470d72624', 'metadata': {}}])) to volume 8d3a953b-2cc0-45ff-94ca-ab84c954ae1c successfully. {{(pid=86873) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 18:42:59 devstack cinder-volume[86873]: DEBUG cinder.image.image_utils [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] Temporary image 9af8b46e-3f06-4165-9812-4f0470d72624 for user 98ed70d32e7d4804bad506cc8163d848 is deleted. {{(pid=86873) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 18:42:59 devstack cinder-volume[86873]: DEBUG cinder.volume.volume_utils [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] Marking volume 8d3a953b-2cc0-45ff-94ca-ab84c954ae1c as bootable. {{(pid=86873) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 18:42:59 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] Copying metadata from image 9af8b46e-3f06-4165-9812-4f0470d72624 to 8d3a953b-2cc0-45ff-94ca-ab84c954ae1c. {{(pid=86873) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 18:42:59 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] Creating volume glance metadata for volume 8d3a953b-2cc0-45ff-94ca-ab84c954ae1c backed by image 9af8b46e-3f06-4165-9812-4f0470d72624 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9af8b46e-3f06-4165-9812-4f0470d72624', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86873) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 18:42:59 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dd27995-bfac-427a-993b-cecdf11aeaf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d3a953b-2cc0-45ff-94ca-ab84c954ae1c', 'volume_size': 1, 'image_id': '9af8b46e-3f06-4165-9812-4f0470d72624', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9af8b46e-3f06-4165-9812-4f0470d72624', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '14269f30917742408b75240392484938', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9af8b46e-3f06-4165-9812-4f0470d72624', 'created_at': datetime.datetime(2026, 7, 8, 16, 25, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 25, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9af8b46e-3f06-4165-9812-4f0470d72624/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:59 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf496587-3e8b-4640-a18a-c3fc67b4b9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:59 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] Volume volume-8d3a953b-2cc0-45ff-94ca-ab84c954ae1c (8d3a953b-2cc0-45ff-94ca-ab84c954ae1c): created successfully Jul 08 18:42:59 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf496587-3e8b-4640-a18a-c3fc67b4b9a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:59 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] Flow 'volume_create_manager' (7bc10cf5-1ee9-4ca9-be9b-2a9883ce1adc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:42:59 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-5fb7da34-d744-4574-9c22-2dd6e19c8824 tempest-VolumesImageMetadata-762667470 None] Created volume successfully. Jul 08 18:42:59 devstack sudo[95884]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-78fdc756-a3e1-4ee9-88b6-73720dd9fb53 tempest-AttachVolumeTestJSON-339721191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3dcf979c-5fe7-437d-be59-b18880bb3a93" returned: 0 in 0.907s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:59 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-78fdc756-a3e1-4ee9-88b6-73720dd9fb53 tempest-AttachVolumeTestJSON-339721191 None] <== create_volume: return (1889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:42:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-78fdc756-a3e1-4ee9-88b6-73720dd9fb53 tempest-AttachVolumeTestJSON-339721191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.891s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:42:59 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-78fdc756-a3e1-4ee9-88b6-73720dd9fb53 tempest-AttachVolumeTestJSON-339721191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b408502-ddc9-4a82-af47-26c43317eebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dcf979c-5fe7-437d-be59-b18880bb3a93', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:59 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-78fdc756-a3e1-4ee9-88b6-73720dd9fb53 tempest-AttachVolumeTestJSON-339721191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67fd91e5-e1e9-4bab-a410-8f313c165b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:59 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-78fdc756-a3e1-4ee9-88b6-73720dd9fb53 tempest-AttachVolumeTestJSON-339721191 None] Volume volume-3dcf979c-5fe7-437d-be59-b18880bb3a93 (3dcf979c-5fe7-437d-be59-b18880bb3a93): created successfully Jul 08 18:42:59 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-78fdc756-a3e1-4ee9-88b6-73720dd9fb53 tempest-AttachVolumeTestJSON-339721191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67fd91e5-e1e9-4bab-a410-8f313c165b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:59 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-78fdc756-a3e1-4ee9-88b6-73720dd9fb53 tempest-AttachVolumeTestJSON-339721191 None] Flow 'volume_create_manager' (a745994a-4110-43d3-ba4b-f8173bfd8a55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:42:59 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-78fdc756-a3e1-4ee9-88b6-73720dd9fb53 tempest-AttachVolumeTestJSON-339721191 None] Created volume successfully. Jul 08 18:43:00 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-23c92fd0-06c5-4781-9c07-70ee7f89e342 tempest-VolumesImageMetadata-762667470 None] Acquiring lock "cinder-8d3a953b-2cc0-45ff-94ca-ab84c954ae1c-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:43:00 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-23c92fd0-06c5-4781-9c07-70ee7f89e342 tempest-VolumesImageMetadata-762667470 None] Lock "cinder-8d3a953b-2cc0-45ff-94ca-ab84c954ae1c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:43:00 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-23c92fd0-06c5-4781-9c07-70ee7f89e342 tempest-VolumesImageMetadata-762667470 None] Acquiring lock "cinder-quobyte-8d3a953b-2cc0-45ff-94ca-ab84c954ae1c" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:43:00 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-23c92fd0-06c5-4781-9c07-70ee7f89e342 tempest-VolumesImageMetadata-762667470 None] Lock "cinder-quobyte-8d3a953b-2cc0-45ff-94ca-ab84c954ae1c" acquired by "delete_volume" :: waited 0.016s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:43:00 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa13d380-713d-42cb-b376-8fa78806704b]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:43:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-23c92fd0-06c5-4781-9c07-70ee7f89e342 tempest-VolumesImageMetadata-762667470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8d3a953b-2cc0-45ff-94ca-ab84c954ae1c {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:43:00 devstack sudo[95913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8d3a953b-2cc0-45ff-94ca-ab84c954ae1c Jul 08 18:43:00 devstack sudo[95913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:43:01 devstack sudo[95913]: pam_unix(sudo:session): session closed for user root Jul 08 18:43:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-23c92fd0-06c5-4781-9c07-70ee7f89e342 tempest-VolumesImageMetadata-762667470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8d3a953b-2cc0-45ff-94ca-ab84c954ae1c" returned: 0 in 0.791s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:43:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-23c92fd0-06c5-4781-9c07-70ee7f89e342 tempest-VolumesImageMetadata-762667470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8d3a953b-2cc0-45ff-94ca-ab84c954ae1c {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:43:01 devstack sudo[95920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8d3a953b-2cc0-45ff-94ca-ab84c954ae1c Jul 08 18:43:01 devstack sudo[95920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:43:02 devstack sudo[95920]: pam_unix(sudo:session): session closed for user root Jul 08 18:43:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-23c92fd0-06c5-4781-9c07-70ee7f89e342 tempest-VolumesImageMetadata-762667470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8d3a953b-2cc0-45ff-94ca-ab84c954ae1c" returned: 1 in 0.779s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:43:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-23c92fd0-06c5-4781-9c07-70ee7f89e342 tempest-VolumesImageMetadata-762667470 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8d3a953b-2cc0-45ff-94ca-ab84c954ae1c' failed. Not Retrying. {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:43:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-23c92fd0-06c5-4781-9c07-70ee7f89e342 tempest-VolumesImageMetadata-762667470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8d3a953b-2cc0-45ff-94ca-ab84c954ae1c {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:43:02 devstack sudo[95928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8d3a953b-2cc0-45ff-94ca-ab84c954ae1c Jul 08 18:43:02 devstack sudo[95928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:43:03 devstack sudo[95928]: pam_unix(sudo:session): session closed for user root Jul 08 18:43:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-23c92fd0-06c5-4781-9c07-70ee7f89e342 tempest-VolumesImageMetadata-762667470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8d3a953b-2cc0-45ff-94ca-ab84c954ae1c" returned: 0 in 0.644s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:43:03 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-23c92fd0-06c5-4781-9c07-70ee7f89e342 tempest-VolumesImageMetadata-762667470 None] Lock "cinder-quobyte-8d3a953b-2cc0-45ff-94ca-ab84c954ae1c" released by "delete_volume" :: held 2.269s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:43:03 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-23c92fd0-06c5-4781-9c07-70ee7f89e342 tempest-VolumesImageMetadata-762667470 None] Created reservations ['7cfcce31-f473-43fe-9a89-028bf9e96dd0', '7f8b9a9b-cc63-414a-8e97-570d49bc1fce', 'a79d35f1-fc5d-4edf-8535-bcd4a5b41fe3', 'b79a6e3e-ccf0-40fa-9100-df459dba5e14'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:43:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-23c92fd0-06c5-4781-9c07-70ee7f89e342 tempest-VolumesImageMetadata-762667470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:43:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-23c92fd0-06c5-4781-9c07-70ee7f89e342 tempest-VolumesImageMetadata-762667470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:43:03 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-23c92fd0-06c5-4781-9c07-70ee7f89e342 tempest-VolumesImageMetadata-762667470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:43:03 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-23c92fd0-06c5-4781-9c07-70ee7f89e342 tempest-VolumesImageMetadata-762667470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:43:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-23c92fd0-06c5-4781-9c07-70ee7f89e342 tempest-VolumesImageMetadata-762667470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:43:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-23c92fd0-06c5-4781-9c07-70ee7f89e342 tempest-VolumesImageMetadata-762667470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:43:03 devstack sudo[95931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:43:03 devstack sudo[95931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:43:03 devstack sudo[95931]: pam_unix(sudo:session): session closed for user root Jul 08 18:43:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-23c92fd0-06c5-4781-9c07-70ee7f89e342 tempest-VolumesImageMetadata-762667470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.679s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:43:03 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-23c92fd0-06c5-4781-9c07-70ee7f89e342 tempest-VolumesImageMetadata-762667470 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:43:03 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-23c92fd0-06c5-4781-9c07-70ee7f89e342 tempest-VolumesImageMetadata-762667470 None] Deleted volume successfully. Jul 08 18:43:03 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-23c92fd0-06c5-4781-9c07-70ee7f89e342 tempest-VolumesImageMetadata-762667470 None] Lock "cinder-8d3a953b-2cc0-45ff-94ca-ab84c954ae1c-delete_volume" released by "delete_volume" :: held 3.168s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:43:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-2c65f1ea-243a-4008-bdb7-3c49e1585a73 req-b4764869-9655-45c2-9896-bbda96567f89 tempest-AttachVolumeTestJSON-339721191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:43:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-2c65f1ea-243a-4008-bdb7-3c49e1585a73 req-b4764869-9655-45c2-9896-bbda96567f89 tempest-AttachVolumeTestJSON-339721191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:43:04 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[386dad58-c368-4d0c-b6db-0635557abd55]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:43:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-2c65f1ea-243a-4008-bdb7-3c49e1585a73 req-b4764869-9655-45c2-9896-bbda96567f89 tempest-AttachVolumeTestJSON-339721191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3dcf979c-5fe7-437d-be59-b18880bb3a93 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:43:04 devstack sudo[95942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3dcf979c-5fe7-437d-be59-b18880bb3a93 Jul 08 18:43:04 devstack sudo[95942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:43:04 devstack sudo[95942]: pam_unix(sudo:session): session closed for user root Jul 08 18:43:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-2c65f1ea-243a-4008-bdb7-3c49e1585a73 req-b4764869-9655-45c2-9896-bbda96567f89 tempest-AttachVolumeTestJSON-339721191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3dcf979c-5fe7-437d-be59-b18880bb3a93" returned: 0 in 0.880s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:43:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-2c65f1ea-243a-4008-bdb7-3c49e1585a73 req-b4764869-9655-45c2-9896-bbda96567f89 tempest-AttachVolumeTestJSON-339721191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.905s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:43:04 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-2c65f1ea-243a-4008-bdb7-3c49e1585a73 req-b4764869-9655-45c2-9896-bbda96567f89 tempest-AttachVolumeTestJSON-339721191 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2', 'name': 'volume-3dcf979c-5fe7-437d-be59-b18880bb3a93', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd28d38cf-fd55-4822-bb84-f637a3eeb61a', 'enforce_multipath': True} {{(pid=86873) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 18:43:05 devstack cinder-volume[86873]: INFO cinder.volume.manager [req-2c65f1ea-243a-4008-bdb7-3c49e1585a73 req-b4764869-9655-45c2-9896-bbda96567f89 tempest-AttachVolumeTestJSON-339721191 None] attachment_update completed successfully. Jul 08 18:43:08 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-af55744c-1df2-4a37-b599-dd2e33d05d7a tempest-VolumesTransfersTest-69676971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:43:08 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-af55744c-1df2-4a37-b599-dd2e33d05d7a tempest-VolumesTransfersTest-69676971 None] Flow 'volume_create_manager' (444ad19a-f7c3-4931-a098-206a80f11e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:43:08 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-af55744c-1df2-4a37-b599-dd2e33d05d7a tempest-VolumesTransfersTest-69676971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e97cf112-29dd-47cd-8f3f-f873c26ef329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:43:08 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-af55744c-1df2-4a37-b599-dd2e33d05d7a tempest-VolumesTransfersTest-69676971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e97cf112-29dd-47cd-8f3f-f873c26ef329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-41201905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3df1526a-81f7-4c33-be39-18f805d288d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a7fde384fc949c0a8510885d9e097fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:43:08Z,use_quota=True,user_id='c6c7d9a3a1344f55a3d0761928feb875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:43:08 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-af55744c-1df2-4a37-b599-dd2e33d05d7a tempest-VolumesTransfersTest-69676971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e24abd5-d73e-4fc0-ae44-186593b14f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:43:08 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-af55744c-1df2-4a37-b599-dd2e33d05d7a tempest-VolumesTransfersTest-69676971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e24abd5-d73e-4fc0-ae44-186593b14f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:43:08 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-af55744c-1df2-4a37-b599-dd2e33d05d7a tempest-VolumesTransfersTest-69676971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a960425-48d5-49f5-804c-434faff613c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:43:08 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-af55744c-1df2-4a37-b599-dd2e33d05d7a tempest-VolumesTransfersTest-69676971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a960425-48d5-49f5-804c-434faff613c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3df1526a-81f7-4c33-be39-18f805d288d9', 'volume_name': 'volume-3df1526a-81f7-4c33-be39-18f805d288d9', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:43:08 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-af55744c-1df2-4a37-b599-dd2e33d05d7a tempest-VolumesTransfersTest-69676971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeffe13b-8b1e-47ac-8a43-d7df18d2b040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:43:08 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-af55744c-1df2-4a37-b599-dd2e33d05d7a tempest-VolumesTransfersTest-69676971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeffe13b-8b1e-47ac-8a43-d7df18d2b040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:43:08 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-af55744c-1df2-4a37-b599-dd2e33d05d7a tempest-VolumesTransfersTest-69676971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d86f3f7f-ca49-4229-8189-c90016e3101b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:43:08 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-af55744c-1df2-4a37-b599-dd2e33d05d7a tempest-VolumesTransfersTest-69676971 None] Volume 3df1526a-81f7-4c33-be39-18f805d288d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3df1526a-81f7-4c33-be39-18f805d288d9', 'volume_size': 1} Jul 08 18:43:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-af55744c-1df2-4a37-b599-dd2e33d05d7a tempest-VolumesTransfersTest-69676971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:43:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-af55744c-1df2-4a37-b599-dd2e33d05d7a tempest-VolumesTransfersTest-69676971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:43:08 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-af55744c-1df2-4a37-b599-dd2e33d05d7a tempest-VolumesTransfersTest-69676971 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-41201905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3df1526a-81f7-4c33-be39-18f805d288d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a7fde384fc949c0a8510885d9e097fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:43:08Z,use_quota=True,user_id='c6c7d9a3a1344f55a3d0761928feb875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:43:08 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-af55744c-1df2-4a37-b599-dd2e33d05d7a tempest-VolumesTransfersTest-69676971 None] Creating volume 3df1526a-81f7-4c33-be39-18f805d288d9 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:43:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-af55744c-1df2-4a37-b599-dd2e33d05d7a tempest-VolumesTransfersTest-69676971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:43:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-af55744c-1df2-4a37-b599-dd2e33d05d7a tempest-VolumesTransfersTest-69676971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:43:08 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-af55744c-1df2-4a37-b599-dd2e33d05d7a tempest-VolumesTransfersTest-69676971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:43:08 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-af55744c-1df2-4a37-b599-dd2e33d05d7a tempest-VolumesTransfersTest-69676971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:43:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-af55744c-1df2-4a37-b599-dd2e33d05d7a tempest-VolumesTransfersTest-69676971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:43:08 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-af55744c-1df2-4a37-b599-dd2e33d05d7a tempest-VolumesTransfersTest-69676971 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:43:08 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-af55744c-1df2-4a37-b599-dd2e33d05d7a tempest-VolumesTransfersTest-69676971 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:43:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-af55744c-1df2-4a37-b599-dd2e33d05d7a tempest-VolumesTransfersTest-69676971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3df1526a-81f7-4c33-be39-18f805d288d9 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:43:08 devstack sudo[96329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3df1526a-81f7-4c33-be39-18f805d288d9 1073741824 Jul 08 18:43:08 devstack sudo[96329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:43:09 devstack sudo[96329]: pam_unix(sudo:session): session closed for user root Jul 08 18:43:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-af55744c-1df2-4a37-b599-dd2e33d05d7a tempest-VolumesTransfersTest-69676971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3df1526a-81f7-4c33-be39-18f805d288d9 1073741824" returned: 0 in 0.870s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:43:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-af55744c-1df2-4a37-b599-dd2e33d05d7a tempest-VolumesTransfersTest-69676971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3df1526a-81f7-4c33-be39-18f805d288d9 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:43:09 devstack sudo[96335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3df1526a-81f7-4c33-be39-18f805d288d9 Jul 08 18:43:09 devstack sudo[96335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:43:09 devstack sudo[96335]: pam_unix(sudo:session): session closed for user root Jul 08 18:43:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-af55744c-1df2-4a37-b599-dd2e33d05d7a tempest-VolumesTransfersTest-69676971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3df1526a-81f7-4c33-be39-18f805d288d9" returned: 0 in 0.646s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:43:09 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-af55744c-1df2-4a37-b599-dd2e33d05d7a tempest-VolumesTransfersTest-69676971 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:43:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-af55744c-1df2-4a37-b599-dd2e33d05d7a tempest-VolumesTransfersTest-69676971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:43:09 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-af55744c-1df2-4a37-b599-dd2e33d05d7a tempest-VolumesTransfersTest-69676971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d86f3f7f-ca49-4229-8189-c90016e3101b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3df1526a-81f7-4c33-be39-18f805d288d9', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:43:09 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-af55744c-1df2-4a37-b599-dd2e33d05d7a tempest-VolumesTransfersTest-69676971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3ff74e4-ce4f-4d3f-aa67-13933a951d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:43:09 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-af55744c-1df2-4a37-b599-dd2e33d05d7a tempest-VolumesTransfersTest-69676971 None] Volume volume-3df1526a-81f7-4c33-be39-18f805d288d9 (3df1526a-81f7-4c33-be39-18f805d288d9): created successfully Jul 08 18:43:09 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-af55744c-1df2-4a37-b599-dd2e33d05d7a tempest-VolumesTransfersTest-69676971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3ff74e4-ce4f-4d3f-aa67-13933a951d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:43:09 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-af55744c-1df2-4a37-b599-dd2e33d05d7a tempest-VolumesTransfersTest-69676971 None] Flow 'volume_create_manager' (444ad19a-f7c3-4931-a098-206a80f11e02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:43:09 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-af55744c-1df2-4a37-b599-dd2e33d05d7a tempest-VolumesTransfersTest-69676971 None] Created volume successfully. Jul 08 18:43:10 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a63df69-f595-4e14-bdb8-518f9132ec60 tempest-AttachVolumeTestJSON-339721191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:43:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5a63df69-f595-4e14-bdb8-518f9132ec60 tempest-AttachVolumeTestJSON-339721191 None] Flow 'volume_create_manager' (4cf0caaf-ce61-4988-a163-6a2478f4de2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:43:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5a63df69-f595-4e14-bdb8-518f9132ec60 tempest-AttachVolumeTestJSON-339721191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4cb90fc-bfe6-489a-8024-0f71d0a6ac50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:43:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5a63df69-f595-4e14-bdb8-518f9132ec60 tempest-AttachVolumeTestJSON-339721191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4cb90fc-bfe6-489a-8024-0f71d0a6ac50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:43:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-269834029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4313b21-ff1e-4063-ad10-6f47d166eacf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca0fb35f852f43cfa610f321cd0c3609',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:43:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:43:11Z,use_quota=True,user_id='a0502d45925349ba9e1ff3abaa2e395f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:43:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5a63df69-f595-4e14-bdb8-518f9132ec60 tempest-AttachVolumeTestJSON-339721191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cc9fa06-a6b6-4d71-bf23-e19fc76445d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:43:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5a63df69-f595-4e14-bdb8-518f9132ec60 tempest-AttachVolumeTestJSON-339721191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cc9fa06-a6b6-4d71-bf23-e19fc76445d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:43:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5a63df69-f595-4e14-bdb8-518f9132ec60 tempest-AttachVolumeTestJSON-339721191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8b2ce88-cbcc-44b8-b5c8-943dee07aaf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:43:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5a63df69-f595-4e14-bdb8-518f9132ec60 tempest-AttachVolumeTestJSON-339721191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8b2ce88-cbcc-44b8-b5c8-943dee07aaf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4313b21-ff1e-4063-ad10-6f47d166eacf', 'volume_name': 'volume-c4313b21-ff1e-4063-ad10-6f47d166eacf', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:43:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5a63df69-f595-4e14-bdb8-518f9132ec60 tempest-AttachVolumeTestJSON-339721191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4868691-178d-4db6-81d7-d853dcb2c2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:43:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5a63df69-f595-4e14-bdb8-518f9132ec60 tempest-AttachVolumeTestJSON-339721191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4868691-178d-4db6-81d7-d853dcb2c2fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:43:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5a63df69-f595-4e14-bdb8-518f9132ec60 tempest-AttachVolumeTestJSON-339721191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e69411bf-5122-4377-bf9a-532a28015125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:43:10 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-5a63df69-f595-4e14-bdb8-518f9132ec60 tempest-AttachVolumeTestJSON-339721191 None] Volume c4313b21-ff1e-4063-ad10-6f47d166eacf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4313b21-ff1e-4063-ad10-6f47d166eacf', 'volume_size': 1} Jul 08 18:43:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5a63df69-f595-4e14-bdb8-518f9132ec60 tempest-AttachVolumeTestJSON-339721191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:43:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5a63df69-f595-4e14-bdb8-518f9132ec60 tempest-AttachVolumeTestJSON-339721191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:43:10 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-5a63df69-f595-4e14-bdb8-518f9132ec60 tempest-AttachVolumeTestJSON-339721191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:43:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-269834029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4313b21-ff1e-4063-ad10-6f47d166eacf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca0fb35f852f43cfa610f321cd0c3609',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:43:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:43:11Z,use_quota=True,user_id='a0502d45925349ba9e1ff3abaa2e395f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:43:10 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-5a63df69-f595-4e14-bdb8-518f9132ec60 tempest-AttachVolumeTestJSON-339721191 None] Creating volume c4313b21-ff1e-4063-ad10-6f47d166eacf {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:43:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5a63df69-f595-4e14-bdb8-518f9132ec60 tempest-AttachVolumeTestJSON-339721191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:43:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5a63df69-f595-4e14-bdb8-518f9132ec60 tempest-AttachVolumeTestJSON-339721191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:43:10 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-5a63df69-f595-4e14-bdb8-518f9132ec60 tempest-AttachVolumeTestJSON-339721191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:43:10 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-5a63df69-f595-4e14-bdb8-518f9132ec60 tempest-AttachVolumeTestJSON-339721191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:43:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5a63df69-f595-4e14-bdb8-518f9132ec60 tempest-AttachVolumeTestJSON-339721191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:43:10 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-5a63df69-f595-4e14-bdb8-518f9132ec60 tempest-AttachVolumeTestJSON-339721191 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:43:10 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-5a63df69-f595-4e14-bdb8-518f9132ec60 tempest-AttachVolumeTestJSON-339721191 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:43:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5a63df69-f595-4e14-bdb8-518f9132ec60 tempest-AttachVolumeTestJSON-339721191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c4313b21-ff1e-4063-ad10-6f47d166eacf 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:43:10 devstack sudo[96339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c4313b21-ff1e-4063-ad10-6f47d166eacf 1073741824 Jul 08 18:43:10 devstack sudo[96339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:43:10 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-cdf05c81-80f2-492c-92c7-c86d7af169d3 tempest-VolumesTransfersTest-254717747 None] Transfer volume completed successfully. Jul 08 18:43:11 devstack sudo[96339]: pam_unix(sudo:session): session closed for user root Jul 08 18:43:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5a63df69-f595-4e14-bdb8-518f9132ec60 tempest-AttachVolumeTestJSON-339721191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c4313b21-ff1e-4063-ad10-6f47d166eacf 1073741824" returned: 0 in 0.908s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:43:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5a63df69-f595-4e14-bdb8-518f9132ec60 tempest-AttachVolumeTestJSON-339721191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c4313b21-ff1e-4063-ad10-6f47d166eacf {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:43:11 devstack sudo[96345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c4313b21-ff1e-4063-ad10-6f47d166eacf Jul 08 18:43:11 devstack sudo[96345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:43:11 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-03aa61fd-f0f6-49d8-9ab0-31bda6ade2b6 tempest-VolumesTransfersTest-1012125194 None] Acquiring lock "cinder-3df1526a-81f7-4c33-be39-18f805d288d9-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:43:11 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-03aa61fd-f0f6-49d8-9ab0-31bda6ade2b6 tempest-VolumesTransfersTest-1012125194 None] Lock "cinder-3df1526a-81f7-4c33-be39-18f805d288d9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:43:12 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-03aa61fd-f0f6-49d8-9ab0-31bda6ade2b6 tempest-VolumesTransfersTest-1012125194 None] Acquiring lock "cinder-quobyte-3df1526a-81f7-4c33-be39-18f805d288d9" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:43:12 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-03aa61fd-f0f6-49d8-9ab0-31bda6ade2b6 tempest-VolumesTransfersTest-1012125194 None] Lock "cinder-quobyte-3df1526a-81f7-4c33-be39-18f805d288d9" acquired by "delete_volume" :: waited 0.018s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:43:12 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a8d20d-50de-43f9-adaf-5211c4c91440]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:43:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-03aa61fd-f0f6-49d8-9ab0-31bda6ade2b6 tempest-VolumesTransfersTest-1012125194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3df1526a-81f7-4c33-be39-18f805d288d9 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:43:12 devstack sudo[96348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3df1526a-81f7-4c33-be39-18f805d288d9 Jul 08 18:43:12 devstack sudo[96348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:43:12 devstack sudo[96345]: pam_unix(sudo:session): session closed for user root Jul 08 18:43:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5a63df69-f595-4e14-bdb8-518f9132ec60 tempest-AttachVolumeTestJSON-339721191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c4313b21-ff1e-4063-ad10-6f47d166eacf" returned: 0 in 0.670s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:43:12 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-5a63df69-f595-4e14-bdb8-518f9132ec60 tempest-AttachVolumeTestJSON-339721191 None] <== create_volume: return (1632ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:43:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5a63df69-f595-4e14-bdb8-518f9132ec60 tempest-AttachVolumeTestJSON-339721191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:43:12 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5a63df69-f595-4e14-bdb8-518f9132ec60 tempest-AttachVolumeTestJSON-339721191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e69411bf-5122-4377-bf9a-532a28015125) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4313b21-ff1e-4063-ad10-6f47d166eacf', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:43:12 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5a63df69-f595-4e14-bdb8-518f9132ec60 tempest-AttachVolumeTestJSON-339721191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d85b1068-437e-46f8-a1c7-a4eda7ad1a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:43:12 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-5a63df69-f595-4e14-bdb8-518f9132ec60 tempest-AttachVolumeTestJSON-339721191 None] Volume volume-c4313b21-ff1e-4063-ad10-6f47d166eacf (c4313b21-ff1e-4063-ad10-6f47d166eacf): created successfully Jul 08 18:43:12 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5a63df69-f595-4e14-bdb8-518f9132ec60 tempest-AttachVolumeTestJSON-339721191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d85b1068-437e-46f8-a1c7-a4eda7ad1a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:43:12 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5a63df69-f595-4e14-bdb8-518f9132ec60 tempest-AttachVolumeTestJSON-339721191 None] Flow 'volume_create_manager' (4cf0caaf-ce61-4988-a163-6a2478f4de2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:43:12 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-5a63df69-f595-4e14-bdb8-518f9132ec60 tempest-AttachVolumeTestJSON-339721191 None] Created volume successfully. Jul 08 18:43:12 devstack sudo[96348]: pam_unix(sudo:session): session closed for user root Jul 08 18:43:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-03aa61fd-f0f6-49d8-9ab0-31bda6ade2b6 tempest-VolumesTransfersTest-1012125194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3df1526a-81f7-4c33-be39-18f805d288d9" returned: 0 in 0.787s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:43:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-03aa61fd-f0f6-49d8-9ab0-31bda6ade2b6 tempest-VolumesTransfersTest-1012125194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3df1526a-81f7-4c33-be39-18f805d288d9 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:43:12 devstack sudo[96354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3df1526a-81f7-4c33-be39-18f805d288d9 Jul 08 18:43:12 devstack sudo[96354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:43:13 devstack sudo[96354]: pam_unix(sudo:session): session closed for user root Jul 08 18:43:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-03aa61fd-f0f6-49d8-9ab0-31bda6ade2b6 tempest-VolumesTransfersTest-1012125194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3df1526a-81f7-4c33-be39-18f805d288d9" returned: 0 in 0.662s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:43:13 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-03aa61fd-f0f6-49d8-9ab0-31bda6ade2b6 tempest-VolumesTransfersTest-1012125194 None] Lock "cinder-quobyte-3df1526a-81f7-4c33-be39-18f805d288d9" released by "delete_volume" :: held 1.487s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:43:13 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-03aa61fd-f0f6-49d8-9ab0-31bda6ade2b6 tempest-VolumesTransfersTest-1012125194 None] Created reservations ['ab52103f-ff46-4401-aa0a-1ec33ce88fca', 'faf0aaa6-34bc-461c-8289-f26c9cde9784', '4cbd2391-15f4-40e0-a77c-dda5cdd0c4be', '728fac5e-114e-4f5a-9e21-00b8104dc1ef'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:43:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-03aa61fd-f0f6-49d8-9ab0-31bda6ade2b6 tempest-VolumesTransfersTest-1012125194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:43:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-03aa61fd-f0f6-49d8-9ab0-31bda6ade2b6 tempest-VolumesTransfersTest-1012125194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:43:13 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-03aa61fd-f0f6-49d8-9ab0-31bda6ade2b6 tempest-VolumesTransfersTest-1012125194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:43:13 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-03aa61fd-f0f6-49d8-9ab0-31bda6ade2b6 tempest-VolumesTransfersTest-1012125194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:43:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-03aa61fd-f0f6-49d8-9ab0-31bda6ade2b6 tempest-VolumesTransfersTest-1012125194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:43:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-03aa61fd-f0f6-49d8-9ab0-31bda6ade2b6 tempest-VolumesTransfersTest-1012125194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:43:13 devstack sudo[96360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:43:13 devstack sudo[96360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:43:14 devstack sudo[96360]: pam_unix(sudo:session): session closed for user root Jul 08 18:43:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-03aa61fd-f0f6-49d8-9ab0-31bda6ade2b6 tempest-VolumesTransfersTest-1012125194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.632s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:43:14 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-03aa61fd-f0f6-49d8-9ab0-31bda6ade2b6 tempest-VolumesTransfersTest-1012125194 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:43:14 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-03aa61fd-f0f6-49d8-9ab0-31bda6ade2b6 tempest-VolumesTransfersTest-1012125194 None] Deleted volume successfully. Jul 08 18:43:14 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-03aa61fd-f0f6-49d8-9ab0-31bda6ade2b6 tempest-VolumesTransfersTest-1012125194 None] Lock "cinder-3df1526a-81f7-4c33-be39-18f805d288d9-delete_volume" released by "delete_volume" :: held 2.359s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:43:14 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-aece7a1a-8a7a-4094-82b9-dbe0f410dabe tempest-VolumesTransfersTest-69676971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:43:14 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-aece7a1a-8a7a-4094-82b9-dbe0f410dabe tempest-VolumesTransfersTest-69676971 None] Flow 'volume_create_manager' (8941188b-bfca-4c24-8317-ec5d8e656dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:43:14 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-aece7a1a-8a7a-4094-82b9-dbe0f410dabe tempest-VolumesTransfersTest-69676971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a18fbfab-5554-4fe0-b639-7b08e030a8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:43:14 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-aece7a1a-8a7a-4094-82b9-dbe0f410dabe tempest-VolumesTransfersTest-69676971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a18fbfab-5554-4fe0-b639-7b08e030a8fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:43:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1011561625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba3ea3f6-2c64-45d7-aa76-06672ffdc279,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a7fde384fc949c0a8510885d9e097fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:43:15Z,use_quota=True,user_id='c6c7d9a3a1344f55a3d0761928feb875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:43:14 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-aece7a1a-8a7a-4094-82b9-dbe0f410dabe tempest-VolumesTransfersTest-69676971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fe68f9b-98f6-49d1-850c-38f8aee7a568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:43:14 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-aece7a1a-8a7a-4094-82b9-dbe0f410dabe tempest-VolumesTransfersTest-69676971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fe68f9b-98f6-49d1-850c-38f8aee7a568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:43:14 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-aece7a1a-8a7a-4094-82b9-dbe0f410dabe tempest-VolumesTransfersTest-69676971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2297b60-4fd6-44cd-a3c3-bd72524dcfee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:43:14 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-aece7a1a-8a7a-4094-82b9-dbe0f410dabe tempest-VolumesTransfersTest-69676971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2297b60-4fd6-44cd-a3c3-bd72524dcfee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba3ea3f6-2c64-45d7-aa76-06672ffdc279', 'volume_name': 'volume-ba3ea3f6-2c64-45d7-aa76-06672ffdc279', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:43:14 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-aece7a1a-8a7a-4094-82b9-dbe0f410dabe tempest-VolumesTransfersTest-69676971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45288584-a92c-4a34-bfcb-cf40b69fcd49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:43:14 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-aece7a1a-8a7a-4094-82b9-dbe0f410dabe tempest-VolumesTransfersTest-69676971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45288584-a92c-4a34-bfcb-cf40b69fcd49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:43:14 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-aece7a1a-8a7a-4094-82b9-dbe0f410dabe tempest-VolumesTransfersTest-69676971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3538e47-a42c-436b-9c68-8e46677909b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:43:14 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-aece7a1a-8a7a-4094-82b9-dbe0f410dabe tempest-VolumesTransfersTest-69676971 None] Volume ba3ea3f6-2c64-45d7-aa76-06672ffdc279: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba3ea3f6-2c64-45d7-aa76-06672ffdc279', 'volume_size': 1} Jul 08 18:43:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-aece7a1a-8a7a-4094-82b9-dbe0f410dabe tempest-VolumesTransfersTest-69676971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:43:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-aece7a1a-8a7a-4094-82b9-dbe0f410dabe tempest-VolumesTransfersTest-69676971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:43:14 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-aece7a1a-8a7a-4094-82b9-dbe0f410dabe tempest-VolumesTransfersTest-69676971 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:43:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1011561625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba3ea3f6-2c64-45d7-aa76-06672ffdc279,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a7fde384fc949c0a8510885d9e097fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:43:15Z,use_quota=True,user_id='c6c7d9a3a1344f55a3d0761928feb875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:43:14 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-aece7a1a-8a7a-4094-82b9-dbe0f410dabe tempest-VolumesTransfersTest-69676971 None] Creating volume ba3ea3f6-2c64-45d7-aa76-06672ffdc279 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:43:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-aece7a1a-8a7a-4094-82b9-dbe0f410dabe tempest-VolumesTransfersTest-69676971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:43:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-aece7a1a-8a7a-4094-82b9-dbe0f410dabe tempest-VolumesTransfersTest-69676971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:43:14 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-aece7a1a-8a7a-4094-82b9-dbe0f410dabe tempest-VolumesTransfersTest-69676971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:43:14 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-aece7a1a-8a7a-4094-82b9-dbe0f410dabe tempest-VolumesTransfersTest-69676971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:43:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-aece7a1a-8a7a-4094-82b9-dbe0f410dabe tempest-VolumesTransfersTest-69676971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:43:14 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-aece7a1a-8a7a-4094-82b9-dbe0f410dabe tempest-VolumesTransfersTest-69676971 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:43:14 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-aece7a1a-8a7a-4094-82b9-dbe0f410dabe tempest-VolumesTransfersTest-69676971 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:43:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-aece7a1a-8a7a-4094-82b9-dbe0f410dabe tempest-VolumesTransfersTest-69676971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ba3ea3f6-2c64-45d7-aa76-06672ffdc279 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:43:14 devstack sudo[96363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ba3ea3f6-2c64-45d7-aa76-06672ffdc279 1073741824 Jul 08 18:43:14 devstack sudo[96363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:43:15 devstack sudo[96363]: pam_unix(sudo:session): session closed for user root Jul 08 18:43:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-aece7a1a-8a7a-4094-82b9-dbe0f410dabe tempest-VolumesTransfersTest-69676971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ba3ea3f6-2c64-45d7-aa76-06672ffdc279 1073741824" returned: 0 in 0.878s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:43:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-aece7a1a-8a7a-4094-82b9-dbe0f410dabe tempest-VolumesTransfersTest-69676971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ba3ea3f6-2c64-45d7-aa76-06672ffdc279 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:43:15 devstack sudo[96374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ba3ea3f6-2c64-45d7-aa76-06672ffdc279 Jul 08 18:43:15 devstack sudo[96374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:43:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-ac02c9a2-3788-4847-bdb8-244e2fcffb84 req-58621921-b93e-4a98-9925-e3bb19195f47 tempest-AttachVolumeTestJSON-339721191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:43:16 devstack sudo[96374]: pam_unix(sudo:session): session closed for user root Jul 08 18:43:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-aece7a1a-8a7a-4094-82b9-dbe0f410dabe tempest-VolumesTransfersTest-69676971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ba3ea3f6-2c64-45d7-aa76-06672ffdc279" returned: 0 in 0.643s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:43:16 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-aece7a1a-8a7a-4094-82b9-dbe0f410dabe tempest-VolumesTransfersTest-69676971 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:43:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-aece7a1a-8a7a-4094-82b9-dbe0f410dabe tempest-VolumesTransfersTest-69676971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.567s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:43:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-ac02c9a2-3788-4847-bdb8-244e2fcffb84 req-58621921-b93e-4a98-9925-e3bb19195f47 tempest-AttachVolumeTestJSON-339721191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.245s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:43:16 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-aece7a1a-8a7a-4094-82b9-dbe0f410dabe tempest-VolumesTransfersTest-69676971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3538e47-a42c-436b-9c68-8e46677909b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba3ea3f6-2c64-45d7-aa76-06672ffdc279', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:43:16 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-aece7a1a-8a7a-4094-82b9-dbe0f410dabe tempest-VolumesTransfersTest-69676971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbff7683-e280-4fb5-a529-21182d632704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:43:16 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc23fca-ac46-4ba0-aab8-65ddff9832bc]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:43:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-ac02c9a2-3788-4847-bdb8-244e2fcffb84 req-58621921-b93e-4a98-9925-e3bb19195f47 tempest-AttachVolumeTestJSON-339721191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c4313b21-ff1e-4063-ad10-6f47d166eacf {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:43:16 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-aece7a1a-8a7a-4094-82b9-dbe0f410dabe tempest-VolumesTransfersTest-69676971 None] Volume volume-ba3ea3f6-2c64-45d7-aa76-06672ffdc279 (ba3ea3f6-2c64-45d7-aa76-06672ffdc279): created successfully Jul 08 18:43:16 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-aece7a1a-8a7a-4094-82b9-dbe0f410dabe tempest-VolumesTransfersTest-69676971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbff7683-e280-4fb5-a529-21182d632704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:43:16 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-aece7a1a-8a7a-4094-82b9-dbe0f410dabe tempest-VolumesTransfersTest-69676971 None] Flow 'volume_create_manager' (8941188b-bfca-4c24-8317-ec5d8e656dc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:43:16 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-aece7a1a-8a7a-4094-82b9-dbe0f410dabe tempest-VolumesTransfersTest-69676971 None] Created volume successfully. Jul 08 18:43:16 devstack sudo[96385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c4313b21-ff1e-4063-ad10-6f47d166eacf Jul 08 18:43:16 devstack sudo[96385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:43:17 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-5d7d8bca-8a2f-46d7-bf95-14b83f4963b6 tempest-VolumesTransfersTest-1012125194 None] Acquiring lock "cinder-ba3ea3f6-2c64-45d7-aa76-06672ffdc279-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:43:17 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-5d7d8bca-8a2f-46d7-bf95-14b83f4963b6 tempest-VolumesTransfersTest-1012125194 None] Lock "cinder-ba3ea3f6-2c64-45d7-aa76-06672ffdc279-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:43:17 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-5d7d8bca-8a2f-46d7-bf95-14b83f4963b6 tempest-VolumesTransfersTest-1012125194 None] Acquiring lock "cinder-quobyte-ba3ea3f6-2c64-45d7-aa76-06672ffdc279" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:43:17 devstack sudo[96385]: pam_unix(sudo:session): session closed for user root Jul 08 18:43:17 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-5d7d8bca-8a2f-46d7-bf95-14b83f4963b6 tempest-VolumesTransfersTest-1012125194 None] Lock "cinder-quobyte-ba3ea3f6-2c64-45d7-aa76-06672ffdc279" acquired by "delete_volume" :: waited 0.017s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:43:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-ac02c9a2-3788-4847-bdb8-244e2fcffb84 req-58621921-b93e-4a98-9925-e3bb19195f47 tempest-AttachVolumeTestJSON-339721191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c4313b21-ff1e-4063-ad10-6f47d166eacf" returned: 0 in 0.781s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:43:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-ac02c9a2-3788-4847-bdb8-244e2fcffb84 req-58621921-b93e-4a98-9925-e3bb19195f47 tempest-AttachVolumeTestJSON-339721191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.811s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:43:17 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb4f1d9-d639-40dc-aa83-e6087ab66a36]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:43:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5d7d8bca-8a2f-46d7-bf95-14b83f4963b6 tempest-VolumesTransfersTest-1012125194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ba3ea3f6-2c64-45d7-aa76-06672ffdc279 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:43:17 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-ac02c9a2-3788-4847-bdb8-244e2fcffb84 req-58621921-b93e-4a98-9925-e3bb19195f47 tempest-AttachVolumeTestJSON-339721191 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2', 'name': 'volume-c4313b21-ff1e-4063-ad10-6f47d166eacf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '316b6cf3-22c5-4f61-a40d-f226bdca1da7', 'enforce_multipath': True} {{(pid=86873) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 18:43:17 devstack cinder-volume[86873]: INFO cinder.volume.manager [req-ac02c9a2-3788-4847-bdb8-244e2fcffb84 req-58621921-b93e-4a98-9925-e3bb19195f47 tempest-AttachVolumeTestJSON-339721191 None] attachment_update completed successfully. Jul 08 18:43:17 devstack sudo[96390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ba3ea3f6-2c64-45d7-aa76-06672ffdc279 Jul 08 18:43:17 devstack sudo[96390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:43:17 devstack sudo[96390]: pam_unix(sudo:session): session closed for user root Jul 08 18:43:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5d7d8bca-8a2f-46d7-bf95-14b83f4963b6 tempest-VolumesTransfersTest-1012125194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ba3ea3f6-2c64-45d7-aa76-06672ffdc279" returned: 0 in 0.766s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:43:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5d7d8bca-8a2f-46d7-bf95-14b83f4963b6 tempest-VolumesTransfersTest-1012125194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ba3ea3f6-2c64-45d7-aa76-06672ffdc279 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:43:17 devstack sudo[96395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ba3ea3f6-2c64-45d7-aa76-06672ffdc279 Jul 08 18:43:17 devstack sudo[96395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:43:18 devstack sudo[96395]: pam_unix(sudo:session): session closed for user root Jul 08 18:43:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5d7d8bca-8a2f-46d7-bf95-14b83f4963b6 tempest-VolumesTransfersTest-1012125194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ba3ea3f6-2c64-45d7-aa76-06672ffdc279" returned: 0 in 0.671s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:43:18 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-5d7d8bca-8a2f-46d7-bf95-14b83f4963b6 tempest-VolumesTransfersTest-1012125194 None] Lock "cinder-quobyte-ba3ea3f6-2c64-45d7-aa76-06672ffdc279" released by "delete_volume" :: held 1.477s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:43:18 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-5d7d8bca-8a2f-46d7-bf95-14b83f4963b6 tempest-VolumesTransfersTest-1012125194 None] Created reservations ['d3d3df83-1e1d-4fbc-a6da-eaa6fa7f95b3', '46e707f2-7103-4506-abe1-2d848bd8a45a', '9496b33e-2e80-4b82-b4f6-a048ac0f50f9', '51519e8d-f211-4e6d-881a-b2442e4b207e'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:43:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5d7d8bca-8a2f-46d7-bf95-14b83f4963b6 tempest-VolumesTransfersTest-1012125194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:43:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5d7d8bca-8a2f-46d7-bf95-14b83f4963b6 tempest-VolumesTransfersTest-1012125194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:43:18 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-5d7d8bca-8a2f-46d7-bf95-14b83f4963b6 tempest-VolumesTransfersTest-1012125194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:43:18 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-5d7d8bca-8a2f-46d7-bf95-14b83f4963b6 tempest-VolumesTransfersTest-1012125194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:43:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5d7d8bca-8a2f-46d7-bf95-14b83f4963b6 tempest-VolumesTransfersTest-1012125194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:43:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5d7d8bca-8a2f-46d7-bf95-14b83f4963b6 tempest-VolumesTransfersTest-1012125194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:43:18 devstack sudo[96401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:43:18 devstack sudo[96401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:43:19 devstack sudo[96401]: pam_unix(sudo:session): session closed for user root Jul 08 18:43:19 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5d7d8bca-8a2f-46d7-bf95-14b83f4963b6 tempest-VolumesTransfersTest-1012125194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.687s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:43:19 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-5d7d8bca-8a2f-46d7-bf95-14b83f4963b6 tempest-VolumesTransfersTest-1012125194 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:43:19 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-5d7d8bca-8a2f-46d7-bf95-14b83f4963b6 tempest-VolumesTransfersTest-1012125194 None] Deleted volume successfully. Jul 08 18:43:19 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-5d7d8bca-8a2f-46d7-bf95-14b83f4963b6 tempest-VolumesTransfersTest-1012125194 None] Lock "cinder-ba3ea3f6-2c64-45d7-aa76-06672ffdc279-delete_volume" released by "delete_volume" :: held 2.368s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:43:23 devstack cinder-volume[86873]: INFO cinder.volume.manager [req-97b8a832-db17-4722-a1c1-8752abba5424 req-4c4117f1-2544-4c95-9c41-cd61dbae924d tempest-AttachVolumeTestJSON-339721191 None] Terminate volume connection completed successfully. Jul 08 18:43:23 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-97b8a832-db17-4722-a1c1-8752abba5424 req-4c4117f1-2544-4c95-9c41-cd61dbae924d tempest-AttachVolumeTestJSON-339721191 None] Deleting attachment d28d38cf-fd55-4822-bb84-f637a3eeb61a. {{(pid=86873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 18:43:26 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:SELECT=92,cinder:INSERT=30,cinder:UPDATE=107,cinder:DELETE=7 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:43:26 devstack cinder-volume[86873]: INFO cinder.volume.manager [req-1691c785-aab3-4c2b-82c3-9021dd81d200 req-5a79cbe9-aa13-4d27-967f-aaeec2ce77db tempest-AttachVolumeTestJSON-339721191 None] Terminate volume connection completed successfully. Jul 08 18:43:26 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-1691c785-aab3-4c2b-82c3-9021dd81d200 req-5a79cbe9-aa13-4d27-967f-aaeec2ce77db tempest-AttachVolumeTestJSON-339721191 None] Deleting attachment 316b6cf3-22c5-4f61-a40d-f226bdca1da7. {{(pid=86873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 18:43:33 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6298dea-0962-4a23-8f95-0ddd9f9c7c87 tempest-VolumesActionsTest-1330750976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:43:33 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f6298dea-0962-4a23-8f95-0ddd9f9c7c87 tempest-VolumesActionsTest-1330750976 None] Flow 'volume_create_manager' (ad044229-a122-460d-b43a-746043ca2876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:43:33 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f6298dea-0962-4a23-8f95-0ddd9f9c7c87 tempest-VolumesActionsTest-1330750976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (574532ba-044e-4b54-b4b0-02f808057bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:43:33 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f6298dea-0962-4a23-8f95-0ddd9f9c7c87 tempest-VolumesActionsTest-1330750976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (574532ba-044e-4b54-b4b0-02f808057bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:43:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1929659483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ff6df71-4736-4ad1-84f3-44d971402f38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50b5d09711e34452bd44be61726fba2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:43:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:43:33Z,use_quota=True,user_id='82cb490ac38a4c8ab9feb196d103930d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:43:33 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f6298dea-0962-4a23-8f95-0ddd9f9c7c87 tempest-VolumesActionsTest-1330750976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6789a6df-dd75-4286-afec-eaaded3905f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:43:33 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f6298dea-0962-4a23-8f95-0ddd9f9c7c87 tempest-VolumesActionsTest-1330750976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6789a6df-dd75-4286-afec-eaaded3905f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:43:33 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f6298dea-0962-4a23-8f95-0ddd9f9c7c87 tempest-VolumesActionsTest-1330750976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3ebc149-ce8a-4928-bbf7-9767f465b93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:43:33 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f6298dea-0962-4a23-8f95-0ddd9f9c7c87 tempest-VolumesActionsTest-1330750976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3ebc149-ce8a-4928-bbf7-9767f465b93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ff6df71-4736-4ad1-84f3-44d971402f38', 'volume_name': 'volume-8ff6df71-4736-4ad1-84f3-44d971402f38', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:43:33 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f6298dea-0962-4a23-8f95-0ddd9f9c7c87 tempest-VolumesActionsTest-1330750976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (411c7b6c-4386-4bf3-b4bf-d09851ecbc72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:43:33 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f6298dea-0962-4a23-8f95-0ddd9f9c7c87 tempest-VolumesActionsTest-1330750976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (411c7b6c-4386-4bf3-b4bf-d09851ecbc72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:43:33 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f6298dea-0962-4a23-8f95-0ddd9f9c7c87 tempest-VolumesActionsTest-1330750976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71bb815b-c85a-4e15-af99-224d426f434e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:43:33 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-f6298dea-0962-4a23-8f95-0ddd9f9c7c87 tempest-VolumesActionsTest-1330750976 None] Volume 8ff6df71-4736-4ad1-84f3-44d971402f38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ff6df71-4736-4ad1-84f3-44d971402f38', 'volume_size': 1} Jul 08 18:43:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f6298dea-0962-4a23-8f95-0ddd9f9c7c87 tempest-VolumesActionsTest-1330750976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:43:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f6298dea-0962-4a23-8f95-0ddd9f9c7c87 tempest-VolumesActionsTest-1330750976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:43:33 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-f6298dea-0962-4a23-8f95-0ddd9f9c7c87 tempest-VolumesActionsTest-1330750976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:43:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1929659483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ff6df71-4736-4ad1-84f3-44d971402f38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50b5d09711e34452bd44be61726fba2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:43:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:43:33Z,use_quota=True,user_id='82cb490ac38a4c8ab9feb196d103930d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:43:33 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-f6298dea-0962-4a23-8f95-0ddd9f9c7c87 tempest-VolumesActionsTest-1330750976 None] Creating volume 8ff6df71-4736-4ad1-84f3-44d971402f38 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:43:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f6298dea-0962-4a23-8f95-0ddd9f9c7c87 tempest-VolumesActionsTest-1330750976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:43:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f6298dea-0962-4a23-8f95-0ddd9f9c7c87 tempest-VolumesActionsTest-1330750976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:43:33 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-f6298dea-0962-4a23-8f95-0ddd9f9c7c87 tempest-VolumesActionsTest-1330750976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:43:33 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-f6298dea-0962-4a23-8f95-0ddd9f9c7c87 tempest-VolumesActionsTest-1330750976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:43:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f6298dea-0962-4a23-8f95-0ddd9f9c7c87 tempest-VolumesActionsTest-1330750976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:43:33 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-f6298dea-0962-4a23-8f95-0ddd9f9c7c87 tempest-VolumesActionsTest-1330750976 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:43:33 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-f6298dea-0962-4a23-8f95-0ddd9f9c7c87 tempest-VolumesActionsTest-1330750976 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:43:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f6298dea-0962-4a23-8f95-0ddd9f9c7c87 tempest-VolumesActionsTest-1330750976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8ff6df71-4736-4ad1-84f3-44d971402f38 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:43:33 devstack sudo[96462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8ff6df71-4736-4ad1-84f3-44d971402f38 1073741824 Jul 08 18:43:33 devstack sudo[96462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:43:34 devstack sudo[96462]: pam_unix(sudo:session): session closed for user root Jul 08 18:43:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f6298dea-0962-4a23-8f95-0ddd9f9c7c87 tempest-VolumesActionsTest-1330750976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8ff6df71-4736-4ad1-84f3-44d971402f38 1073741824" returned: 0 in 0.851s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:43:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f6298dea-0962-4a23-8f95-0ddd9f9c7c87 tempest-VolumesActionsTest-1330750976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8ff6df71-4736-4ad1-84f3-44d971402f38 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:43:34 devstack sudo[96467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8ff6df71-4736-4ad1-84f3-44d971402f38 Jul 08 18:43:34 devstack sudo[96467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:43:35 devstack sudo[96467]: pam_unix(sudo:session): session closed for user root Jul 08 18:43:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f6298dea-0962-4a23-8f95-0ddd9f9c7c87 tempest-VolumesActionsTest-1330750976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8ff6df71-4736-4ad1-84f3-44d971402f38" returned: 0 in 0.667s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:43:35 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-f6298dea-0962-4a23-8f95-0ddd9f9c7c87 tempest-VolumesActionsTest-1330750976 None] <== create_volume: return (1563ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:43:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f6298dea-0962-4a23-8f95-0ddd9f9c7c87 tempest-VolumesActionsTest-1330750976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:43:35 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f6298dea-0962-4a23-8f95-0ddd9f9c7c87 tempest-VolumesActionsTest-1330750976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71bb815b-c85a-4e15-af99-224d426f434e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ff6df71-4736-4ad1-84f3-44d971402f38', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:43:35 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f6298dea-0962-4a23-8f95-0ddd9f9c7c87 tempest-VolumesActionsTest-1330750976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (948b0872-58c2-46c1-9511-1af8ac988037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:43:35 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-f6298dea-0962-4a23-8f95-0ddd9f9c7c87 tempest-VolumesActionsTest-1330750976 None] Volume volume-8ff6df71-4736-4ad1-84f3-44d971402f38 (8ff6df71-4736-4ad1-84f3-44d971402f38): created successfully Jul 08 18:43:35 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f6298dea-0962-4a23-8f95-0ddd9f9c7c87 tempest-VolumesActionsTest-1330750976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (948b0872-58c2-46c1-9511-1af8ac988037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:43:35 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f6298dea-0962-4a23-8f95-0ddd9f9c7c87 tempest-VolumesActionsTest-1330750976 None] Flow 'volume_create_manager' (ad044229-a122-460d-b43a-746043ca2876) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:43:35 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-f6298dea-0962-4a23-8f95-0ddd9f9c7c87 tempest-VolumesActionsTest-1330750976 None] Created volume successfully. Jul 08 18:43:38 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-1bcc0cdf-23d5-4b59-935b-9caaba1050a2 tempest-AttachVolumeTestJSON-339721191 None] Acquiring lock "cinder-c4313b21-ff1e-4063-ad10-6f47d166eacf-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:43:38 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-1bcc0cdf-23d5-4b59-935b-9caaba1050a2 tempest-AttachVolumeTestJSON-339721191 None] Lock "cinder-c4313b21-ff1e-4063-ad10-6f47d166eacf-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:43:38 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-1bcc0cdf-23d5-4b59-935b-9caaba1050a2 tempest-AttachVolumeTestJSON-339721191 None] Acquiring lock "cinder-quobyte-c4313b21-ff1e-4063-ad10-6f47d166eacf" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:43:38 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-1bcc0cdf-23d5-4b59-935b-9caaba1050a2 tempest-AttachVolumeTestJSON-339721191 None] Lock "cinder-quobyte-c4313b21-ff1e-4063-ad10-6f47d166eacf" acquired by "delete_volume" :: waited 0.029s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:43:38 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c62640d-be07-4963-bf3e-f7c69ff572c9]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:43:38 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1bcc0cdf-23d5-4b59-935b-9caaba1050a2 tempest-AttachVolumeTestJSON-339721191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c4313b21-ff1e-4063-ad10-6f47d166eacf {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:43:38 devstack sudo[96474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c4313b21-ff1e-4063-ad10-6f47d166eacf Jul 08 18:43:38 devstack sudo[96474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:43:39 devstack sudo[96474]: pam_unix(sudo:session): session closed for user root Jul 08 18:43:39 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1bcc0cdf-23d5-4b59-935b-9caaba1050a2 tempest-AttachVolumeTestJSON-339721191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c4313b21-ff1e-4063-ad10-6f47d166eacf" returned: 0 in 0.853s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:43:39 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1bcc0cdf-23d5-4b59-935b-9caaba1050a2 tempest-AttachVolumeTestJSON-339721191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c4313b21-ff1e-4063-ad10-6f47d166eacf {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:43:39 devstack sudo[96479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c4313b21-ff1e-4063-ad10-6f47d166eacf Jul 08 18:43:39 devstack sudo[96479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:43:40 devstack sudo[96479]: pam_unix(sudo:session): session closed for user root Jul 08 18:43:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1bcc0cdf-23d5-4b59-935b-9caaba1050a2 tempest-AttachVolumeTestJSON-339721191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c4313b21-ff1e-4063-ad10-6f47d166eacf" returned: 0 in 0.663s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:43:40 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-1bcc0cdf-23d5-4b59-935b-9caaba1050a2 tempest-AttachVolumeTestJSON-339721191 None] Lock "cinder-quobyte-c4313b21-ff1e-4063-ad10-6f47d166eacf" released by "delete_volume" :: held 1.577s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:43:40 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-1bcc0cdf-23d5-4b59-935b-9caaba1050a2 tempest-AttachVolumeTestJSON-339721191 None] Created reservations ['6986077d-0ff3-4810-b1b1-46a1e09d03ae', 'e2f2f3b8-2f5e-43bd-92b6-d7cdc7008424', '156027c4-48f3-4249-bc42-727229fedc7e', '76bc7788-de68-442c-b9a6-786910322b29'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:43:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1bcc0cdf-23d5-4b59-935b-9caaba1050a2 tempest-AttachVolumeTestJSON-339721191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:43:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1bcc0cdf-23d5-4b59-935b-9caaba1050a2 tempest-AttachVolumeTestJSON-339721191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:43:40 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-1bcc0cdf-23d5-4b59-935b-9caaba1050a2 tempest-AttachVolumeTestJSON-339721191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:43:40 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-1bcc0cdf-23d5-4b59-935b-9caaba1050a2 tempest-AttachVolumeTestJSON-339721191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:43:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1bcc0cdf-23d5-4b59-935b-9caaba1050a2 tempest-AttachVolumeTestJSON-339721191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:43:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1bcc0cdf-23d5-4b59-935b-9caaba1050a2 tempest-AttachVolumeTestJSON-339721191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:43:40 devstack sudo[96482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:43:40 devstack sudo[96482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:43:40 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-c19ee24f-05be-4371-b1c3-dd84479aba62 tempest-AttachVolumeTestJSON-339721191 None] Acquiring lock "cinder-3dcf979c-5fe7-437d-be59-b18880bb3a93-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:43:40 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-c19ee24f-05be-4371-b1c3-dd84479aba62 tempest-AttachVolumeTestJSON-339721191 None] Lock "cinder-3dcf979c-5fe7-437d-be59-b18880bb3a93-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:43:40 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-c19ee24f-05be-4371-b1c3-dd84479aba62 tempest-AttachVolumeTestJSON-339721191 None] Acquiring lock "cinder-quobyte-3dcf979c-5fe7-437d-be59-b18880bb3a93" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:43:40 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-c19ee24f-05be-4371-b1c3-dd84479aba62 tempest-AttachVolumeTestJSON-339721191 None] Lock "cinder-quobyte-3dcf979c-5fe7-437d-be59-b18880bb3a93" acquired by "delete_volume" :: waited 0.019s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:43:40 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[c762b598-21d6-4123-a133-76e7c7932fc0]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:43:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c19ee24f-05be-4371-b1c3-dd84479aba62 tempest-AttachVolumeTestJSON-339721191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3dcf979c-5fe7-437d-be59-b18880bb3a93 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:43:40 devstack sudo[96482]: pam_unix(sudo:session): session closed for user root Jul 08 18:43:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1bcc0cdf-23d5-4b59-935b-9caaba1050a2 tempest-AttachVolumeTestJSON-339721191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.732s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:43:40 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-1bcc0cdf-23d5-4b59-935b-9caaba1050a2 tempest-AttachVolumeTestJSON-339721191 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:43:40 devstack sudo[96485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3dcf979c-5fe7-437d-be59-b18880bb3a93 Jul 08 18:43:40 devstack sudo[96485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:43:41 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-1bcc0cdf-23d5-4b59-935b-9caaba1050a2 tempest-AttachVolumeTestJSON-339721191 None] Deleted volume successfully. Jul 08 18:43:41 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-1bcc0cdf-23d5-4b59-935b-9caaba1050a2 tempest-AttachVolumeTestJSON-339721191 None] Lock "cinder-c4313b21-ff1e-4063-ad10-6f47d166eacf-delete_volume" released by "delete_volume" :: held 2.559s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:43:41 devstack sudo[96485]: pam_unix(sudo:session): session closed for user root Jul 08 18:43:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c19ee24f-05be-4371-b1c3-dd84479aba62 tempest-AttachVolumeTestJSON-339721191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3dcf979c-5fe7-437d-be59-b18880bb3a93" returned: 0 in 0.848s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:43:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c19ee24f-05be-4371-b1c3-dd84479aba62 tempest-AttachVolumeTestJSON-339721191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3dcf979c-5fe7-437d-be59-b18880bb3a93 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:43:41 devstack sudo[96491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3dcf979c-5fe7-437d-be59-b18880bb3a93 Jul 08 18:43:41 devstack sudo[96491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:43:42 devstack sudo[96491]: pam_unix(sudo:session): session closed for user root Jul 08 18:43:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c19ee24f-05be-4371-b1c3-dd84479aba62 tempest-AttachVolumeTestJSON-339721191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3dcf979c-5fe7-437d-be59-b18880bb3a93" returned: 0 in 0.760s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:43:42 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-c19ee24f-05be-4371-b1c3-dd84479aba62 tempest-AttachVolumeTestJSON-339721191 None] Lock "cinder-quobyte-3dcf979c-5fe7-437d-be59-b18880bb3a93" released by "delete_volume" :: held 1.662s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:43:42 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-c19ee24f-05be-4371-b1c3-dd84479aba62 tempest-AttachVolumeTestJSON-339721191 None] Created reservations ['f2d23157-6986-4633-a35f-cd2f418a109c', '74656e9c-51d2-4b17-89b8-5bcbf4c08a49', '056cf352-2435-42e9-b567-44fb5ebc7883', 'b6c3516b-038c-4bba-8a87-78be750aa444'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:43:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c19ee24f-05be-4371-b1c3-dd84479aba62 tempest-AttachVolumeTestJSON-339721191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:43:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c19ee24f-05be-4371-b1c3-dd84479aba62 tempest-AttachVolumeTestJSON-339721191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:43:42 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c19ee24f-05be-4371-b1c3-dd84479aba62 tempest-AttachVolumeTestJSON-339721191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:43:42 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c19ee24f-05be-4371-b1c3-dd84479aba62 tempest-AttachVolumeTestJSON-339721191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:43:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c19ee24f-05be-4371-b1c3-dd84479aba62 tempest-AttachVolumeTestJSON-339721191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:43:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c19ee24f-05be-4371-b1c3-dd84479aba62 tempest-AttachVolumeTestJSON-339721191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:43:42 devstack sudo[96496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:43:42 devstack sudo[96496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:43:43 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-d817aaa9-35b4-4b98-9573-41b96af02348 tempest-AttachVolumeTestJSON-339721191 None] Acquiring lock "cinder-07fde341-5b1d-4c61-be93-8ddc382c67a9-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:43:43 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-d817aaa9-35b4-4b98-9573-41b96af02348 tempest-AttachVolumeTestJSON-339721191 None] Lock "cinder-07fde341-5b1d-4c61-be93-8ddc382c67a9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:43:43 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-d817aaa9-35b4-4b98-9573-41b96af02348 tempest-AttachVolumeTestJSON-339721191 None] Acquiring lock "cinder-quobyte-07fde341-5b1d-4c61-be93-8ddc382c67a9" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:43:43 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-d817aaa9-35b4-4b98-9573-41b96af02348 tempest-AttachVolumeTestJSON-339721191 None] Lock "cinder-quobyte-07fde341-5b1d-4c61-be93-8ddc382c67a9" acquired by "delete_volume" :: waited 0.022s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:43:43 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb5fb2db-f30a-4d1e-b279-23c1b6830099]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:43:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d817aaa9-35b4-4b98-9573-41b96af02348 tempest-AttachVolumeTestJSON-339721191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07fde341-5b1d-4c61-be93-8ddc382c67a9 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:43:43 devstack sudo[96496]: pam_unix(sudo:session): session closed for user root Jul 08 18:43:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c19ee24f-05be-4371-b1c3-dd84479aba62 tempest-AttachVolumeTestJSON-339721191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.774s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:43:43 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-c19ee24f-05be-4371-b1c3-dd84479aba62 tempest-AttachVolumeTestJSON-339721191 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:43:43 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-c19ee24f-05be-4371-b1c3-dd84479aba62 tempest-AttachVolumeTestJSON-339721191 None] Deleted volume successfully. Jul 08 18:43:43 devstack sudo[96511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07fde341-5b1d-4c61-be93-8ddc382c67a9 Jul 08 18:43:43 devstack sudo[96511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:43:43 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-c19ee24f-05be-4371-b1c3-dd84479aba62 tempest-AttachVolumeTestJSON-339721191 None] Lock "cinder-3dcf979c-5fe7-437d-be59-b18880bb3a93-delete_volume" released by "delete_volume" :: held 2.684s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:43:44 devstack sudo[96511]: pam_unix(sudo:session): session closed for user root Jul 08 18:43:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d817aaa9-35b4-4b98-9573-41b96af02348 tempest-AttachVolumeTestJSON-339721191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07fde341-5b1d-4c61-be93-8ddc382c67a9" returned: 0 in 0.832s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:43:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d817aaa9-35b4-4b98-9573-41b96af02348 tempest-AttachVolumeTestJSON-339721191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07fde341-5b1d-4c61-be93-8ddc382c67a9 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:43:44 devstack sudo[96521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07fde341-5b1d-4c61-be93-8ddc382c67a9 Jul 08 18:43:44 devstack sudo[96521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:43:44 devstack sudo[96521]: pam_unix(sudo:session): session closed for user root Jul 08 18:43:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d817aaa9-35b4-4b98-9573-41b96af02348 tempest-AttachVolumeTestJSON-339721191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07fde341-5b1d-4c61-be93-8ddc382c67a9" returned: 0 in 0.694s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:43:44 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-d817aaa9-35b4-4b98-9573-41b96af02348 tempest-AttachVolumeTestJSON-339721191 None] Lock "cinder-quobyte-07fde341-5b1d-4c61-be93-8ddc382c67a9" released by "delete_volume" :: held 1.605s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:43:44 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-d817aaa9-35b4-4b98-9573-41b96af02348 tempest-AttachVolumeTestJSON-339721191 None] Created reservations ['159eddf2-aebe-4086-b607-d1b304b9d9ab', '19b7117d-0c23-4671-814f-6f572f199ced', '07f37b20-53cb-465a-ab73-82187870ef91', 'ce55fab7-ba22-4dab-a893-69034b4a50d9'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:43:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-d817aaa9-35b4-4b98-9573-41b96af02348 tempest-AttachVolumeTestJSON-339721191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:43:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-d817aaa9-35b4-4b98-9573-41b96af02348 tempest-AttachVolumeTestJSON-339721191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:43:44 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-d817aaa9-35b4-4b98-9573-41b96af02348 tempest-AttachVolumeTestJSON-339721191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:43:44 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-d817aaa9-35b4-4b98-9573-41b96af02348 tempest-AttachVolumeTestJSON-339721191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:43:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-d817aaa9-35b4-4b98-9573-41b96af02348 tempest-AttachVolumeTestJSON-339721191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:43:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d817aaa9-35b4-4b98-9573-41b96af02348 tempest-AttachVolumeTestJSON-339721191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:43:45 devstack sudo[96524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:43:45 devstack sudo[96524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:43:45 devstack sudo[96524]: pam_unix(sudo:session): session closed for user root Jul 08 18:43:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d817aaa9-35b4-4b98-9573-41b96af02348 tempest-AttachVolumeTestJSON-339721191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.713s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:43:45 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-d817aaa9-35b4-4b98-9573-41b96af02348 tempest-AttachVolumeTestJSON-339721191 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:43:45 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-d817aaa9-35b4-4b98-9573-41b96af02348 tempest-AttachVolumeTestJSON-339721191 None] Deleted volume successfully. Jul 08 18:43:45 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-d817aaa9-35b4-4b98-9573-41b96af02348 tempest-AttachVolumeTestJSON-339721191 None] Lock "cinder-07fde341-5b1d-4c61-be93-8ddc382c67a9-delete_volume" released by "delete_volume" :: held 2.590s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:43:48 devstack cinder-volume[86873]: DEBUG oslo_service.periodic_task [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86873) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:43:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:43:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:43:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:43:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:43:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:43:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:43:48 devstack sudo[96594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:43:48 devstack sudo[96594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:43:49 devstack sudo[96594]: pam_unix(sudo:session): session closed for user root Jul 08 18:43:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.896s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:43:49 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:43:49 devstack cinder-volume[86873]: DEBUG oslo_service.periodic_task [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running periodic task VolumeManager._thread_info {{(pid=86873) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:43:49 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] thread count: 29 {{(pid=86873) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:43:49 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] thread info: [<_MainThread(MainThread, started 138577734545536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86873) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:43:51 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ffb3645b-bb5e-4fed-b675-2e4038cb930a tempest-VolumesActionsTest-1330750976 None] Acquiring lock "cinder-8ff6df71-4736-4ad1-84f3-44d971402f38" by "attach_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:43:51 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ffb3645b-bb5e-4fed-b675-2e4038cb930a tempest-VolumesActionsTest-1330750976 None] Lock "cinder-8ff6df71-4736-4ad1-84f3-44d971402f38" acquired by "attach_volume" :: waited 0.024s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:43:51 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-ffb3645b-bb5e-4fed-b675-2e4038cb930a tempest-VolumesActionsTest-1330750976 None] Attaching volume 8ff6df71-4736-4ad1-84f3-44d971402f38 to instance 75d487d7-e0e1-40c2-8596-86f0baef7d31 at mountpoint /dev/vdb on host None. Jul 08 18:43:51 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-ffb3645b-bb5e-4fed-b675-2e4038cb930a tempest-VolumesActionsTest-1330750976 None] Attach volume completed successfully. Jul 08 18:43:51 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ffb3645b-bb5e-4fed-b675-2e4038cb930a tempest-VolumesActionsTest-1330750976 None] Lock "cinder-8ff6df71-4736-4ad1-84f3-44d971402f38" released by "attach_volume" :: held 0.106s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:43:52 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-421f1de0-13d2-4bb7-8dac-161d043c0c7b tempest-VolumesActionsTest-1330750976 None] Acquiring lock "cinder-8ff6df71-4736-4ad1-84f3-44d971402f38-detach_volume" by "detach_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:43:52 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-421f1de0-13d2-4bb7-8dac-161d043c0c7b tempest-VolumesActionsTest-1330750976 None] Lock "cinder-8ff6df71-4736-4ad1-84f3-44d971402f38-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:43:52 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-421f1de0-13d2-4bb7-8dac-161d043c0c7b tempest-VolumesActionsTest-1330750976 None] Detaching volume 8ff6df71-4736-4ad1-84f3-44d971402f38 from instance 75d487d7-e0e1-40c2-8596-86f0baef7d31. Jul 08 18:43:52 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:SELECT=70,cinder:INSERT=28,cinder:UPDATE=73,cinder:DELETE=7 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:43:52 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-421f1de0-13d2-4bb7-8dac-161d043c0c7b tempest-VolumesActionsTest-1330750976 None] Detach volume completed successfully. Jul 08 18:43:52 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-421f1de0-13d2-4bb7-8dac-161d043c0c7b tempest-VolumesActionsTest-1330750976 None] Lock "cinder-8ff6df71-4736-4ad1-84f3-44d971402f38-detach_volume" released by "detach_volume" :: held 0.084s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:43:53 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-cc576dcf-4267-48bc-86ac-8cefa9eafe77 tempest-GroupSnapshotsTest-1187820760 None] Group tempest-GroupSnapshotsTest-Group-441656093: creating Jul 08 18:43:53 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-cc576dcf-4267-48bc-86ac-8cefa9eafe77 tempest-GroupSnapshotsTest-1187820760 None] Group tempest-GroupSnapshotsTest-Group-441656093: created successfully Jul 08 18:43:53 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-cc576dcf-4267-48bc-86ac-8cefa9eafe77 tempest-GroupSnapshotsTest-1187820760 None] Create group completed successfully. Jul 08 18:43:54 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-95427b85-44d2-46bc-b9c5-0b6c8488a215 tempest-GroupSnapshotsTest-1187820760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:43:55 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-95427b85-44d2-46bc-b9c5-0b6c8488a215 tempest-GroupSnapshotsTest-1187820760 None] Flow 'volume_create_manager' (302241a7-6c32-429f-83d7-703dca8e3515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:43:55 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-95427b85-44d2-46bc-b9c5-0b6c8488a215 tempest-GroupSnapshotsTest-1187820760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65819943-5576-4d2d-92ab-bdff02a12d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:43:55 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-95427b85-44d2-46bc-b9c5-0b6c8488a215 tempest-GroupSnapshotsTest-1187820760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65819943-5576-4d2d-92ab-bdff02a12d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:43:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1466025860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=57d9ae91-c272-404c-b5b4-30b3adef7d2c,host='devstack@QuobyteHD#QuobyteHD',id=aeab7d7f-5bdc-4f86-964d-16e924c7946e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c35e7af23bf148a78ff51789ffe3ca73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:43:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:43:55Z,use_quota=True,user_id='0adf784786744c4d8f6d6bb06f2f20fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccc912bb-529c-471e-96a4-91d70f1a2f32),volume_type_id=ccc912bb-529c-471e-96a4-91d70f1a2f32)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:43:55 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-95427b85-44d2-46bc-b9c5-0b6c8488a215 tempest-GroupSnapshotsTest-1187820760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba21ce1a-4b1b-456b-af6b-695057547b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:43:55 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-95427b85-44d2-46bc-b9c5-0b6c8488a215 tempest-GroupSnapshotsTest-1187820760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba21ce1a-4b1b-456b-af6b-695057547b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:43:55 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-95427b85-44d2-46bc-b9c5-0b6c8488a215 tempest-GroupSnapshotsTest-1187820760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (008bc336-83f1-4e90-9f73-0f5565a60a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:43:55 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-95427b85-44d2-46bc-b9c5-0b6c8488a215 tempest-GroupSnapshotsTest-1187820760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (008bc336-83f1-4e90-9f73-0f5565a60a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aeab7d7f-5bdc-4f86-964d-16e924c7946e', 'volume_name': 'volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:43:55 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-95427b85-44d2-46bc-b9c5-0b6c8488a215 tempest-GroupSnapshotsTest-1187820760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8acbfa54-0b27-4c21-ab1e-afeba6e8a37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:43:55 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-95427b85-44d2-46bc-b9c5-0b6c8488a215 tempest-GroupSnapshotsTest-1187820760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8acbfa54-0b27-4c21-ab1e-afeba6e8a37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:43:55 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-95427b85-44d2-46bc-b9c5-0b6c8488a215 tempest-GroupSnapshotsTest-1187820760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bbb64b5-4e1b-4343-9040-b5cf41c3484a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:43:55 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-95427b85-44d2-46bc-b9c5-0b6c8488a215 tempest-GroupSnapshotsTest-1187820760 None] Volume aeab7d7f-5bdc-4f86-964d-16e924c7946e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e', 'volume_size': 1} Jul 08 18:43:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-95427b85-44d2-46bc-b9c5-0b6c8488a215 tempest-GroupSnapshotsTest-1187820760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:43:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-95427b85-44d2-46bc-b9c5-0b6c8488a215 tempest-GroupSnapshotsTest-1187820760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:43:55 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-95427b85-44d2-46bc-b9c5-0b6c8488a215 tempest-GroupSnapshotsTest-1187820760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=57d9ae91-c272-404c-b5b4-30b3adef7d2c,created_at=2026-07-08T16:43:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1466025860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=57d9ae91-c272-404c-b5b4-30b3adef7d2c,host='devstack@QuobyteHD#QuobyteHD',id=aeab7d7f-5bdc-4f86-964d-16e924c7946e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c35e7af23bf148a78ff51789ffe3ca73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:43:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:43:55Z,use_quota=True,user_id='0adf784786744c4d8f6d6bb06f2f20fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccc912bb-529c-471e-96a4-91d70f1a2f32),volume_type_id=ccc912bb-529c-471e-96a4-91d70f1a2f32)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:43:55 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-95427b85-44d2-46bc-b9c5-0b6c8488a215 tempest-GroupSnapshotsTest-1187820760 None] Creating volume aeab7d7f-5bdc-4f86-964d-16e924c7946e {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:43:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-95427b85-44d2-46bc-b9c5-0b6c8488a215 tempest-GroupSnapshotsTest-1187820760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:43:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-95427b85-44d2-46bc-b9c5-0b6c8488a215 tempest-GroupSnapshotsTest-1187820760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:43:55 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-95427b85-44d2-46bc-b9c5-0b6c8488a215 tempest-GroupSnapshotsTest-1187820760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:43:55 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-95427b85-44d2-46bc-b9c5-0b6c8488a215 tempest-GroupSnapshotsTest-1187820760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:43:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-95427b85-44d2-46bc-b9c5-0b6c8488a215 tempest-GroupSnapshotsTest-1187820760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:43:55 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-95427b85-44d2-46bc-b9c5-0b6c8488a215 tempest-GroupSnapshotsTest-1187820760 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:43:55 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-95427b85-44d2-46bc-b9c5-0b6c8488a215 tempest-GroupSnapshotsTest-1187820760 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:43:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-95427b85-44d2-46bc-b9c5-0b6c8488a215 tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:43:55 devstack sudo[96623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e 1073741824 Jul 08 18:43:55 devstack sudo[96623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:43:56 devstack sudo[96623]: pam_unix(sudo:session): session closed for user root Jul 08 18:43:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-95427b85-44d2-46bc-b9c5-0b6c8488a215 tempest-GroupSnapshotsTest-1187820760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e 1073741824" returned: 0 in 0.938s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:43:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-95427b85-44d2-46bc-b9c5-0b6c8488a215 tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:43:56 devstack sudo[96633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e Jul 08 18:43:56 devstack sudo[96633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:43:56 devstack sudo[96633]: pam_unix(sudo:session): session closed for user root Jul 08 18:43:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-95427b85-44d2-46bc-b9c5-0b6c8488a215 tempest-GroupSnapshotsTest-1187820760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e" returned: 0 in 0.708s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:43:56 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-95427b85-44d2-46bc-b9c5-0b6c8488a215 tempest-GroupSnapshotsTest-1187820760 None] <== create_volume: return (1690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:43:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-95427b85-44d2-46bc-b9c5-0b6c8488a215 tempest-GroupSnapshotsTest-1187820760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.694s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:43:56 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-95427b85-44d2-46bc-b9c5-0b6c8488a215 tempest-GroupSnapshotsTest-1187820760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bbb64b5-4e1b-4343-9040-b5cf41c3484a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:43:56 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-95427b85-44d2-46bc-b9c5-0b6c8488a215 tempest-GroupSnapshotsTest-1187820760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (372be768-d72b-4201-9736-39717c7b6e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:43:56 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-95427b85-44d2-46bc-b9c5-0b6c8488a215 tempest-GroupSnapshotsTest-1187820760 None] Volume volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e (aeab7d7f-5bdc-4f86-964d-16e924c7946e): created successfully Jul 08 18:43:56 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-95427b85-44d2-46bc-b9c5-0b6c8488a215 tempest-GroupSnapshotsTest-1187820760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (372be768-d72b-4201-9736-39717c7b6e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:43:56 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-95427b85-44d2-46bc-b9c5-0b6c8488a215 tempest-GroupSnapshotsTest-1187820760 None] Flow 'volume_create_manager' (302241a7-6c32-429f-83d7-703dca8e3515) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:43:56 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-95427b85-44d2-46bc-b9c5-0b6c8488a215 tempest-GroupSnapshotsTest-1187820760 None] Created volume successfully. Jul 08 18:43:57 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-f6d4f233-22ed-4cb7-8f29-d5e9f338fc94 tempest-GroupSnapshotsTest-1187820760 None] GroupSnapshot de18349f-ce4e-4a73-b307-a112a5ab7676: creating. Jul 08 18:43:57 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f6d4f233-22ed-4cb7-8f29-d5e9f338fc94 tempest-GroupSnapshotsTest-1187820760 None] Group snapshot de18349f-ce4e-4a73-b307-a112a5ab7676: creating. {{(pid=86873) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 08 18:43:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f6d4f233-22ed-4cb7-8f29-d5e9f338fc94 tempest-GroupSnapshotsTest-1187820760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:43:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f6d4f233-22ed-4cb7-8f29-d5e9f338fc94 tempest-GroupSnapshotsTest-1187820760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:43:57 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-f6d4f233-22ed-4cb7-8f29-d5e9f338fc94 tempest-GroupSnapshotsTest-1187820760 None] Creating offline snapshot 4ce13589-8112-45af-9844-d0f2d7521c00 of volume aeab7d7f-5bdc-4f86-964d-16e924c7946e {{(pid=86873) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:43:57 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd40c5d2-339a-4eeb-bf29-4e4019db7fbf]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:43:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f6d4f233-22ed-4cb7-8f29-d5e9f338fc94 tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:43:57 devstack sudo[96636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e Jul 08 18:43:57 devstack sudo[96636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:43:58 devstack sudo[96636]: pam_unix(sudo:session): session closed for user root Jul 08 18:43:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f6d4f233-22ed-4cb7-8f29-d5e9f338fc94 tempest-GroupSnapshotsTest-1187820760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e" returned: 0 in 0.817s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:43:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f6d4f233-22ed-4cb7-8f29-d5e9f338fc94 tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e.4ce13589-8112-45af-9844-d0f2d7521c00 1G {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:43:58 devstack sudo[96641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e.4ce13589-8112-45af-9844-d0f2d7521c00 1G Jul 08 18:43:58 devstack sudo[96641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:43:59 devstack sudo[96641]: pam_unix(sudo:session): session closed for user root Jul 08 18:43:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f6d4f233-22ed-4cb7-8f29-d5e9f338fc94 tempest-GroupSnapshotsTest-1187820760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e.4ce13589-8112-45af-9844-d0f2d7521c00 1G" returned: 0 in 0.833s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:43:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f6d4f233-22ed-4cb7-8f29-d5e9f338fc94 tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e.4ce13589-8112-45af-9844-d0f2d7521c00 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:43:59 devstack sudo[96647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e.4ce13589-8112-45af-9844-d0f2d7521c00 Jul 08 18:43:59 devstack sudo[96647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:44:00 devstack sudo[96647]: pam_unix(sudo:session): session closed for user root Jul 08 18:44:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f6d4f233-22ed-4cb7-8f29-d5e9f338fc94 tempest-GroupSnapshotsTest-1187820760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e.4ce13589-8112-45af-9844-d0f2d7521c00" returned: 0 in 0.746s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:44:00 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-f6d4f233-22ed-4cb7-8f29-d5e9f338fc94 tempest-GroupSnapshotsTest-1187820760 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e.4ce13589-8112-45af-9844-d0f2d7521c00 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 18:44:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f6d4f233-22ed-4cb7-8f29-d5e9f338fc94 tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e.4ce13589-8112-45af-9844-d0f2d7521c00 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:44:00 devstack sudo[96689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e.4ce13589-8112-45af-9844-d0f2d7521c00 Jul 08 18:44:00 devstack sudo[96689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:44:00 devstack sudo[96689]: pam_unix(sudo:session): session closed for user root Jul 08 18:44:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f6d4f233-22ed-4cb7-8f29-d5e9f338fc94 tempest-GroupSnapshotsTest-1187820760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e.4ce13589-8112-45af-9844-d0f2d7521c00" returned: 0 in 0.732s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:44:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f6d4f233-22ed-4cb7-8f29-d5e9f338fc94 tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:44:00 devstack sudo[96692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e.info Jul 08 18:44:00 devstack sudo[96692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:44:01 devstack sudo[96692]: pam_unix(sudo:session): session closed for user root Jul 08 18:44:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f6d4f233-22ed-4cb7-8f29-d5e9f338fc94 tempest-GroupSnapshotsTest-1187820760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e.info" returned: 0 in 0.748s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:44:01 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-f6d4f233-22ed-4cb7-8f29-d5e9f338fc94 tempest-GroupSnapshotsTest-1187820760 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 18:44:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f6d4f233-22ed-4cb7-8f29-d5e9f338fc94 tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:44:01 devstack sudo[96698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e.info Jul 08 18:44:01 devstack sudo[96698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:44:02 devstack sudo[96698]: pam_unix(sudo:session): session closed for user root Jul 08 18:44:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f6d4f233-22ed-4cb7-8f29-d5e9f338fc94 tempest-GroupSnapshotsTest-1187820760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e.info" returned: 0 in 0.709s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:44:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f6d4f233-22ed-4cb7-8f29-d5e9f338fc94 tempest-GroupSnapshotsTest-1187820760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.669s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:44:02 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-f6d4f233-22ed-4cb7-8f29-d5e9f338fc94 tempest-GroupSnapshotsTest-1187820760 None] group_snapshot de18349f-ce4e-4a73-b307-a112a5ab7676: created successfully Jul 08 18:44:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5a899e7a-570c-434f-9f58-c7ecabe81009 tempest-GroupSnapshotsTest-1187820760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:44:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5a899e7a-570c-434f-9f58-c7ecabe81009 tempest-GroupSnapshotsTest-1187820760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:44:03 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-5a899e7a-570c-434f-9f58-c7ecabe81009 tempest-GroupSnapshotsTest-1187820760 None] Acquiring lock "cinder-quobyte-4ce13589-8112-45af-9844-d0f2d7521c00-4cbea823-8a7f-4f03-bf98-c4cb5b806a92" by "_create_volume_from_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:44:04 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-5a899e7a-570c-434f-9f58-c7ecabe81009 tempest-GroupSnapshotsTest-1187820760 None] Lock "cinder-quobyte-4ce13589-8112-45af-9844-d0f2d7521c00-4cbea823-8a7f-4f03-bf98-c4cb5b806a92" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:44:04 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-5a899e7a-570c-434f-9f58-c7ecabe81009 tempest-GroupSnapshotsTest-1187820760 None] Creating volume 4cbea823-8a7f-4f03-bf98-c4cb5b806a92 from snapshot 4ce13589-8112-45af-9844-d0f2d7521c00 {{(pid=86873) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 18:44:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5a899e7a-570c-434f-9f58-c7ecabe81009 tempest-GroupSnapshotsTest-1187820760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:44:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5a899e7a-570c-434f-9f58-c7ecabe81009 tempest-GroupSnapshotsTest-1187820760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:44:04 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-5a899e7a-570c-434f-9f58-c7ecabe81009 tempest-GroupSnapshotsTest-1187820760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:44:04 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-5a899e7a-570c-434f-9f58-c7ecabe81009 tempest-GroupSnapshotsTest-1187820760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:44:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5a899e7a-570c-434f-9f58-c7ecabe81009 tempest-GroupSnapshotsTest-1187820760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:44:04 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-5a899e7a-570c-434f-9f58-c7ecabe81009 tempest-GroupSnapshotsTest-1187820760 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:44:04 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-5a899e7a-570c-434f-9f58-c7ecabe81009 tempest-GroupSnapshotsTest-1187820760 None] Acquiring lock "cinder-quobyte-4cbea823-8a7f-4f03-bf98-c4cb5b806a92" by "_copy_volume_from_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:44:04 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-5a899e7a-570c-434f-9f58-c7ecabe81009 tempest-GroupSnapshotsTest-1187820760 None] Lock "cinder-quobyte-4cbea823-8a7f-4f03-bf98-c4cb5b806a92" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:44:04 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-5a899e7a-570c-434f-9f58-c7ecabe81009 tempest-GroupSnapshotsTest-1187820760 None] snapshot: 4ce13589-8112-45af-9844-d0f2d7521c00, volume: 4cbea823-8a7f-4f03-bf98-c4cb5b806a92, {{(pid=86873) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 18:44:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5a899e7a-570c-434f-9f58-c7ecabe81009 tempest-GroupSnapshotsTest-1187820760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:44:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5a899e7a-570c-434f-9f58-c7ecabe81009 tempest-GroupSnapshotsTest-1187820760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:44:04 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-5a899e7a-570c-434f-9f58-c7ecabe81009 tempest-GroupSnapshotsTest-1187820760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:44:04 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-5a899e7a-570c-434f-9f58-c7ecabe81009 tempest-GroupSnapshotsTest-1187820760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:44:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5a899e7a-570c-434f-9f58-c7ecabe81009 tempest-GroupSnapshotsTest-1187820760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:44:04 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccf04f7-f79d-4de3-8bb1-93db945f5f20]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:44:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5a899e7a-570c-434f-9f58-c7ecabe81009 tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e.4ce13589-8112-45af-9844-d0f2d7521c00 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:44:04 devstack sudo[96705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e.4ce13589-8112-45af-9844-d0f2d7521c00 Jul 08 18:44:04 devstack sudo[96705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:44:04 devstack sudo[96705]: pam_unix(sudo:session): session closed for user root Jul 08 18:44:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5a899e7a-570c-434f-9f58-c7ecabe81009 tempest-GroupSnapshotsTest-1187820760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e.4ce13589-8112-45af-9844-d0f2d7521c00" returned: 0 in 0.794s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:44:04 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-5a899e7a-570c-434f-9f58-c7ecabe81009 tempest-GroupSnapshotsTest-1187820760 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:44:04 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-5a899e7a-570c-434f-9f58-c7ecabe81009 tempest-GroupSnapshotsTest-1187820760 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e {{(pid=86873) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 18:44:04 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-5a899e7a-570c-434f-9f58-c7ecabe81009 tempest-GroupSnapshotsTest-1187820760 None] Creating direct copy from snapshot {{(pid=86873) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 18:44:04 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[502e0fc1-ccb0-455f-b713-9575c817deff]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:44:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5a899e7a-570c-434f-9f58-c7ecabe81009 tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:44:05 devstack sudo[96710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e Jul 08 18:44:05 devstack sudo[96710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:44:05 devstack sudo[96710]: pam_unix(sudo:session): session closed for user root Jul 08 18:44:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5a899e7a-570c-434f-9f58-c7ecabe81009 tempest-GroupSnapshotsTest-1187820760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e" returned: 0 in 0.791s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:44:05 devstack cinder-volume[86873]: DEBUG cinder.utils [None req-5a899e7a-570c-434f-9f58-c7ecabe81009 tempest-GroupSnapshotsTest-1187820760 None] Path /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4cbea823-8a7f-4f03-bf98-c4cb5b806a92 not found in is_blk_device check {{(pid=86873) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 18:44:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5a899e7a-570c-434f-9f58-c7ecabe81009 tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4cbea823-8a7f-4f03-bf98-c4cb5b806a92 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:44:05 devstack sudo[96715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4cbea823-8a7f-4f03-bf98-c4cb5b806a92 Jul 08 18:44:05 devstack sudo[96715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:44:11 devstack sudo[96715]: pam_unix(sudo:session): session closed for user root Jul 08 18:44:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5a899e7a-570c-434f-9f58-c7ecabe81009 tempest-GroupSnapshotsTest-1187820760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4cbea823-8a7f-4f03-bf98-c4cb5b806a92" returned: 0 in 5.766s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:44:11 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d12dad-76e6-4b87-ac28-b6abf616997b]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:44:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5a899e7a-570c-434f-9f58-c7ecabe81009 tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:44:11 devstack sudo[96746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e Jul 08 18:44:11 devstack sudo[96746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:44:12 devstack sudo[96746]: pam_unix(sudo:session): session closed for user root Jul 08 18:44:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5a899e7a-570c-434f-9f58-c7ecabe81009 tempest-GroupSnapshotsTest-1187820760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e" returned: 0 in 0.929s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:44:12 devstack cinder-volume[86873]: DEBUG cinder.image.image_utils [None req-5a899e7a-570c-434f-9f58-c7ecabe81009 tempest-GroupSnapshotsTest-1187820760 None] Image conversion details: src /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e, size 1024.00 MB, duration 5.77 sec, destination /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4cbea823-8a7f-4f03-bf98-c4cb5b806a92 {{(pid=86873) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:44:12 devstack cinder-volume[86873]: INFO cinder.image.image_utils [None req-5a899e7a-570c-434f-9f58-c7ecabe81009 tempest-GroupSnapshotsTest-1187820760 None] Converted 1024.00 MB image at 177.57 MB/s Jul 08 18:44:12 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-5a899e7a-570c-434f-9f58-c7ecabe81009 tempest-GroupSnapshotsTest-1187820760 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4cbea823-8a7f-4f03-bf98-c4cb5b806a92 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 18:44:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5a899e7a-570c-434f-9f58-c7ecabe81009 tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4cbea823-8a7f-4f03-bf98-c4cb5b806a92 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:44:12 devstack sudo[96752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4cbea823-8a7f-4f03-bf98-c4cb5b806a92 Jul 08 18:44:12 devstack sudo[96752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:44:13 devstack sudo[96752]: pam_unix(sudo:session): session closed for user root Jul 08 18:44:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5a899e7a-570c-434f-9f58-c7ecabe81009 tempest-GroupSnapshotsTest-1187820760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4cbea823-8a7f-4f03-bf98-c4cb5b806a92" returned: 0 in 0.651s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:44:13 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-5a899e7a-570c-434f-9f58-c7ecabe81009 tempest-GroupSnapshotsTest-1187820760 None] Lock "cinder-quobyte-4cbea823-8a7f-4f03-bf98-c4cb5b806a92" released by "_copy_volume_from_snapshot" :: held 9.030s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:44:13 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-5a899e7a-570c-434f-9f58-c7ecabe81009 tempest-GroupSnapshotsTest-1187820760 None] Lock "cinder-quobyte-4ce13589-8112-45af-9844-d0f2d7521c00-4cbea823-8a7f-4f03-bf98-c4cb5b806a92" released by "_create_volume_from_snapshot" :: held 9.065s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:44:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5a899e7a-570c-434f-9f58-c7ecabe81009 tempest-GroupSnapshotsTest-1187820760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.088s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:44:13 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-5a899e7a-570c-434f-9f58-c7ecabe81009 tempest-GroupSnapshotsTest-1187820760 None] Create group from source-snapshot-de18349f-ce4e-4a73-b307-a112a5ab7676 completed successfully. Jul 08 18:44:14 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-cfdf5ced-9807-4d27-95c8-539deda24217 tempest-GroupSnapshotsTest-1187820760 None] Acquiring lock "cinder-quobyte-4cbea823-8a7f-4f03-bf98-c4cb5b806a92" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:44:14 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-cfdf5ced-9807-4d27-95c8-539deda24217 tempest-GroupSnapshotsTest-1187820760 None] Lock "cinder-quobyte-4cbea823-8a7f-4f03-bf98-c4cb5b806a92" acquired by "delete_volume" :: waited 0.014s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:44:14 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[7584ae2b-90eb-400b-9490-9baedb624c77]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:44:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-cfdf5ced-9807-4d27-95c8-539deda24217 tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4cbea823-8a7f-4f03-bf98-c4cb5b806a92 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:44:14 devstack sudo[96796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4cbea823-8a7f-4f03-bf98-c4cb5b806a92 Jul 08 18:44:14 devstack sudo[96796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:44:15 devstack sudo[96796]: pam_unix(sudo:session): session closed for user root Jul 08 18:44:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-cfdf5ced-9807-4d27-95c8-539deda24217 tempest-GroupSnapshotsTest-1187820760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4cbea823-8a7f-4f03-bf98-c4cb5b806a92" returned: 0 in 0.817s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:44:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-cfdf5ced-9807-4d27-95c8-539deda24217 tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4cbea823-8a7f-4f03-bf98-c4cb5b806a92 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:44:15 devstack sudo[96806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4cbea823-8a7f-4f03-bf98-c4cb5b806a92 Jul 08 18:44:15 devstack sudo[96806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:44:15 devstack sudo[96806]: pam_unix(sudo:session): session closed for user root Jul 08 18:44:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-cfdf5ced-9807-4d27-95c8-539deda24217 tempest-GroupSnapshotsTest-1187820760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4cbea823-8a7f-4f03-bf98-c4cb5b806a92" returned: 0 in 0.694s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:44:15 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-cfdf5ced-9807-4d27-95c8-539deda24217 tempest-GroupSnapshotsTest-1187820760 None] Lock "cinder-quobyte-4cbea823-8a7f-4f03-bf98-c4cb5b806a92" released by "delete_volume" :: held 1.580s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:44:15 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-cfdf5ced-9807-4d27-95c8-539deda24217 tempest-GroupSnapshotsTest-1187820760 None] Created reservations ['19435cf9-0032-45ad-8ddf-01075c010776'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:44:15 devstack cinder-volume[86873]: WARNING cinder.quota [None req-cfdf5ced-9807-4d27-95c8-539deda24217 tempest-GroupSnapshotsTest-1187820760 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-434019406 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-434019406, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:44:15 devstack cinder-volume[86873]: WARNING cinder.quota [None req-cfdf5ced-9807-4d27-95c8-539deda24217 tempest-GroupSnapshotsTest-1187820760 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-434019406 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-434019406, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:44:15 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-cfdf5ced-9807-4d27-95c8-539deda24217 tempest-GroupSnapshotsTest-1187820760 None] Created reservations ['dbdcb048-d478-429c-a449-178e05aa6687', 'f859e883-4f07-4665-87ee-eee779ae2fc5', '6116a6e7-2925-4a10-9938-bcffa7041265', 'f033a9e6-d61a-46f0-82f1-5345cc4044d5'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:44:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-cfdf5ced-9807-4d27-95c8-539deda24217 tempest-GroupSnapshotsTest-1187820760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:44:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-cfdf5ced-9807-4d27-95c8-539deda24217 tempest-GroupSnapshotsTest-1187820760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:44:16 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-cfdf5ced-9807-4d27-95c8-539deda24217 tempest-GroupSnapshotsTest-1187820760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:44:16 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-cfdf5ced-9807-4d27-95c8-539deda24217 tempest-GroupSnapshotsTest-1187820760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:44:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-cfdf5ced-9807-4d27-95c8-539deda24217 tempest-GroupSnapshotsTest-1187820760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:44:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-cfdf5ced-9807-4d27-95c8-539deda24217 tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:44:16 devstack sudo[96834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:44:16 devstack sudo[96834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:44:16 devstack sudo[96834]: pam_unix(sudo:session): session closed for user root Jul 08 18:44:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-cfdf5ced-9807-4d27-95c8-539deda24217 tempest-GroupSnapshotsTest-1187820760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.664s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:44:16 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-cfdf5ced-9807-4d27-95c8-539deda24217 tempest-GroupSnapshotsTest-1187820760 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:44:16 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-cfdf5ced-9807-4d27-95c8-539deda24217 tempest-GroupSnapshotsTest-1187820760 None] Delete group completed successfully. Jul 08 18:44:16 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-794efa5a-7e84-4c04-bb8f-ec33dd885b5b tempest-GroupSnapshotsTest-1187820760 None] group_snapshot de18349f-ce4e-4a73-b307-a112a5ab7676: deleting Jul 08 18:44:16 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-794efa5a-7e84-4c04-bb8f-ec33dd885b5b tempest-GroupSnapshotsTest-1187820760 None] group_snapshot de18349f-ce4e-4a73-b307-a112a5ab7676: deleting {{(pid=86873) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 08 18:44:16 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-794efa5a-7e84-4c04-bb8f-ec33dd885b5b tempest-GroupSnapshotsTest-1187820760 None] Acquiring lock "cinder-quobyte-aeab7d7f-5bdc-4f86-964d-16e924c7946e" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:44:16 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-794efa5a-7e84-4c04-bb8f-ec33dd885b5b tempest-GroupSnapshotsTest-1187820760 None] Lock "cinder-quobyte-aeab7d7f-5bdc-4f86-964d-16e924c7946e" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:44:16 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-794efa5a-7e84-4c04-bb8f-ec33dd885b5b tempest-GroupSnapshotsTest-1187820760 None] Acquiring lock "cinder-quobyte-4ce13589-8112-45af-9844-d0f2d7521c00" by "_delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:44:16 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-794efa5a-7e84-4c04-bb8f-ec33dd885b5b tempest-GroupSnapshotsTest-1187820760 None] Lock "cinder-quobyte-4ce13589-8112-45af-9844-d0f2d7521c00" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:44:16 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-794efa5a-7e84-4c04-bb8f-ec33dd885b5b tempest-GroupSnapshotsTest-1187820760 None] Deleting offline snapshot 4ce13589-8112-45af-9844-d0f2d7521c00 of volume aeab7d7f-5bdc-4f86-964d-16e924c7946e {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:44:16 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-794efa5a-7e84-4c04-bb8f-ec33dd885b5b tempest-GroupSnapshotsTest-1187820760 None] snapshot_file for this snap is: volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e.4ce13589-8112-45af-9844-d0f2d7521c00 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:44:16 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[392138f3-291e-44dd-b240-cf26d1e12102]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:44:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-794efa5a-7e84-4c04-bb8f-ec33dd885b5b tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e.4ce13589-8112-45af-9844-d0f2d7521c00 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:44:17 devstack sudo[96839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e.4ce13589-8112-45af-9844-d0f2d7521c00 Jul 08 18:44:17 devstack sudo[96839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:44:17 devstack sudo[96839]: pam_unix(sudo:session): session closed for user root Jul 08 18:44:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-794efa5a-7e84-4c04-bb8f-ec33dd885b5b tempest-GroupSnapshotsTest-1187820760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e.4ce13589-8112-45af-9844-d0f2d7521c00" returned: 0 in 0.916s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:44:17 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-794efa5a-7e84-4c04-bb8f-ec33dd885b5b tempest-GroupSnapshotsTest-1187820760 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:44:17 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80aa50e-d532-459a-9e41-2afce8a70429]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:44:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-794efa5a-7e84-4c04-bb8f-ec33dd885b5b tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:44:18 devstack sudo[96846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e Jul 08 18:44:18 devstack sudo[96846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:44:18 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-5b6f8973-19f3-4c54-83db-8b86ff0e8352 tempest-VolumesActionsTest-1330750976 None] Acquiring lock "cinder-8ff6df71-4736-4ad1-84f3-44d971402f38" by "attach_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:44:18 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-5b6f8973-19f3-4c54-83db-8b86ff0e8352 tempest-VolumesActionsTest-1330750976 None] Lock "cinder-8ff6df71-4736-4ad1-84f3-44d971402f38" acquired by "attach_volume" :: waited 0.022s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:44:18 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-5b6f8973-19f3-4c54-83db-8b86ff0e8352 tempest-VolumesActionsTest-1330750976 None] Attaching volume 8ff6df71-4736-4ad1-84f3-44d971402f38 to instance 1f9c6f20-8762-4d93-9383-26aa12a3f720 at mountpoint /dev/vdb on host None. Jul 08 18:44:18 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-5b6f8973-19f3-4c54-83db-8b86ff0e8352 tempest-VolumesActionsTest-1330750976 None] Attach volume completed successfully. Jul 08 18:44:18 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-5b6f8973-19f3-4c54-83db-8b86ff0e8352 tempest-VolumesActionsTest-1330750976 None] Lock "cinder-8ff6df71-4736-4ad1-84f3-44d971402f38" released by "attach_volume" :: held 0.107s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:44:18 devstack sudo[96846]: pam_unix(sudo:session): session closed for user root Jul 08 18:44:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-794efa5a-7e84-4c04-bb8f-ec33dd885b5b tempest-GroupSnapshotsTest-1187820760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e" returned: 0 in 0.882s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:44:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-794efa5a-7e84-4c04-bb8f-ec33dd885b5b tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e.4ce13589-8112-45af-9844-d0f2d7521c00 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:44:18 devstack sudo[96851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e.4ce13589-8112-45af-9844-d0f2d7521c00 Jul 08 18:44:18 devstack sudo[96851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:44:19 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-19690db9-50f4-41f3-9c74-5d075e6cc7c1 tempest-VolumesActionsTest-1330750976 None] Acquiring lock "cinder-8ff6df71-4736-4ad1-84f3-44d971402f38-detach_volume" by "detach_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:44:19 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-19690db9-50f4-41f3-9c74-5d075e6cc7c1 tempest-VolumesActionsTest-1330750976 None] Lock "cinder-8ff6df71-4736-4ad1-84f3-44d971402f38-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:44:19 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-19690db9-50f4-41f3-9c74-5d075e6cc7c1 tempest-VolumesActionsTest-1330750976 None] Detaching volume 8ff6df71-4736-4ad1-84f3-44d971402f38 from instance 1f9c6f20-8762-4d93-9383-26aa12a3f720. Jul 08 18:44:19 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-19690db9-50f4-41f3-9c74-5d075e6cc7c1 tempest-VolumesActionsTest-1330750976 None] Detach volume completed successfully. Jul 08 18:44:19 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-19690db9-50f4-41f3-9c74-5d075e6cc7c1 tempest-VolumesActionsTest-1330750976 None] Lock "cinder-8ff6df71-4736-4ad1-84f3-44d971402f38-detach_volume" released by "detach_volume" :: held 0.071s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:44:19 devstack sudo[96851]: pam_unix(sudo:session): session closed for user root Jul 08 18:44:19 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-794efa5a-7e84-4c04-bb8f-ec33dd885b5b tempest-GroupSnapshotsTest-1187820760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e.4ce13589-8112-45af-9844-d0f2d7521c00" returned: 0 in 0.774s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:44:19 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-794efa5a-7e84-4c04-bb8f-ec33dd885b5b tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e.4ce13589-8112-45af-9844-d0f2d7521c00 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:44:19 devstack sudo[96856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e.4ce13589-8112-45af-9844-d0f2d7521c00 Jul 08 18:44:19 devstack sudo[96856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:44:20 devstack sudo[96856]: pam_unix(sudo:session): session closed for user root Jul 08 18:44:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-794efa5a-7e84-4c04-bb8f-ec33dd885b5b tempest-GroupSnapshotsTest-1187820760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e.4ce13589-8112-45af-9844-d0f2d7521c00" returned: 0 in 0.714s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:44:20 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-794efa5a-7e84-4c04-bb8f-ec33dd885b5b tempest-GroupSnapshotsTest-1187820760 None] Lock "cinder-quobyte-4ce13589-8112-45af-9844-d0f2d7521c00" released by "_delete_snapshot" :: held 3.424s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:44:20 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-794efa5a-7e84-4c04-bb8f-ec33dd885b5b tempest-GroupSnapshotsTest-1187820760 None] Lock "cinder-quobyte-aeab7d7f-5bdc-4f86-964d-16e924c7946e" released by "delete_snapshot" :: held 3.459s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:44:20 devstack cinder-volume[86873]: WARNING cinder.quota [None req-794efa5a-7e84-4c04-bb8f-ec33dd885b5b tempest-GroupSnapshotsTest-1187820760 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-434019406 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-434019406, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:44:20 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-794efa5a-7e84-4c04-bb8f-ec33dd885b5b tempest-GroupSnapshotsTest-1187820760 None] Created reservations ['8edde6c8-2de9-49a7-b5bb-2a731e6a0f8f', '6d388704-339d-4778-8268-4ac53cf39198', 'b1339586-a9e9-401f-a267-31672caa3d7f', '2bfcd4bd-77ff-49c5-9cb7-ceb36368222d'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:44:20 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-794efa5a-7e84-4c04-bb8f-ec33dd885b5b tempest-GroupSnapshotsTest-1187820760 None] group_snapshot de18349f-ce4e-4a73-b307-a112a5ab7676: deleted successfully Jul 08 18:44:21 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-53bdd03e-1340-4791-a1e7-9910c2dea9c2 tempest-GroupSnapshotsTest-1187820760 None] Acquiring lock "cinder-quobyte-aeab7d7f-5bdc-4f86-964d-16e924c7946e" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:44:21 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-53bdd03e-1340-4791-a1e7-9910c2dea9c2 tempest-GroupSnapshotsTest-1187820760 None] Lock "cinder-quobyte-aeab7d7f-5bdc-4f86-964d-16e924c7946e" acquired by "delete_volume" :: waited 0.016s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:44:21 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[672e4b00-716a-4149-8036-9b574c928a1d]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:44:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-53bdd03e-1340-4791-a1e7-9910c2dea9c2 tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:44:21 devstack sudo[96864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e Jul 08 18:44:21 devstack sudo[96864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:44:22 devstack sudo[96864]: pam_unix(sudo:session): session closed for user root Jul 08 18:44:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-53bdd03e-1340-4791-a1e7-9910c2dea9c2 tempest-GroupSnapshotsTest-1187820760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e" returned: 0 in 0.932s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:44:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-53bdd03e-1340-4791-a1e7-9910c2dea9c2 tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:44:22 devstack sudo[96888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e Jul 08 18:44:22 devstack sudo[96888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:44:23 devstack sudo[96888]: pam_unix(sudo:session): session closed for user root Jul 08 18:44:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-53bdd03e-1340-4791-a1e7-9910c2dea9c2 tempest-GroupSnapshotsTest-1187820760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aeab7d7f-5bdc-4f86-964d-16e924c7946e" returned: 0 in 0.729s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:44:23 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-53bdd03e-1340-4791-a1e7-9910c2dea9c2 tempest-GroupSnapshotsTest-1187820760 None] Lock "cinder-quobyte-aeab7d7f-5bdc-4f86-964d-16e924c7946e" released by "delete_volume" :: held 1.726s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:44:23 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-53bdd03e-1340-4791-a1e7-9910c2dea9c2 tempest-GroupSnapshotsTest-1187820760 None] Created reservations ['de3623ba-1a4d-4801-ab0b-a7880584d0ed'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:44:23 devstack cinder-volume[86873]: WARNING cinder.db.api [None req-53bdd03e-1340-4791-a1e7-9910c2dea9c2 tempest-GroupSnapshotsTest-1187820760 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-434019406'] Jul 08 18:44:23 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-53bdd03e-1340-4791-a1e7-9910c2dea9c2 tempest-GroupSnapshotsTest-1187820760 None] Created reservations ['2204cfb7-e14b-43a1-ba1b-a152295185e7', '1c0ed59d-3717-43ef-9a70-81ed034f1505', 'd266cc15-1341-43b5-9afb-dc9f4b983c96', '86a49c82-6b51-4fbf-87b0-4ae1847289a0'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:44:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-53bdd03e-1340-4791-a1e7-9910c2dea9c2 tempest-GroupSnapshotsTest-1187820760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:44:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-53bdd03e-1340-4791-a1e7-9910c2dea9c2 tempest-GroupSnapshotsTest-1187820760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:44:23 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-53bdd03e-1340-4791-a1e7-9910c2dea9c2 tempest-GroupSnapshotsTest-1187820760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:44:23 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-53bdd03e-1340-4791-a1e7-9910c2dea9c2 tempest-GroupSnapshotsTest-1187820760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:44:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-53bdd03e-1340-4791-a1e7-9910c2dea9c2 tempest-GroupSnapshotsTest-1187820760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:44:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-53bdd03e-1340-4791-a1e7-9910c2dea9c2 tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:44:23 devstack sudo[96892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:44:23 devstack sudo[96892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:44:24 devstack sudo[96892]: pam_unix(sudo:session): session closed for user root Jul 08 18:44:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-53bdd03e-1340-4791-a1e7-9910c2dea9c2 tempest-GroupSnapshotsTest-1187820760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.689s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:44:24 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-53bdd03e-1340-4791-a1e7-9910c2dea9c2 tempest-GroupSnapshotsTest-1187820760 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:44:24 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-53bdd03e-1340-4791-a1e7-9910c2dea9c2 tempest-GroupSnapshotsTest-1187820760 None] Delete group completed successfully. Jul 08 18:44:24 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-80e50c5d-a743-4a46-90f4-f0dc84a1f2e2 tempest-GroupSnapshotsTest-1187820760 None] Group tempest-GroupSnapshotsTest-Group-1605724932: creating Jul 08 18:44:24 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-80e50c5d-a743-4a46-90f4-f0dc84a1f2e2 tempest-GroupSnapshotsTest-1187820760 None] Group tempest-GroupSnapshotsTest-Group-1605724932: created successfully Jul 08 18:44:24 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-80e50c5d-a743-4a46-90f4-f0dc84a1f2e2 tempest-GroupSnapshotsTest-1187820760 None] Create group completed successfully. Jul 08 18:44:25 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-47ca05c9-75d4-4204-b812-4055ba1059d6 tempest-GroupSnapshotsTest-1187820760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:44:25 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-47ca05c9-75d4-4204-b812-4055ba1059d6 tempest-GroupSnapshotsTest-1187820760 None] Flow 'volume_create_manager' (defdb47a-e341-4e26-9642-319620aa081f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:44:25 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-47ca05c9-75d4-4204-b812-4055ba1059d6 tempest-GroupSnapshotsTest-1187820760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9bbddd6-81ca-432f-a6a0-d840d8648b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:44:25 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-47ca05c9-75d4-4204-b812-4055ba1059d6 tempest-GroupSnapshotsTest-1187820760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9bbddd6-81ca-432f-a6a0-d840d8648b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:44:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1106633946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e476f6a5-3203-42e5-8057-73ca93e3822b,host='devstack@QuobyteHD#QuobyteHD',id=7c2ecde7-c63d-46d3-bd20-debfcb38de58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c35e7af23bf148a78ff51789ffe3ca73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:44:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:44:26Z,use_quota=True,user_id='0adf784786744c4d8f6d6bb06f2f20fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54629e2f-080d-467b-af3f-7ecbdda6dd2c),volume_type_id=54629e2f-080d-467b-af3f-7ecbdda6dd2c)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:44:26 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-47ca05c9-75d4-4204-b812-4055ba1059d6 tempest-GroupSnapshotsTest-1187820760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47fca8a9-ad83-4576-92d3-8aee9503d2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:44:26 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-47ca05c9-75d4-4204-b812-4055ba1059d6 tempest-GroupSnapshotsTest-1187820760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47fca8a9-ad83-4576-92d3-8aee9503d2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:44:26 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-47ca05c9-75d4-4204-b812-4055ba1059d6 tempest-GroupSnapshotsTest-1187820760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd23fe47-b282-4b9c-b892-b10e66491500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:44:26 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-47ca05c9-75d4-4204-b812-4055ba1059d6 tempest-GroupSnapshotsTest-1187820760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd23fe47-b282-4b9c-b892-b10e66491500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c2ecde7-c63d-46d3-bd20-debfcb38de58', 'volume_name': 'volume-7c2ecde7-c63d-46d3-bd20-debfcb38de58', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:44:26 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-47ca05c9-75d4-4204-b812-4055ba1059d6 tempest-GroupSnapshotsTest-1187820760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6c96dc1-b2da-4e44-8a8b-38ff595e1135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:44:26 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-47ca05c9-75d4-4204-b812-4055ba1059d6 tempest-GroupSnapshotsTest-1187820760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6c96dc1-b2da-4e44-8a8b-38ff595e1135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:44:26 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-47ca05c9-75d4-4204-b812-4055ba1059d6 tempest-GroupSnapshotsTest-1187820760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7c776a5-7512-4e05-9576-d004ddcace75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:44:26 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-47ca05c9-75d4-4204-b812-4055ba1059d6 tempest-GroupSnapshotsTest-1187820760 None] Volume 7c2ecde7-c63d-46d3-bd20-debfcb38de58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c2ecde7-c63d-46d3-bd20-debfcb38de58', 'volume_size': 1} Jul 08 18:44:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-47ca05c9-75d4-4204-b812-4055ba1059d6 tempest-GroupSnapshotsTest-1187820760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:44:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-47ca05c9-75d4-4204-b812-4055ba1059d6 tempest-GroupSnapshotsTest-1187820760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:44:26 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-47ca05c9-75d4-4204-b812-4055ba1059d6 tempest-GroupSnapshotsTest-1187820760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e476f6a5-3203-42e5-8057-73ca93e3822b,created_at=2026-07-08T16:44:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1106633946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e476f6a5-3203-42e5-8057-73ca93e3822b,host='devstack@QuobyteHD#QuobyteHD',id=7c2ecde7-c63d-46d3-bd20-debfcb38de58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c35e7af23bf148a78ff51789ffe3ca73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:44:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:44:26Z,use_quota=True,user_id='0adf784786744c4d8f6d6bb06f2f20fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54629e2f-080d-467b-af3f-7ecbdda6dd2c),volume_type_id=54629e2f-080d-467b-af3f-7ecbdda6dd2c)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:44:26 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-47ca05c9-75d4-4204-b812-4055ba1059d6 tempest-GroupSnapshotsTest-1187820760 None] Creating volume 7c2ecde7-c63d-46d3-bd20-debfcb38de58 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:44:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-47ca05c9-75d4-4204-b812-4055ba1059d6 tempest-GroupSnapshotsTest-1187820760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:44:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-47ca05c9-75d4-4204-b812-4055ba1059d6 tempest-GroupSnapshotsTest-1187820760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:44:26 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-47ca05c9-75d4-4204-b812-4055ba1059d6 tempest-GroupSnapshotsTest-1187820760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:44:26 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-47ca05c9-75d4-4204-b812-4055ba1059d6 tempest-GroupSnapshotsTest-1187820760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:44:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-47ca05c9-75d4-4204-b812-4055ba1059d6 tempest-GroupSnapshotsTest-1187820760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:44:26 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-47ca05c9-75d4-4204-b812-4055ba1059d6 tempest-GroupSnapshotsTest-1187820760 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:44:26 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-47ca05c9-75d4-4204-b812-4055ba1059d6 tempest-GroupSnapshotsTest-1187820760 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:44:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-47ca05c9-75d4-4204-b812-4055ba1059d6 tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7c2ecde7-c63d-46d3-bd20-debfcb38de58 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:44:26 devstack sudo[96895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7c2ecde7-c63d-46d3-bd20-debfcb38de58 1073741824 Jul 08 18:44:26 devstack sudo[96895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:44:26 devstack sudo[96895]: pam_unix(sudo:session): session closed for user root Jul 08 18:44:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-47ca05c9-75d4-4204-b812-4055ba1059d6 tempest-GroupSnapshotsTest-1187820760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7c2ecde7-c63d-46d3-bd20-debfcb38de58 1073741824" returned: 0 in 0.856s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:44:26 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:UPDATE=70,cinder:DELETE=3,cinder:SELECT=67,cinder:INSERT=15 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:44:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-47ca05c9-75d4-4204-b812-4055ba1059d6 tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7c2ecde7-c63d-46d3-bd20-debfcb38de58 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:44:26 devstack sudo[96901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7c2ecde7-c63d-46d3-bd20-debfcb38de58 Jul 08 18:44:26 devstack sudo[96901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:44:27 devstack sudo[96901]: pam_unix(sudo:session): session closed for user root Jul 08 18:44:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-47ca05c9-75d4-4204-b812-4055ba1059d6 tempest-GroupSnapshotsTest-1187820760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7c2ecde7-c63d-46d3-bd20-debfcb38de58" returned: 0 in 0.677s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:44:27 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-47ca05c9-75d4-4204-b812-4055ba1059d6 tempest-GroupSnapshotsTest-1187820760 None] <== create_volume: return (1580ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:44:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-47ca05c9-75d4-4204-b812-4055ba1059d6 tempest-GroupSnapshotsTest-1187820760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.584s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:44:27 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-47ca05c9-75d4-4204-b812-4055ba1059d6 tempest-GroupSnapshotsTest-1187820760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7c776a5-7512-4e05-9576-d004ddcace75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c2ecde7-c63d-46d3-bd20-debfcb38de58', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:44:27 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-47ca05c9-75d4-4204-b812-4055ba1059d6 tempest-GroupSnapshotsTest-1187820760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86be0309-c862-4e7d-8183-478c9f11eb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:44:27 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-47ca05c9-75d4-4204-b812-4055ba1059d6 tempest-GroupSnapshotsTest-1187820760 None] Volume volume-7c2ecde7-c63d-46d3-bd20-debfcb38de58 (7c2ecde7-c63d-46d3-bd20-debfcb38de58): created successfully Jul 08 18:44:27 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-47ca05c9-75d4-4204-b812-4055ba1059d6 tempest-GroupSnapshotsTest-1187820760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86be0309-c862-4e7d-8183-478c9f11eb77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:44:27 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-47ca05c9-75d4-4204-b812-4055ba1059d6 tempest-GroupSnapshotsTest-1187820760 None] Flow 'volume_create_manager' (defdb47a-e341-4e26-9642-319620aa081f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:44:27 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-47ca05c9-75d4-4204-b812-4055ba1059d6 tempest-GroupSnapshotsTest-1187820760 None] Created volume successfully. Jul 08 18:44:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c81cbf59-bad0-4879-ad6e-e4c731146b94 tempest-VolumesActionsTest-1330750976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:44:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c81cbf59-bad0-4879-ad6e-e4c731146b94 tempest-VolumesActionsTest-1330750976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:44:28 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[352798f1-9ef1-4037-a25a-216a02834684]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:44:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c81cbf59-bad0-4879-ad6e-e4c731146b94 tempest-VolumesActionsTest-1330750976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8ff6df71-4736-4ad1-84f3-44d971402f38 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:44:28 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-38e0d890-2661-4253-8002-4cb93600a212 tempest-GroupSnapshotsTest-1187820760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:44:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-38e0d890-2661-4253-8002-4cb93600a212 tempest-GroupSnapshotsTest-1187820760 None] Flow 'volume_create_manager' (c10b0ee7-daca-4bc9-ae34-c6c5dc48cb06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:44:28 devstack sudo[96904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8ff6df71-4736-4ad1-84f3-44d971402f38 Jul 08 18:44:28 devstack sudo[96904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:44:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-38e0d890-2661-4253-8002-4cb93600a212 tempest-GroupSnapshotsTest-1187820760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb562db9-0c45-4244-b8eb-65cc63c26d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:44:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-38e0d890-2661-4253-8002-4cb93600a212 tempest-GroupSnapshotsTest-1187820760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb562db9-0c45-4244-b8eb-65cc63c26d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:44:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-835458964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e476f6a5-3203-42e5-8057-73ca93e3822b,host='devstack@QuobyteHD#QuobyteHD',id=c52f8048-49c6-48dc-bce6-a631d3e3425c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c35e7af23bf148a78ff51789ffe3ca73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:44:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:44:29Z,use_quota=True,user_id='0adf784786744c4d8f6d6bb06f2f20fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54629e2f-080d-467b-af3f-7ecbdda6dd2c),volume_type_id=54629e2f-080d-467b-af3f-7ecbdda6dd2c)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:44:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-38e0d890-2661-4253-8002-4cb93600a212 tempest-GroupSnapshotsTest-1187820760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66e8cd4d-5ac9-4c56-892d-cba086bb83cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:44:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-38e0d890-2661-4253-8002-4cb93600a212 tempest-GroupSnapshotsTest-1187820760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66e8cd4d-5ac9-4c56-892d-cba086bb83cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:44:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-38e0d890-2661-4253-8002-4cb93600a212 tempest-GroupSnapshotsTest-1187820760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8a33249-8507-40a4-b553-c4c512d8ef08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:44:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-38e0d890-2661-4253-8002-4cb93600a212 tempest-GroupSnapshotsTest-1187820760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8a33249-8507-40a4-b553-c4c512d8ef08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c52f8048-49c6-48dc-bce6-a631d3e3425c', 'volume_name': 'volume-c52f8048-49c6-48dc-bce6-a631d3e3425c', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:44:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-38e0d890-2661-4253-8002-4cb93600a212 tempest-GroupSnapshotsTest-1187820760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6009fae8-7e8a-444f-b5be-b7aa4cf53d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:44:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-38e0d890-2661-4253-8002-4cb93600a212 tempest-GroupSnapshotsTest-1187820760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6009fae8-7e8a-444f-b5be-b7aa4cf53d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:44:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-38e0d890-2661-4253-8002-4cb93600a212 tempest-GroupSnapshotsTest-1187820760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a19ac81-d915-4868-a24d-d98967b45ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:44:28 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-38e0d890-2661-4253-8002-4cb93600a212 tempest-GroupSnapshotsTest-1187820760 None] Volume c52f8048-49c6-48dc-bce6-a631d3e3425c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c52f8048-49c6-48dc-bce6-a631d3e3425c', 'volume_size': 1} Jul 08 18:44:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-38e0d890-2661-4253-8002-4cb93600a212 tempest-GroupSnapshotsTest-1187820760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:44:29 devstack sudo[96904]: pam_unix(sudo:session): session closed for user root Jul 08 18:44:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c81cbf59-bad0-4879-ad6e-e4c731146b94 tempest-VolumesActionsTest-1330750976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8ff6df71-4736-4ad1-84f3-44d971402f38" returned: 0 in 0.777s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:44:29 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[26880db3-86b9-4233-8283-e33193a69d25]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:44:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c81cbf59-bad0-4879-ad6e-e4c731146b94 tempest-VolumesActionsTest-1330750976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8ff6df71-4736-4ad1-84f3-44d971402f38 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:44:29 devstack sudo[96910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8ff6df71-4736-4ad1-84f3-44d971402f38 Jul 08 18:44:29 devstack sudo[96910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:44:30 devstack sudo[96910]: pam_unix(sudo:session): session closed for user root Jul 08 18:44:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c81cbf59-bad0-4879-ad6e-e4c731146b94 tempest-VolumesActionsTest-1330750976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8ff6df71-4736-4ad1-84f3-44d971402f38" returned: 0 in 0.798s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:44:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c81cbf59-bad0-4879-ad6e-e4c731146b94 tempest-VolumesActionsTest-1330750976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8ff6df71-4736-4ad1-84f3-44d971402f38 /opt/stack/data/cinder/conversion/8ff6df71-4736-4ad1-84f3-44d971402f38.temp_image.1be26ecd-457d-4342-9b34-65a812e777d0mw1142ke.img {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:44:30 devstack sudo[96915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8ff6df71-4736-4ad1-84f3-44d971402f38 /opt/stack/data/cinder/conversion/8ff6df71-4736-4ad1-84f3-44d971402f38.temp_image.1be26ecd-457d-4342-9b34-65a812e777d0mw1142ke.img Jul 08 18:44:30 devstack sudo[96915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:44:34 devstack sudo[96915]: pam_unix(sudo:session): session closed for user root Jul 08 18:44:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c81cbf59-bad0-4879-ad6e-e4c731146b94 tempest-VolumesActionsTest-1330750976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8ff6df71-4736-4ad1-84f3-44d971402f38 /opt/stack/data/cinder/conversion/8ff6df71-4736-4ad1-84f3-44d971402f38.temp_image.1be26ecd-457d-4342-9b34-65a812e777d0mw1142ke.img" returned: 0 in 4.463s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:44:34 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[242616f8-782c-40f9-8ec6-3b176b2d0e25]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:44:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c81cbf59-bad0-4879-ad6e-e4c731146b94 tempest-VolumesActionsTest-1330750976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8ff6df71-4736-4ad1-84f3-44d971402f38 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:44:34 devstack sudo[96929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8ff6df71-4736-4ad1-84f3-44d971402f38 Jul 08 18:44:34 devstack sudo[96929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:44:35 devstack sudo[96929]: pam_unix(sudo:session): session closed for user root Jul 08 18:44:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c81cbf59-bad0-4879-ad6e-e4c731146b94 tempest-VolumesActionsTest-1330750976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8ff6df71-4736-4ad1-84f3-44d971402f38" returned: 0 in 0.965s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:44:35 devstack cinder-volume[86873]: DEBUG cinder.image.image_utils [None req-c81cbf59-bad0-4879-ad6e-e4c731146b94 tempest-VolumesActionsTest-1330750976 None] Image conversion details: src /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8ff6df71-4736-4ad1-84f3-44d971402f38, size 1024.00 MB, duration 4.46 sec, destination /opt/stack/data/cinder/conversion/8ff6df71-4736-4ad1-84f3-44d971402f38.temp_image.1be26ecd-457d-4342-9b34-65a812e777d0mw1142ke.img {{(pid=86873) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:44:35 devstack cinder-volume[86873]: INFO cinder.image.image_utils [None req-c81cbf59-bad0-4879-ad6e-e4c731146b94 tempest-VolumesActionsTest-1330750976 None] Converted 1024.00 MB image at 229.36 MB/s Jul 08 18:44:35 devstack cinder-volume[86873]: DEBUG cinder.image.image_utils [None req-c81cbf59-bad0-4879-ad6e-e4c731146b94 tempest-VolumesActionsTest-1330750976 None] 1be26ecd-457d-4342-9b34-65a812e777d0 was raw, no need to convert to raw {{(pid=86873) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 08 18:44:45 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:UPDATE=43,cinder:SELECT=51,cinder:DELETE=1,cinder:INSERT=11 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:44:45 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:UPDATE=1,cinder:DELETE=1,cinder:SELECT=3 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:44:48 devstack cinder-volume[86873]: DEBUG oslo_service.periodic_task [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86873) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:44:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:44:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:44:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:44:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:44:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:44:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:44:48 devstack sudo[96935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:44:48 devstack sudo[96935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:44:48 devstack sudo[96935]: pam_unix(sudo:session): session closed for user root Jul 08 18:44:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.770s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:44:48 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:44:49 devstack cinder-volume[86873]: DEBUG oslo_service.periodic_task [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running periodic task VolumeManager._thread_info {{(pid=86873) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:44:49 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] thread count: 29 {{(pid=86873) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:44:49 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] thread info: [<_MainThread(MainThread, started 138577734545536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86873) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:44:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c81cbf59-bad0-4879-ad6e-e4c731146b94 tempest-VolumesActionsTest-1330750976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.647s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:44:54 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c81cbf59-bad0-4879-ad6e-e4c731146b94 tempest-VolumesActionsTest-1330750976 None] Uploaded volume to glance image-id: 1be26ecd-457d-4342-9b34-65a812e777d0. {{(pid=86873) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 08 18:44:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-38e0d890-2661-4253-8002-4cb93600a212 tempest-GroupSnapshotsTest-1187820760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 25.437s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:44:54 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-38e0d890-2661-4253-8002-4cb93600a212 tempest-GroupSnapshotsTest-1187820760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e476f6a5-3203-42e5-8057-73ca93e3822b,created_at=2026-07-08T16:44:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-835458964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e476f6a5-3203-42e5-8057-73ca93e3822b,host='devstack@QuobyteHD#QuobyteHD',id=c52f8048-49c6-48dc-bce6-a631d3e3425c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c35e7af23bf148a78ff51789ffe3ca73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:44:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:44:29Z,use_quota=True,user_id='0adf784786744c4d8f6d6bb06f2f20fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54629e2f-080d-467b-af3f-7ecbdda6dd2c),volume_type_id=54629e2f-080d-467b-af3f-7ecbdda6dd2c)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:44:54 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-38e0d890-2661-4253-8002-4cb93600a212 tempest-GroupSnapshotsTest-1187820760 None] Creating volume c52f8048-49c6-48dc-bce6-a631d3e3425c {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:44:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-38e0d890-2661-4253-8002-4cb93600a212 tempest-GroupSnapshotsTest-1187820760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:44:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-38e0d890-2661-4253-8002-4cb93600a212 tempest-GroupSnapshotsTest-1187820760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:44:54 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-38e0d890-2661-4253-8002-4cb93600a212 tempest-GroupSnapshotsTest-1187820760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:44:54 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-38e0d890-2661-4253-8002-4cb93600a212 tempest-GroupSnapshotsTest-1187820760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:44:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-38e0d890-2661-4253-8002-4cb93600a212 tempest-GroupSnapshotsTest-1187820760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:44:54 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-38e0d890-2661-4253-8002-4cb93600a212 tempest-GroupSnapshotsTest-1187820760 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:44:54 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-38e0d890-2661-4253-8002-4cb93600a212 tempest-GroupSnapshotsTest-1187820760 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:44:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-38e0d890-2661-4253-8002-4cb93600a212 tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c52f8048-49c6-48dc-bce6-a631d3e3425c 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:44:54 devstack sudo[96941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c52f8048-49c6-48dc-bce6-a631d3e3425c 1073741824 Jul 08 18:44:54 devstack sudo[96941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:44:54 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-c81cbf59-bad0-4879-ad6e-e4c731146b94 tempest-VolumesActionsTest-1330750976 None] Copy volume to image completed successfully. Jul 08 18:44:55 devstack sudo[96941]: pam_unix(sudo:session): session closed for user root Jul 08 18:44:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-38e0d890-2661-4253-8002-4cb93600a212 tempest-GroupSnapshotsTest-1187820760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c52f8048-49c6-48dc-bce6-a631d3e3425c 1073741824" returned: 0 in 0.854s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:44:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-38e0d890-2661-4253-8002-4cb93600a212 tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c52f8048-49c6-48dc-bce6-a631d3e3425c {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:44:55 devstack sudo[96946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c52f8048-49c6-48dc-bce6-a631d3e3425c Jul 08 18:44:55 devstack sudo[96946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:44:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-a011f327-3780-4af5-b30a-57b1f36fbcbf tempest-VolumesActionsTest-1330750976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:44:55 devstack sudo[96946]: pam_unix(sudo:session): session closed for user root Jul 08 18:44:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-38e0d890-2661-4253-8002-4cb93600a212 tempest-GroupSnapshotsTest-1187820760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c52f8048-49c6-48dc-bce6-a631d3e3425c" returned: 0 in 0.665s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:44:55 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-38e0d890-2661-4253-8002-4cb93600a212 tempest-GroupSnapshotsTest-1187820760 None] <== create_volume: return (1571ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:44:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-38e0d890-2661-4253-8002-4cb93600a212 tempest-GroupSnapshotsTest-1187820760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.574s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:44:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-a011f327-3780-4af5-b30a-57b1f36fbcbf tempest-VolumesActionsTest-1330750976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.323s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:44:55 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b87c3c-6863-4fdd-881b-d2080d6c142e]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:44:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-a011f327-3780-4af5-b30a-57b1f36fbcbf tempest-VolumesActionsTest-1330750976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8ff6df71-4736-4ad1-84f3-44d971402f38 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:44:56 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-38e0d890-2661-4253-8002-4cb93600a212 tempest-GroupSnapshotsTest-1187820760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a19ac81-d915-4868-a24d-d98967b45ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c52f8048-49c6-48dc-bce6-a631d3e3425c', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:44:56 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-38e0d890-2661-4253-8002-4cb93600a212 tempest-GroupSnapshotsTest-1187820760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2638478-b92e-43dd-be8c-ff82183e42df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:44:56 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-38e0d890-2661-4253-8002-4cb93600a212 tempest-GroupSnapshotsTest-1187820760 None] Volume volume-c52f8048-49c6-48dc-bce6-a631d3e3425c (c52f8048-49c6-48dc-bce6-a631d3e3425c): created successfully Jul 08 18:44:56 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-38e0d890-2661-4253-8002-4cb93600a212 tempest-GroupSnapshotsTest-1187820760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2638478-b92e-43dd-be8c-ff82183e42df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:44:56 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-38e0d890-2661-4253-8002-4cb93600a212 tempest-GroupSnapshotsTest-1187820760 None] Flow 'volume_create_manager' (c10b0ee7-daca-4bc9-ae34-c6c5dc48cb06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:44:56 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-38e0d890-2661-4253-8002-4cb93600a212 tempest-GroupSnapshotsTest-1187820760 None] Created volume successfully. Jul 08 18:44:56 devstack sudo[96949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8ff6df71-4736-4ad1-84f3-44d971402f38 Jul 08 18:44:56 devstack sudo[96949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:44:56 devstack sudo[96949]: pam_unix(sudo:session): session closed for user root Jul 08 18:44:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-a011f327-3780-4af5-b30a-57b1f36fbcbf tempest-VolumesActionsTest-1330750976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8ff6df71-4736-4ad1-84f3-44d971402f38" returned: 0 in 0.773s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:44:56 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8a3e96-cec4-4806-81a6-7546e28e7850]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:44:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-a011f327-3780-4af5-b30a-57b1f36fbcbf tempest-VolumesActionsTest-1330750976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8ff6df71-4736-4ad1-84f3-44d971402f38 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:44:56 devstack sudo[96954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8ff6df71-4736-4ad1-84f3-44d971402f38 Jul 08 18:44:56 devstack sudo[96954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:44:57 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-47cb043f-fad1-4222-b1da-033d0afc7a1e tempest-GroupSnapshotsTest-1187820760 None] Update group completed successfully. Jul 08 18:44:57 devstack sudo[96954]: pam_unix(sudo:session): session closed for user root Jul 08 18:44:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-a011f327-3780-4af5-b30a-57b1f36fbcbf tempest-VolumesActionsTest-1330750976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8ff6df71-4736-4ad1-84f3-44d971402f38" returned: 0 in 0.809s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:44:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-a011f327-3780-4af5-b30a-57b1f36fbcbf tempest-VolumesActionsTest-1330750976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8ff6df71-4736-4ad1-84f3-44d971402f38 /opt/stack/data/cinder/conversion/8ff6df71-4736-4ad1-84f3-44d971402f38.temp_image.aa48bcdc-3825-43bb-955e-e9b6f4580b46fe0jy43f.img {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:44:57 devstack sudo[96959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8ff6df71-4736-4ad1-84f3-44d971402f38 /opt/stack/data/cinder/conversion/8ff6df71-4736-4ad1-84f3-44d971402f38.temp_image.aa48bcdc-3825-43bb-955e-e9b6f4580b46fe0jy43f.img Jul 08 18:44:57 devstack sudo[96959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:44:58 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-00f787ad-0cec-423f-a4ba-aaa1562850c7 tempest-GroupSnapshotsTest-1187820760 None] Update group completed successfully. Jul 08 18:45:00 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-8705489c-18e9-4777-90f3-fb255151ec0e tempest-GroupSnapshotsTest-1187820760 None] Update group completed successfully. Jul 08 18:45:01 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-c7e78f38-a1ce-4dcf-9cee-61b2c554091b tempest-GroupSnapshotsTest-1187820760 None] Update group completed successfully. Jul 08 18:45:02 devstack sudo[96959]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-a011f327-3780-4af5-b30a-57b1f36fbcbf tempest-VolumesActionsTest-1330750976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8ff6df71-4736-4ad1-84f3-44d971402f38 /opt/stack/data/cinder/conversion/8ff6df71-4736-4ad1-84f3-44d971402f38.temp_image.aa48bcdc-3825-43bb-955e-e9b6f4580b46fe0jy43f.img" returned: 0 in 4.777s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:02 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50f31e5-3a9b-40a8-b1e2-6fc6777bfcd3]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:45:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-a011f327-3780-4af5-b30a-57b1f36fbcbf tempest-VolumesActionsTest-1330750976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8ff6df71-4736-4ad1-84f3-44d971402f38 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:02 devstack sudo[97014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8ff6df71-4736-4ad1-84f3-44d971402f38 Jul 08 18:45:02 devstack sudo[97014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:03 devstack sudo[97014]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-a011f327-3780-4af5-b30a-57b1f36fbcbf tempest-VolumesActionsTest-1330750976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8ff6df71-4736-4ad1-84f3-44d971402f38" returned: 0 in 0.901s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:03 devstack cinder-volume[86873]: DEBUG cinder.image.image_utils [None req-a011f327-3780-4af5-b30a-57b1f36fbcbf tempest-VolumesActionsTest-1330750976 None] Image conversion details: src /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8ff6df71-4736-4ad1-84f3-44d971402f38, size 1024.00 MB, duration 4.78 sec, destination /opt/stack/data/cinder/conversion/8ff6df71-4736-4ad1-84f3-44d971402f38.temp_image.aa48bcdc-3825-43bb-955e-e9b6f4580b46fe0jy43f.img {{(pid=86873) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:45:03 devstack cinder-volume[86873]: INFO cinder.image.image_utils [None req-a011f327-3780-4af5-b30a-57b1f36fbcbf tempest-VolumesActionsTest-1330750976 None] Converted 1024.00 MB image at 214.33 MB/s Jul 08 18:45:03 devstack cinder-volume[86873]: DEBUG cinder.image.image_utils [None req-a011f327-3780-4af5-b30a-57b1f36fbcbf tempest-VolumesActionsTest-1330750976 None] aa48bcdc-3825-43bb-955e-e9b6f4580b46 was raw, converting to qcow2 {{(pid=86873) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 08 18:45:03 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[788cca3e-2831-4042-91e0-194cb3fde5e6]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:45:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-a011f327-3780-4af5-b30a-57b1f36fbcbf tempest-VolumesActionsTest-1330750976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8ff6df71-4736-4ad1-84f3-44d971402f38.temp_image.aa48bcdc-3825-43bb-955e-e9b6f4580b46fe0jy43f.img {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:03 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-38c7c51b-0d7a-434d-af30-83870b9b1a0b tempest-GroupSnapshotsTest-1187820760 None] GroupSnapshot 11b1eaaa-ab74-4774-aad9-69796bc80400: creating. Jul 08 18:45:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-38c7c51b-0d7a-434d-af30-83870b9b1a0b tempest-GroupSnapshotsTest-1187820760 None] Group snapshot 11b1eaaa-ab74-4774-aad9-69796bc80400: creating. {{(pid=86873) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 08 18:45:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-38c7c51b-0d7a-434d-af30-83870b9b1a0b tempest-GroupSnapshotsTest-1187820760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:45:03 devstack sudo[97020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8ff6df71-4736-4ad1-84f3-44d971402f38.temp_image.aa48bcdc-3825-43bb-955e-e9b6f4580b46fe0jy43f.img Jul 08 18:45:03 devstack sudo[97020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:04 devstack sudo[97020]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-a011f327-3780-4af5-b30a-57b1f36fbcbf tempest-VolumesActionsTest-1330750976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8ff6df71-4736-4ad1-84f3-44d971402f38.temp_image.aa48bcdc-3825-43bb-955e-e9b6f4580b46fe0jy43f.img" returned: 0 in 0.706s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-a011f327-3780-4af5-b30a-57b1f36fbcbf tempest-VolumesActionsTest-1330750976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8ff6df71-4736-4ad1-84f3-44d971402f38.temp_image.aa48bcdc-3825-43bb-955e-e9b6f4580b46fe0jy43f.img {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:04 devstack sudo[97024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8ff6df71-4736-4ad1-84f3-44d971402f38.temp_image.aa48bcdc-3825-43bb-955e-e9b6f4580b46fe0jy43f.img Jul 08 18:45:04 devstack sudo[97024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:04 devstack sudo[97024]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-a011f327-3780-4af5-b30a-57b1f36fbcbf tempest-VolumesActionsTest-1330750976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8ff6df71-4736-4ad1-84f3-44d971402f38.temp_image.aa48bcdc-3825-43bb-955e-e9b6f4580b46fe0jy43f.img" returned: 1 in 0.697s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-a011f327-3780-4af5-b30a-57b1f36fbcbf tempest-VolumesActionsTest-1330750976 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8ff6df71-4736-4ad1-84f3-44d971402f38.temp_image.aa48bcdc-3825-43bb-955e-e9b6f4580b46fe0jy43f.img' failed. Not Retrying. {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:45:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-a011f327-3780-4af5-b30a-57b1f36fbcbf tempest-VolumesActionsTest-1330750976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8ff6df71-4736-4ad1-84f3-44d971402f38.temp_image.aa48bcdc-3825-43bb-955e-e9b6f4580b46fe0jy43f.img /opt/stack/data/cinder/conversion/vol_upload_0a0wamto {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:04 devstack sudo[97029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8ff6df71-4736-4ad1-84f3-44d971402f38.temp_image.aa48bcdc-3825-43bb-955e-e9b6f4580b46fe0jy43f.img /opt/stack/data/cinder/conversion/vol_upload_0a0wamto Jul 08 18:45:04 devstack sudo[97029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:05 devstack sudo[97029]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-a011f327-3780-4af5-b30a-57b1f36fbcbf tempest-VolumesActionsTest-1330750976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8ff6df71-4736-4ad1-84f3-44d971402f38.temp_image.aa48bcdc-3825-43bb-955e-e9b6f4580b46fe0jy43f.img /opt/stack/data/cinder/conversion/vol_upload_0a0wamto" returned: 0 in 0.671s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:05 devstack cinder-volume[86873]: DEBUG cinder.image.image_utils [None req-a011f327-3780-4af5-b30a-57b1f36fbcbf tempest-VolumesActionsTest-1330750976 None] Image conversion details: src /opt/stack/data/cinder/conversion/8ff6df71-4736-4ad1-84f3-44d971402f38.temp_image.aa48bcdc-3825-43bb-955e-e9b6f4580b46fe0jy43f.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_0a0wamto {{(pid=86873) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:45:05 devstack cinder-volume[86873]: INFO cinder.image.image_utils [None req-a011f327-3780-4af5-b30a-57b1f36fbcbf tempest-VolumesActionsTest-1330750976 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 08 18:45:05 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[521b2530-372a-494a-9637-dd607d53a4f9]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:45:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-a011f327-3780-4af5-b30a-57b1f36fbcbf tempest-VolumesActionsTest-1330750976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_0a0wamto {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:05 devstack sudo[97035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_0a0wamto Jul 08 18:45:05 devstack sudo[97035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:06 devstack sudo[97035]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-a011f327-3780-4af5-b30a-57b1f36fbcbf tempest-VolumesActionsTest-1330750976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_0a0wamto" returned: 0 in 0.693s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-a011f327-3780-4af5-b30a-57b1f36fbcbf tempest-VolumesActionsTest-1330750976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.401s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:45:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-a011f327-3780-4af5-b30a-57b1f36fbcbf tempest-VolumesActionsTest-1330750976 None] Uploaded volume to glance image-id: aa48bcdc-3825-43bb-955e-e9b6f4580b46. {{(pid=86873) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 08 18:45:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-38c7c51b-0d7a-434d-af30-83870b9b1a0b tempest-GroupSnapshotsTest-1187820760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.010s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:45:07 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-38c7c51b-0d7a-434d-af30-83870b9b1a0b tempest-GroupSnapshotsTest-1187820760 None] Creating offline snapshot 5686407f-d5ae-4e2f-83c9-c25d04cffb6b of volume c52f8048-49c6-48dc-bce6-a631d3e3425c {{(pid=86873) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:45:07 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-a011f327-3780-4af5-b30a-57b1f36fbcbf tempest-VolumesActionsTest-1330750976 None] Copy volume to image completed successfully. Jul 08 18:45:07 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f886d4-39b5-448e-b869-c43ec40a350a]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:45:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-38c7c51b-0d7a-434d-af30-83870b9b1a0b tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c52f8048-49c6-48dc-bce6-a631d3e3425c {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:07 devstack sudo[97040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c52f8048-49c6-48dc-bce6-a631d3e3425c Jul 08 18:45:07 devstack sudo[97040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:08 devstack sudo[97040]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-38c7c51b-0d7a-434d-af30-83870b9b1a0b tempest-GroupSnapshotsTest-1187820760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c52f8048-49c6-48dc-bce6-a631d3e3425c" returned: 0 in 0.784s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-38c7c51b-0d7a-434d-af30-83870b9b1a0b tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c52f8048-49c6-48dc-bce6-a631d3e3425c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c52f8048-49c6-48dc-bce6-a631d3e3425c.5686407f-d5ae-4e2f-83c9-c25d04cffb6b 1G {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:08 devstack sudo[97045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c52f8048-49c6-48dc-bce6-a631d3e3425c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c52f8048-49c6-48dc-bce6-a631d3e3425c.5686407f-d5ae-4e2f-83c9-c25d04cffb6b 1G Jul 08 18:45:08 devstack sudo[97045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:08 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-2df35eaa-f0ca-4d01-b96b-6f1874a7af03 tempest-VolumesActionsTest-1330750976 None] Acquiring lock "cinder-8ff6df71-4736-4ad1-84f3-44d971402f38-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:45:08 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-2df35eaa-f0ca-4d01-b96b-6f1874a7af03 tempest-VolumesActionsTest-1330750976 None] Lock "cinder-8ff6df71-4736-4ad1-84f3-44d971402f38-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:45:08 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-2df35eaa-f0ca-4d01-b96b-6f1874a7af03 tempest-VolumesActionsTest-1330750976 None] Acquiring lock "cinder-quobyte-8ff6df71-4736-4ad1-84f3-44d971402f38" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:45:08 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-2df35eaa-f0ca-4d01-b96b-6f1874a7af03 tempest-VolumesActionsTest-1330750976 None] Lock "cinder-quobyte-8ff6df71-4736-4ad1-84f3-44d971402f38" acquired by "delete_volume" :: waited 0.015s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:45:08 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd36037f-05b9-48b3-8c12-ae37020cd96d]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:45:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2df35eaa-f0ca-4d01-b96b-6f1874a7af03 tempest-VolumesActionsTest-1330750976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8ff6df71-4736-4ad1-84f3-44d971402f38 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:09 devstack sudo[97045]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-38c7c51b-0d7a-434d-af30-83870b9b1a0b tempest-GroupSnapshotsTest-1187820760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c52f8048-49c6-48dc-bce6-a631d3e3425c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c52f8048-49c6-48dc-bce6-a631d3e3425c.5686407f-d5ae-4e2f-83c9-c25d04cffb6b 1G" returned: 0 in 0.839s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-38c7c51b-0d7a-434d-af30-83870b9b1a0b tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c52f8048-49c6-48dc-bce6-a631d3e3425c -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c52f8048-49c6-48dc-bce6-a631d3e3425c.5686407f-d5ae-4e2f-83c9-c25d04cffb6b {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:09 devstack sudo[97054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c52f8048-49c6-48dc-bce6-a631d3e3425c -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c52f8048-49c6-48dc-bce6-a631d3e3425c.5686407f-d5ae-4e2f-83c9-c25d04cffb6b Jul 08 18:45:09 devstack sudo[97054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:09 devstack sudo[97053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8ff6df71-4736-4ad1-84f3-44d971402f38 Jul 08 18:45:09 devstack sudo[97053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:09 devstack sudo[97053]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2df35eaa-f0ca-4d01-b96b-6f1874a7af03 tempest-VolumesActionsTest-1330750976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8ff6df71-4736-4ad1-84f3-44d971402f38" returned: 0 in 0.756s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2df35eaa-f0ca-4d01-b96b-6f1874a7af03 tempest-VolumesActionsTest-1330750976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8ff6df71-4736-4ad1-84f3-44d971402f38 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:09 devstack sudo[97054]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-38c7c51b-0d7a-434d-af30-83870b9b1a0b tempest-GroupSnapshotsTest-1187820760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c52f8048-49c6-48dc-bce6-a631d3e3425c -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c52f8048-49c6-48dc-bce6-a631d3e3425c.5686407f-d5ae-4e2f-83c9-c25d04cffb6b" returned: 0 in 0.693s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:09 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-38c7c51b-0d7a-434d-af30-83870b9b1a0b tempest-GroupSnapshotsTest-1187820760 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c52f8048-49c6-48dc-bce6-a631d3e3425c.5686407f-d5ae-4e2f-83c9-c25d04cffb6b is being set with open permissions: ugo+rw: NotImplementedError Jul 08 18:45:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-38c7c51b-0d7a-434d-af30-83870b9b1a0b tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c52f8048-49c6-48dc-bce6-a631d3e3425c.5686407f-d5ae-4e2f-83c9-c25d04cffb6b {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:09 devstack sudo[97063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8ff6df71-4736-4ad1-84f3-44d971402f38 Jul 08 18:45:09 devstack sudo[97063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:09 devstack sudo[97065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c52f8048-49c6-48dc-bce6-a631d3e3425c.5686407f-d5ae-4e2f-83c9-c25d04cffb6b Jul 08 18:45:09 devstack sudo[97065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:10 devstack sudo[97063]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2df35eaa-f0ca-4d01-b96b-6f1874a7af03 tempest-VolumesActionsTest-1330750976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8ff6df71-4736-4ad1-84f3-44d971402f38" returned: 0 in 0.641s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:10 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-2df35eaa-f0ca-4d01-b96b-6f1874a7af03 tempest-VolumesActionsTest-1330750976 None] Lock "cinder-quobyte-8ff6df71-4736-4ad1-84f3-44d971402f38" released by "delete_volume" :: held 1.435s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:45:10 devstack sudo[97065]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-38c7c51b-0d7a-434d-af30-83870b9b1a0b tempest-GroupSnapshotsTest-1187820760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c52f8048-49c6-48dc-bce6-a631d3e3425c.5686407f-d5ae-4e2f-83c9-c25d04cffb6b" returned: 0 in 0.652s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-38c7c51b-0d7a-434d-af30-83870b9b1a0b tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c52f8048-49c6-48dc-bce6-a631d3e3425c.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:10 devstack sudo[97069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c52f8048-49c6-48dc-bce6-a631d3e3425c.info Jul 08 18:45:10 devstack sudo[97069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:10 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-2df35eaa-f0ca-4d01-b96b-6f1874a7af03 tempest-VolumesActionsTest-1330750976 None] Created reservations ['8b343b51-e056-496e-91d6-42222617917d', '7dd90722-80f7-4af7-afd9-37f0d1e35fb1', '714628a0-e4ad-4c13-ac2e-0ea61be9e4c5', 'c424c5d2-530b-4161-8093-b84399fcd6b6'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:45:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-2df35eaa-f0ca-4d01-b96b-6f1874a7af03 tempest-VolumesActionsTest-1330750976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:45:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-2df35eaa-f0ca-4d01-b96b-6f1874a7af03 tempest-VolumesActionsTest-1330750976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:45:10 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-2df35eaa-f0ca-4d01-b96b-6f1874a7af03 tempest-VolumesActionsTest-1330750976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:45:10 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-2df35eaa-f0ca-4d01-b96b-6f1874a7af03 tempest-VolumesActionsTest-1330750976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:45:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-2df35eaa-f0ca-4d01-b96b-6f1874a7af03 tempest-VolumesActionsTest-1330750976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:45:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2df35eaa-f0ca-4d01-b96b-6f1874a7af03 tempest-VolumesActionsTest-1330750976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:10 devstack sudo[97071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:45:10 devstack sudo[97071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:11 devstack sudo[97069]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-38c7c51b-0d7a-434d-af30-83870b9b1a0b tempest-GroupSnapshotsTest-1187820760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c52f8048-49c6-48dc-bce6-a631d3e3425c.info" returned: 0 in 0.674s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:11 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-38c7c51b-0d7a-434d-af30-83870b9b1a0b tempest-GroupSnapshotsTest-1187820760 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c52f8048-49c6-48dc-bce6-a631d3e3425c.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 18:45:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-38c7c51b-0d7a-434d-af30-83870b9b1a0b tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c52f8048-49c6-48dc-bce6-a631d3e3425c.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:11 devstack sudo[97076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c52f8048-49c6-48dc-bce6-a631d3e3425c.info Jul 08 18:45:11 devstack sudo[97076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:11 devstack sudo[97071]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2df35eaa-f0ca-4d01-b96b-6f1874a7af03 tempest-VolumesActionsTest-1330750976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.687s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:11 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-2df35eaa-f0ca-4d01-b96b-6f1874a7af03 tempest-VolumesActionsTest-1330750976 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:45:11 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-2df35eaa-f0ca-4d01-b96b-6f1874a7af03 tempest-VolumesActionsTest-1330750976 None] Deleted volume successfully. Jul 08 18:45:11 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-2df35eaa-f0ca-4d01-b96b-6f1874a7af03 tempest-VolumesActionsTest-1330750976 None] Lock "cinder-8ff6df71-4736-4ad1-84f3-44d971402f38-delete_volume" released by "delete_volume" :: held 2.354s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:45:11 devstack sudo[97076]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-38c7c51b-0d7a-434d-af30-83870b9b1a0b tempest-GroupSnapshotsTest-1187820760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c52f8048-49c6-48dc-bce6-a631d3e3425c.info" returned: 0 in 0.697s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-38c7c51b-0d7a-434d-af30-83870b9b1a0b tempest-GroupSnapshotsTest-1187820760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.428s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:45:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-38c7c51b-0d7a-434d-af30-83870b9b1a0b tempest-GroupSnapshotsTest-1187820760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:45:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-38c7c51b-0d7a-434d-af30-83870b9b1a0b tempest-GroupSnapshotsTest-1187820760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:45:11 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-38c7c51b-0d7a-434d-af30-83870b9b1a0b tempest-GroupSnapshotsTest-1187820760 None] Creating offline snapshot d404ea60-3ffb-4683-81c4-af7afedc8ec1 of volume 7c2ecde7-c63d-46d3-bd20-debfcb38de58 {{(pid=86873) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:45:11 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[0afcfd58-c2fc-4c93-957c-713075447e28]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:45:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-38c7c51b-0d7a-434d-af30-83870b9b1a0b tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7c2ecde7-c63d-46d3-bd20-debfcb38de58 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:11 devstack sudo[97080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7c2ecde7-c63d-46d3-bd20-debfcb38de58 Jul 08 18:45:11 devstack sudo[97080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:12 devstack sudo[97080]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-38c7c51b-0d7a-434d-af30-83870b9b1a0b tempest-GroupSnapshotsTest-1187820760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7c2ecde7-c63d-46d3-bd20-debfcb38de58" returned: 0 in 0.773s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-38c7c51b-0d7a-434d-af30-83870b9b1a0b tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7c2ecde7-c63d-46d3-bd20-debfcb38de58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7c2ecde7-c63d-46d3-bd20-debfcb38de58.d404ea60-3ffb-4683-81c4-af7afedc8ec1 1G {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:12 devstack sudo[97087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7c2ecde7-c63d-46d3-bd20-debfcb38de58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7c2ecde7-c63d-46d3-bd20-debfcb38de58.d404ea60-3ffb-4683-81c4-af7afedc8ec1 1G Jul 08 18:45:12 devstack sudo[97087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:13 devstack sudo[97087]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-38c7c51b-0d7a-434d-af30-83870b9b1a0b tempest-GroupSnapshotsTest-1187820760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7c2ecde7-c63d-46d3-bd20-debfcb38de58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7c2ecde7-c63d-46d3-bd20-debfcb38de58.d404ea60-3ffb-4683-81c4-af7afedc8ec1 1G" returned: 0 in 0.862s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-38c7c51b-0d7a-434d-af30-83870b9b1a0b tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c2ecde7-c63d-46d3-bd20-debfcb38de58 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7c2ecde7-c63d-46d3-bd20-debfcb38de58.d404ea60-3ffb-4683-81c4-af7afedc8ec1 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:13 devstack sudo[97093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c2ecde7-c63d-46d3-bd20-debfcb38de58 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7c2ecde7-c63d-46d3-bd20-debfcb38de58.d404ea60-3ffb-4683-81c4-af7afedc8ec1 Jul 08 18:45:13 devstack sudo[97093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:14 devstack sudo[97093]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-38c7c51b-0d7a-434d-af30-83870b9b1a0b tempest-GroupSnapshotsTest-1187820760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c2ecde7-c63d-46d3-bd20-debfcb38de58 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7c2ecde7-c63d-46d3-bd20-debfcb38de58.d404ea60-3ffb-4683-81c4-af7afedc8ec1" returned: 0 in 0.715s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:14 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-38c7c51b-0d7a-434d-af30-83870b9b1a0b tempest-GroupSnapshotsTest-1187820760 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7c2ecde7-c63d-46d3-bd20-debfcb38de58.d404ea60-3ffb-4683-81c4-af7afedc8ec1 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 18:45:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-38c7c51b-0d7a-434d-af30-83870b9b1a0b tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7c2ecde7-c63d-46d3-bd20-debfcb38de58.d404ea60-3ffb-4683-81c4-af7afedc8ec1 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:14 devstack sudo[97098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7c2ecde7-c63d-46d3-bd20-debfcb38de58.d404ea60-3ffb-4683-81c4-af7afedc8ec1 Jul 08 18:45:14 devstack sudo[97098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:14 devstack sudo[97098]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-38c7c51b-0d7a-434d-af30-83870b9b1a0b tempest-GroupSnapshotsTest-1187820760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7c2ecde7-c63d-46d3-bd20-debfcb38de58.d404ea60-3ffb-4683-81c4-af7afedc8ec1" returned: 0 in 0.728s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-38c7c51b-0d7a-434d-af30-83870b9b1a0b tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7c2ecde7-c63d-46d3-bd20-debfcb38de58.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:14 devstack sudo[97102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7c2ecde7-c63d-46d3-bd20-debfcb38de58.info Jul 08 18:45:14 devstack sudo[97102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:15 devstack sudo[97102]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-38c7c51b-0d7a-434d-af30-83870b9b1a0b tempest-GroupSnapshotsTest-1187820760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7c2ecde7-c63d-46d3-bd20-debfcb38de58.info" returned: 0 in 0.646s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:15 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-38c7c51b-0d7a-434d-af30-83870b9b1a0b tempest-GroupSnapshotsTest-1187820760 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7c2ecde7-c63d-46d3-bd20-debfcb38de58.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 18:45:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-38c7c51b-0d7a-434d-af30-83870b9b1a0b tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7c2ecde7-c63d-46d3-bd20-debfcb38de58.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:15 devstack sudo[97111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7c2ecde7-c63d-46d3-bd20-debfcb38de58.info Jul 08 18:45:15 devstack sudo[97111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:16 devstack sudo[97111]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-38c7c51b-0d7a-434d-af30-83870b9b1a0b tempest-GroupSnapshotsTest-1187820760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7c2ecde7-c63d-46d3-bd20-debfcb38de58.info" returned: 0 in 0.667s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-38c7c51b-0d7a-434d-af30-83870b9b1a0b tempest-GroupSnapshotsTest-1187820760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.504s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:45:16 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-38c7c51b-0d7a-434d-af30-83870b9b1a0b tempest-GroupSnapshotsTest-1187820760 None] group_snapshot 11b1eaaa-ab74-4774-aad9-69796bc80400: created successfully Jul 08 18:45:17 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-db72532b-4086-438a-85cb-71ca84ed19c3 tempest-GroupSnapshotsTest-1187820760 None] group_snapshot 11b1eaaa-ab74-4774-aad9-69796bc80400: deleting Jul 08 18:45:17 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-db72532b-4086-438a-85cb-71ca84ed19c3 tempest-GroupSnapshotsTest-1187820760 None] group_snapshot 11b1eaaa-ab74-4774-aad9-69796bc80400: deleting {{(pid=86873) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 08 18:45:17 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-db72532b-4086-438a-85cb-71ca84ed19c3 tempest-GroupSnapshotsTest-1187820760 None] Acquiring lock "cinder-quobyte-c52f8048-49c6-48dc-bce6-a631d3e3425c" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:45:17 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-db72532b-4086-438a-85cb-71ca84ed19c3 tempest-GroupSnapshotsTest-1187820760 None] Lock "cinder-quobyte-c52f8048-49c6-48dc-bce6-a631d3e3425c" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:45:17 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-db72532b-4086-438a-85cb-71ca84ed19c3 tempest-GroupSnapshotsTest-1187820760 None] Acquiring lock "cinder-quobyte-5686407f-d5ae-4e2f-83c9-c25d04cffb6b" by "_delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:45:17 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:45:17 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] Flow 'volume_create_manager' (81d8fef5-90ba-445e-bca2-c26fbe83865d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:45:17 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e867b511-39a3-435f-a745-057b38ef6778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:45:17 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-db72532b-4086-438a-85cb-71ca84ed19c3 tempest-GroupSnapshotsTest-1187820760 None] Lock "cinder-quobyte-5686407f-d5ae-4e2f-83c9-c25d04cffb6b" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:45:17 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-db72532b-4086-438a-85cb-71ca84ed19c3 tempest-GroupSnapshotsTest-1187820760 None] Deleting offline snapshot 5686407f-d5ae-4e2f-83c9-c25d04cffb6b of volume c52f8048-49c6-48dc-bce6-a631d3e3425c {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:45:17 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-db72532b-4086-438a-85cb-71ca84ed19c3 tempest-GroupSnapshotsTest-1187820760 None] snapshot_file for this snap is: volume-c52f8048-49c6-48dc-bce6-a631d3e3425c.5686407f-d5ae-4e2f-83c9-c25d04cffb6b {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:45:17 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e867b511-39a3-435f-a745-057b38ef6778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:45:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-826669377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6df86b0-0d70-4340-9d8e-d96190fdea5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09e61d3f5e644d9f9c271369f8712202',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:45:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:45:17Z,use_quota=True,user_id='865715c2024e4e23840ee2e2cca79872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:45:17 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca2a4bc9-8a33-42d6-a518-6d0db3f319db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:45:17 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca2a4bc9-8a33-42d6-a518-6d0db3f319db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:45:17 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69b5b330-74c4-4d24-b652-ac666c5de982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:45:17 devstack cinder-volume[86873]: DEBUG cinder.image.glance [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] Creating Keystone auth plugin from conf {{(pid=86873) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 18:45:17 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb17ecc-cc8a-44f5-a620-a75bb5514aa3]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:45:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-db72532b-4086-438a-85cb-71ca84ed19c3 tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c52f8048-49c6-48dc-bce6-a631d3e3425c.5686407f-d5ae-4e2f-83c9-c25d04cffb6b {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:17 devstack sudo[97114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c52f8048-49c6-48dc-bce6-a631d3e3425c.5686407f-d5ae-4e2f-83c9-c25d04cffb6b Jul 08 18:45:17 devstack sudo[97114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:17 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69b5b330-74c4-4d24-b652-ac666c5de982) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f6df86b0-0d70-4340-9d8e-d96190fdea5a', 'volume_name': 'volume-f6df86b0-0d70-4340-9d8e-d96190fdea5a', 'volume_size': 1, 'image_id': '9af8b46e-3f06-4165-9812-4f0470d72624', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9af8b46e-3f06-4165-9812-4f0470d72624', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '14269f30917742408b75240392484938', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9af8b46e-3f06-4165-9812-4f0470d72624', 'created_at': datetime.datetime(2026, 7, 8, 16, 25, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 25, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9af8b46e-3f06-4165-9812-4f0470d72624/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:45:17 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a35e5d3-2ed2-4cc0-a672-47767b0e8852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:45:17 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a35e5d3-2ed2-4cc0-a672-47767b0e8852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:45:17 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2ffe29f-0d39-40f7-bcca-6cc745f2e39a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:45:17 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] Volume f6df86b0-0d70-4340-9d8e-d96190fdea5a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f6df86b0-0d70-4340-9d8e-d96190fdea5a', 'volume_size': 1, 'image_id': '9af8b46e-3f06-4165-9812-4f0470d72624', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9af8b46e-3f06-4165-9812-4f0470d72624', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '14269f30917742408b75240392484938', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9af8b46e-3f06-4165-9812-4f0470d72624', 'created_at': datetime.datetime(2026, 7, 8, 16, 25, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 25, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9af8b46e-3f06-4165-9812-4f0470d72624/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 18:45:17 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] Trying to clone f6df86b0-0d70-4340-9d8e-d96190fdea5a from image 9af8b46e-3f06-4165-9812-4f0470d72624 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9af8b46e-3f06-4165-9812-4f0470d72624', 'metadata': {}}]). {{(pid=86873) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 18:45:17 devstack cinder-volume[86873]: DEBUG cinder.image.image_utils [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9af8b46e-3f06-4165-9812-4f0470d72624_nfu5op2ldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86873) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 18:45:17 devstack cinder-volume[86873]: INFO cinder.image.image_utils [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] Image download 20.69 MB at 20.69 MB/s Jul 08 18:45:17 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6ef69b-96bf-4848-b9d0-e876c6eabe15]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:45:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9af8b46e-3f06-4165-9812-4f0470d72624_nfu5op2ldevstack@QuobyteHD {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:18 devstack sudo[97119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9af8b46e-3f06-4165-9812-4f0470d72624_nfu5op2ldevstack@QuobyteHD Jul 08 18:45:18 devstack sudo[97119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:18 devstack sudo[97114]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-db72532b-4086-438a-85cb-71ca84ed19c3 tempest-GroupSnapshotsTest-1187820760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c52f8048-49c6-48dc-bce6-a631d3e3425c.5686407f-d5ae-4e2f-83c9-c25d04cffb6b" returned: 0 in 0.804s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:18 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-db72532b-4086-438a-85cb-71ca84ed19c3 tempest-GroupSnapshotsTest-1187820760 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c52f8048-49c6-48dc-bce6-a631d3e3425c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:45:18 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[511e075f-d449-4876-87f4-4135fe754d4b]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:45:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-db72532b-4086-438a-85cb-71ca84ed19c3 tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c52f8048-49c6-48dc-bce6-a631d3e3425c {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:18 devstack sudo[97122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c52f8048-49c6-48dc-bce6-a631d3e3425c Jul 08 18:45:18 devstack sudo[97122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:18 devstack sudo[97119]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9af8b46e-3f06-4165-9812-4f0470d72624_nfu5op2ldevstack@QuobyteHD" returned: 0 in 0.732s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:18 devstack cinder-volume[86873]: DEBUG cinder.image.image_utils [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] Temporary image 9af8b46e-3f06-4165-9812-4f0470d72624 is fetched for user 865715c2024e4e23840ee2e2cca79872. {{(pid=86873) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 18:45:18 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[33530115-54cf-4be2-8487-a0f2eda73c6f]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:45:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9af8b46e-3f06-4165-9812-4f0470d72624_nfu5op2ldevstack@QuobyteHD {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:18 devstack sudo[97129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9af8b46e-3f06-4165-9812-4f0470d72624_nfu5op2ldevstack@QuobyteHD Jul 08 18:45:18 devstack sudo[97129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:18 devstack sudo[97122]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-db72532b-4086-438a-85cb-71ca84ed19c3 tempest-GroupSnapshotsTest-1187820760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c52f8048-49c6-48dc-bce6-a631d3e3425c" returned: 0 in 0.757s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-db72532b-4086-438a-85cb-71ca84ed19c3 tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c52f8048-49c6-48dc-bce6-a631d3e3425c.5686407f-d5ae-4e2f-83c9-c25d04cffb6b {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:18 devstack sudo[97133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c52f8048-49c6-48dc-bce6-a631d3e3425c.5686407f-d5ae-4e2f-83c9-c25d04cffb6b Jul 08 18:45:18 devstack sudo[97133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:19 devstack sudo[97129]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:19 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9af8b46e-3f06-4165-9812-4f0470d72624_nfu5op2ldevstack@QuobyteHD" returned: 0 in 0.713s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:19 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:45:19 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:45:19 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:45:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-826669377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6df86b0-0d70-4340-9d8e-d96190fdea5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09e61d3f5e644d9f9c271369f8712202',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:45:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:45:17Z,use_quota=True,user_id='865715c2024e4e23840ee2e2cca79872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:45:19 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] Creating volume f6df86b0-0d70-4340-9d8e-d96190fdea5a {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:45:19 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:45:19 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:45:19 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:45:19 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:45:19 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:45:19 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:45:19 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:45:19 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f6df86b0-0d70-4340-9d8e-d96190fdea5a 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:19 devstack sudo[97141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f6df86b0-0d70-4340-9d8e-d96190fdea5a 1073741824 Jul 08 18:45:19 devstack sudo[97141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:19 devstack sudo[97133]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:19 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-db72532b-4086-438a-85cb-71ca84ed19c3 tempest-GroupSnapshotsTest-1187820760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c52f8048-49c6-48dc-bce6-a631d3e3425c.5686407f-d5ae-4e2f-83c9-c25d04cffb6b" returned: 0 in 0.771s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:19 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-db72532b-4086-438a-85cb-71ca84ed19c3 tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c52f8048-49c6-48dc-bce6-a631d3e3425c.5686407f-d5ae-4e2f-83c9-c25d04cffb6b {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:19 devstack sudo[97143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c52f8048-49c6-48dc-bce6-a631d3e3425c.5686407f-d5ae-4e2f-83c9-c25d04cffb6b Jul 08 18:45:19 devstack sudo[97143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:20 devstack sudo[97141]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f6df86b0-0d70-4340-9d8e-d96190fdea5a 1073741824" returned: 0 in 0.835s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:20 devstack sudo[97143]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-db72532b-4086-438a-85cb-71ca84ed19c3 tempest-GroupSnapshotsTest-1187820760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c52f8048-49c6-48dc-bce6-a631d3e3425c.5686407f-d5ae-4e2f-83c9-c25d04cffb6b" returned: 0 in 0.671s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:20 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-db72532b-4086-438a-85cb-71ca84ed19c3 tempest-GroupSnapshotsTest-1187820760 None] Lock "cinder-quobyte-5686407f-d5ae-4e2f-83c9-c25d04cffb6b" released by "_delete_snapshot" :: held 3.131s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:45:20 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-db72532b-4086-438a-85cb-71ca84ed19c3 tempest-GroupSnapshotsTest-1187820760 None] Lock "cinder-quobyte-c52f8048-49c6-48dc-bce6-a631d3e3425c" released by "delete_snapshot" :: held 3.189s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:45:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f6df86b0-0d70-4340-9d8e-d96190fdea5a {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:20 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-db72532b-4086-438a-85cb-71ca84ed19c3 tempest-GroupSnapshotsTest-1187820760 None] Acquiring lock "cinder-quobyte-7c2ecde7-c63d-46d3-bd20-debfcb38de58" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:45:20 devstack sudo[97149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f6df86b0-0d70-4340-9d8e-d96190fdea5a Jul 08 18:45:20 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-db72532b-4086-438a-85cb-71ca84ed19c3 tempest-GroupSnapshotsTest-1187820760 None] Lock "cinder-quobyte-7c2ecde7-c63d-46d3-bd20-debfcb38de58" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:45:20 devstack sudo[97149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:20 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-db72532b-4086-438a-85cb-71ca84ed19c3 tempest-GroupSnapshotsTest-1187820760 None] Acquiring lock "cinder-quobyte-d404ea60-3ffb-4683-81c4-af7afedc8ec1" by "_delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:45:20 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-db72532b-4086-438a-85cb-71ca84ed19c3 tempest-GroupSnapshotsTest-1187820760 None] Lock "cinder-quobyte-d404ea60-3ffb-4683-81c4-af7afedc8ec1" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:45:20 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-db72532b-4086-438a-85cb-71ca84ed19c3 tempest-GroupSnapshotsTest-1187820760 None] Deleting offline snapshot d404ea60-3ffb-4683-81c4-af7afedc8ec1 of volume 7c2ecde7-c63d-46d3-bd20-debfcb38de58 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:45:20 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-db72532b-4086-438a-85cb-71ca84ed19c3 tempest-GroupSnapshotsTest-1187820760 None] snapshot_file for this snap is: volume-7c2ecde7-c63d-46d3-bd20-debfcb38de58.d404ea60-3ffb-4683-81c4-af7afedc8ec1 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:45:20 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54df6c3-3d79-40ca-8622-7b7a3b8d81e2]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:45:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-db72532b-4086-438a-85cb-71ca84ed19c3 tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7c2ecde7-c63d-46d3-bd20-debfcb38de58.d404ea60-3ffb-4683-81c4-af7afedc8ec1 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:20 devstack sudo[97151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7c2ecde7-c63d-46d3-bd20-debfcb38de58.d404ea60-3ffb-4683-81c4-af7afedc8ec1 Jul 08 18:45:20 devstack sudo[97151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:21 devstack sudo[97149]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f6df86b0-0d70-4340-9d8e-d96190fdea5a" returned: 0 in 0.678s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:21 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] <== create_volume: return (1589ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:45:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.593s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:45:21 devstack cinder-volume[86873]: DEBUG cinder.volume.volume_utils [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] Attempting download of 9af8b46e-3f06-4165-9812-4f0470d72624 ((None, [{'url': 'file:///opt/stack/data/glance/images/9af8b46e-3f06-4165-9812-4f0470d72624', 'metadata': {}}])) to volume f6df86b0-0d70-4340-9d8e-d96190fdea5a. {{(pid=86873) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 18:45:21 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b72396d-681b-48eb-a6a7-2d980be9e4b7]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:45:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9af8b46e-3f06-4165-9812-4f0470d72624_2tmbinrw {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:21 devstack sudo[97151]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-db72532b-4086-438a-85cb-71ca84ed19c3 tempest-GroupSnapshotsTest-1187820760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7c2ecde7-c63d-46d3-bd20-debfcb38de58.d404ea60-3ffb-4683-81c4-af7afedc8ec1" returned: 0 in 0.750s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:21 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-db72532b-4086-438a-85cb-71ca84ed19c3 tempest-GroupSnapshotsTest-1187820760 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c2ecde7-c63d-46d3-bd20-debfcb38de58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:45:21 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e8be38-b62a-46a0-8803-83df97a136b5]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:45:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-db72532b-4086-438a-85cb-71ca84ed19c3 tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7c2ecde7-c63d-46d3-bd20-debfcb38de58 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:21 devstack sudo[97158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9af8b46e-3f06-4165-9812-4f0470d72624_2tmbinrw Jul 08 18:45:21 devstack sudo[97158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:21 devstack sudo[97159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7c2ecde7-c63d-46d3-bd20-debfcb38de58 Jul 08 18:45:21 devstack sudo[97159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:21 devstack sudo[97158]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9af8b46e-3f06-4165-9812-4f0470d72624_2tmbinrw" returned: 0 in 0.751s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9af8b46e-3f06-4165-9812-4f0470d72624_2tmbinrw {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:21 devstack sudo[97159]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-db72532b-4086-438a-85cb-71ca84ed19c3 tempest-GroupSnapshotsTest-1187820760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7c2ecde7-c63d-46d3-bd20-debfcb38de58" returned: 0 in 0.748s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-db72532b-4086-438a-85cb-71ca84ed19c3 tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7c2ecde7-c63d-46d3-bd20-debfcb38de58.d404ea60-3ffb-4683-81c4-af7afedc8ec1 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:21 devstack sudo[97167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9af8b46e-3f06-4165-9812-4f0470d72624_2tmbinrw Jul 08 18:45:21 devstack sudo[97167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:21 devstack sudo[97168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7c2ecde7-c63d-46d3-bd20-debfcb38de58.d404ea60-3ffb-4683-81c4-af7afedc8ec1 Jul 08 18:45:21 devstack sudo[97168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:22 devstack sudo[97167]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9af8b46e-3f06-4165-9812-4f0470d72624_2tmbinrw" returned: 1 in 0.742s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9af8b46e-3f06-4165-9812-4f0470d72624_2tmbinrw' failed. Not Retrying. {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:45:22 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d49695-a9ca-4c7c-83ef-70817170ac93]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:45:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9af8b46e-3f06-4165-9812-4f0470d72624_nfu5op2ldevstack@QuobyteHD {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:22 devstack sudo[97168]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-db72532b-4086-438a-85cb-71ca84ed19c3 tempest-GroupSnapshotsTest-1187820760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7c2ecde7-c63d-46d3-bd20-debfcb38de58.d404ea60-3ffb-4683-81c4-af7afedc8ec1" returned: 0 in 0.745s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-db72532b-4086-438a-85cb-71ca84ed19c3 tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7c2ecde7-c63d-46d3-bd20-debfcb38de58.d404ea60-3ffb-4683-81c4-af7afedc8ec1 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:22 devstack sudo[97177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9af8b46e-3f06-4165-9812-4f0470d72624_nfu5op2ldevstack@QuobyteHD Jul 08 18:45:22 devstack sudo[97177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:22 devstack sudo[97178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7c2ecde7-c63d-46d3-bd20-debfcb38de58.d404ea60-3ffb-4683-81c4-af7afedc8ec1 Jul 08 18:45:22 devstack sudo[97178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:23 devstack sudo[97177]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9af8b46e-3f06-4165-9812-4f0470d72624_nfu5op2ldevstack@QuobyteHD" returned: 0 in 0.729s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:23 devstack cinder-volume[86873]: DEBUG cinder.image.image_utils [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] 9af8b46e-3f06-4165-9812-4f0470d72624 was qcow2, converting to raw {{(pid=86873) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 18:45:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9af8b46e-3f06-4165-9812-4f0470d72624_nfu5op2ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f6df86b0-0d70-4340-9d8e-d96190fdea5a {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:23 devstack sudo[97185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9af8b46e-3f06-4165-9812-4f0470d72624_nfu5op2ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f6df86b0-0d70-4340-9d8e-d96190fdea5a Jul 08 18:45:23 devstack sudo[97185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:23 devstack sudo[97178]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-db72532b-4086-438a-85cb-71ca84ed19c3 tempest-GroupSnapshotsTest-1187820760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7c2ecde7-c63d-46d3-bd20-debfcb38de58.d404ea60-3ffb-4683-81c4-af7afedc8ec1" returned: 0 in 0.699s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:23 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-db72532b-4086-438a-85cb-71ca84ed19c3 tempest-GroupSnapshotsTest-1187820760 None] Lock "cinder-quobyte-d404ea60-3ffb-4683-81c4-af7afedc8ec1" released by "_delete_snapshot" :: held 3.042s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:45:23 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-db72532b-4086-438a-85cb-71ca84ed19c3 tempest-GroupSnapshotsTest-1187820760 None] Lock "cinder-quobyte-7c2ecde7-c63d-46d3-bd20-debfcb38de58" released by "delete_snapshot" :: held 3.066s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:45:23 devstack cinder-volume[86873]: WARNING cinder.quota [None req-db72532b-4086-438a-85cb-71ca84ed19c3 tempest-GroupSnapshotsTest-1187820760 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-974772047 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-974772047, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:45:23 devstack cinder-volume[86873]: WARNING cinder.quota [None req-db72532b-4086-438a-85cb-71ca84ed19c3 tempest-GroupSnapshotsTest-1187820760 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-974772047 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-974772047, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:45:23 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-db72532b-4086-438a-85cb-71ca84ed19c3 tempest-GroupSnapshotsTest-1187820760 None] Created reservations ['13d9f9eb-b2b3-46db-95ab-d11e257eb9b1', 'db6283b7-031a-4b58-a049-c96cc1dbbb60', 'e99a3618-d8a8-4024-aa33-3dafce8fdca2', '22214120-f1ca-4423-b931-55d9827a96d4'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:45:23 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-db72532b-4086-438a-85cb-71ca84ed19c3 tempest-GroupSnapshotsTest-1187820760 None] Created reservations ['50528145-39da-4171-a6c3-16a8eeac7b70', 'e0d47190-0f9d-4282-a961-904e9f71be27', 'b62aec22-1605-4077-85e5-6570f931ec5b', 'c056cf5b-b2e0-4597-8ac4-4470e750db07'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:45:23 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-db72532b-4086-438a-85cb-71ca84ed19c3 tempest-GroupSnapshotsTest-1187820760 None] group_snapshot 11b1eaaa-ab74-4774-aad9-69796bc80400: deleted successfully Jul 08 18:45:25 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6fee3270-0367-44b3-9258-1ef6edd7915c tempest-GroupSnapshotsTest-1187820760 None] Acquiring lock "cinder-quobyte-7c2ecde7-c63d-46d3-bd20-debfcb38de58" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:45:25 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6fee3270-0367-44b3-9258-1ef6edd7915c tempest-GroupSnapshotsTest-1187820760 None] Lock "cinder-quobyte-7c2ecde7-c63d-46d3-bd20-debfcb38de58" acquired by "delete_volume" :: waited 0.020s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:45:25 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d41d62-cf77-4d85-8633-3ddbd963dd4e]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:45:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6fee3270-0367-44b3-9258-1ef6edd7915c tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7c2ecde7-c63d-46d3-bd20-debfcb38de58 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:25 devstack sudo[97185]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9af8b46e-3f06-4165-9812-4f0470d72624_nfu5op2ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f6df86b0-0d70-4340-9d8e-d96190fdea5a" returned: 0 in 1.901s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:25 devstack cinder-volume[86873]: DEBUG cinder.image.image_utils [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9af8b46e-3f06-4165-9812-4f0470d72624_nfu5op2ldevstack@QuobyteHD, size 112.00 MB, duration 1.90 sec, destination /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f6df86b0-0d70-4340-9d8e-d96190fdea5a {{(pid=86873) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:45:25 devstack cinder-volume[86873]: INFO cinder.image.image_utils [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] Converted 112.00 MB image at 58.89 MB/s Jul 08 18:45:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f6df86b0-0d70-4340-9d8e-d96190fdea5a 1G {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:25 devstack sudo[97196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7c2ecde7-c63d-46d3-bd20-debfcb38de58 Jul 08 18:45:25 devstack sudo[97196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:25 devstack sudo[97197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f6df86b0-0d70-4340-9d8e-d96190fdea5a 1G Jul 08 18:45:25 devstack sudo[97197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:25 devstack sudo[97196]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6fee3270-0367-44b3-9258-1ef6edd7915c tempest-GroupSnapshotsTest-1187820760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7c2ecde7-c63d-46d3-bd20-debfcb38de58" returned: 0 in 0.762s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6fee3270-0367-44b3-9258-1ef6edd7915c tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7c2ecde7-c63d-46d3-bd20-debfcb38de58 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:25 devstack sudo[97197]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:25 devstack sudo[97207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7c2ecde7-c63d-46d3-bd20-debfcb38de58 Jul 08 18:45:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f6df86b0-0d70-4340-9d8e-d96190fdea5a 1G" returned: 0 in 0.703s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:25 devstack sudo[97207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:26 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2ecc0d-a8a8-4bda-a91b-5dc416a1cfc5]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:45:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f6df86b0-0d70-4340-9d8e-d96190fdea5a {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:26 devstack sudo[97209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f6df86b0-0d70-4340-9d8e-d96190fdea5a Jul 08 18:45:26 devstack sudo[97209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:26 devstack sudo[97207]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6fee3270-0367-44b3-9258-1ef6edd7915c tempest-GroupSnapshotsTest-1187820760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7c2ecde7-c63d-46d3-bd20-debfcb38de58" returned: 0 in 0.643s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:26 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6fee3270-0367-44b3-9258-1ef6edd7915c tempest-GroupSnapshotsTest-1187820760 None] Lock "cinder-quobyte-7c2ecde7-c63d-46d3-bd20-debfcb38de58" released by "delete_volume" :: held 1.470s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:45:26 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6fee3270-0367-44b3-9258-1ef6edd7915c tempest-GroupSnapshotsTest-1187820760 None] Acquiring lock "cinder-quobyte-c52f8048-49c6-48dc-bce6-a631d3e3425c" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:45:26 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6fee3270-0367-44b3-9258-1ef6edd7915c tempest-GroupSnapshotsTest-1187820760 None] Lock "cinder-quobyte-c52f8048-49c6-48dc-bce6-a631d3e3425c" acquired by "delete_volume" :: waited 0.012s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:45:26 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[945e9fb9-232e-41f6-a8df-1a21ced9bb9e]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:45:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6fee3270-0367-44b3-9258-1ef6edd7915c tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c52f8048-49c6-48dc-bce6-a631d3e3425c {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:26 devstack sudo[97209]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f6df86b0-0d70-4340-9d8e-d96190fdea5a" returned: 0 in 0.770s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f6df86b0-0d70-4340-9d8e-d96190fdea5a {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:26 devstack sudo[97214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c52f8048-49c6-48dc-bce6-a631d3e3425c Jul 08 18:45:26 devstack sudo[97214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:26 devstack sudo[97216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f6df86b0-0d70-4340-9d8e-d96190fdea5a Jul 08 18:45:26 devstack sudo[97216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:27 devstack sudo[97214]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6fee3270-0367-44b3-9258-1ef6edd7915c tempest-GroupSnapshotsTest-1187820760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c52f8048-49c6-48dc-bce6-a631d3e3425c" returned: 0 in 0.807s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6fee3270-0367-44b3-9258-1ef6edd7915c tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c52f8048-49c6-48dc-bce6-a631d3e3425c {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:27 devstack sudo[97224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c52f8048-49c6-48dc-bce6-a631d3e3425c Jul 08 18:45:27 devstack sudo[97224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:27 devstack sudo[97216]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f6df86b0-0d70-4340-9d8e-d96190fdea5a" returned: 1 in 0.798s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f6df86b0-0d70-4340-9d8e-d96190fdea5a' failed. Not Retrying. {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:45:27 devstack cinder-volume[86873]: DEBUG cinder.volume.volume_utils [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] Downloaded image 9af8b46e-3f06-4165-9812-4f0470d72624 ((None, [{'url': 'file:///opt/stack/data/glance/images/9af8b46e-3f06-4165-9812-4f0470d72624', 'metadata': {}}])) to volume f6df86b0-0d70-4340-9d8e-d96190fdea5a successfully. {{(pid=86873) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 18:45:27 devstack cinder-volume[86873]: DEBUG cinder.image.image_utils [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] Temporary image 9af8b46e-3f06-4165-9812-4f0470d72624 for user 865715c2024e4e23840ee2e2cca79872 is deleted. {{(pid=86873) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 18:45:27 devstack cinder-volume[86873]: DEBUG cinder.volume.volume_utils [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] Marking volume f6df86b0-0d70-4340-9d8e-d96190fdea5a as bootable. {{(pid=86873) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 18:45:27 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] Copying metadata from image 9af8b46e-3f06-4165-9812-4f0470d72624 to f6df86b0-0d70-4340-9d8e-d96190fdea5a. {{(pid=86873) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 18:45:27 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] Creating volume glance metadata for volume f6df86b0-0d70-4340-9d8e-d96190fdea5a backed by image 9af8b46e-3f06-4165-9812-4f0470d72624 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9af8b46e-3f06-4165-9812-4f0470d72624', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86873) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 18:45:27 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2ffe29f-0d39-40f7-bcca-6cc745f2e39a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6df86b0-0d70-4340-9d8e-d96190fdea5a', 'volume_size': 1, 'image_id': '9af8b46e-3f06-4165-9812-4f0470d72624', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9af8b46e-3f06-4165-9812-4f0470d72624', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '14269f30917742408b75240392484938', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9af8b46e-3f06-4165-9812-4f0470d72624', 'created_at': datetime.datetime(2026, 7, 8, 16, 25, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 25, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9af8b46e-3f06-4165-9812-4f0470d72624/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:45:27 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eadd6ee-2e2a-4770-9597-4ad2199ea8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:45:27 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] Volume volume-f6df86b0-0d70-4340-9d8e-d96190fdea5a (f6df86b0-0d70-4340-9d8e-d96190fdea5a): created successfully Jul 08 18:45:27 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eadd6ee-2e2a-4770-9597-4ad2199ea8c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:45:27 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] Flow 'volume_create_manager' (81d8fef5-90ba-445e-bca2-c26fbe83865d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:45:27 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-1f5d6948-6045-4cd5-8ba9-26edfdca8460 tempest-VolumesExtendTest-1228408462 None] Created volume successfully. Jul 08 18:45:28 devstack sudo[97224]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6fee3270-0367-44b3-9258-1ef6edd7915c tempest-GroupSnapshotsTest-1187820760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c52f8048-49c6-48dc-bce6-a631d3e3425c" returned: 0 in 0.679s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:28 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6fee3270-0367-44b3-9258-1ef6edd7915c tempest-GroupSnapshotsTest-1187820760 None] Lock "cinder-quobyte-c52f8048-49c6-48dc-bce6-a631d3e3425c" released by "delete_volume" :: held 1.547s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:45:28 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-6fee3270-0367-44b3-9258-1ef6edd7915c tempest-GroupSnapshotsTest-1187820760 None] Created reservations ['7bdb7328-600d-4e9e-875b-fa52ff7fa8ca'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:45:28 devstack cinder-volume[86873]: WARNING cinder.quota [None req-6fee3270-0367-44b3-9258-1ef6edd7915c tempest-GroupSnapshotsTest-1187820760 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-974772047 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-974772047, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:45:28 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-6fee3270-0367-44b3-9258-1ef6edd7915c tempest-GroupSnapshotsTest-1187820760 None] Created reservations ['c79748e8-b828-4f4d-ac2d-d006fc6e5cba', '8584858d-df30-4f24-9819-fae4e1bf4ed1', 'aad9a602-50ba-4c9f-bd63-da3347eb5faf', 'ad51b0b7-74cf-48bb-95d1-8f7c620d9e8a'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:45:28 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-6fee3270-0367-44b3-9258-1ef6edd7915c tempest-GroupSnapshotsTest-1187820760 None] Created reservations ['25632c1b-a245-4455-bd53-51772b93d5e9', '5f73fbda-1467-434a-9220-625489c8c984', '1c8d94e4-ec63-4b7c-bd34-3f39b8987b38', '38f9077d-1b08-4f5c-945b-63c2dd1cfb9b'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:45:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6fee3270-0367-44b3-9258-1ef6edd7915c tempest-GroupSnapshotsTest-1187820760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:45:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6fee3270-0367-44b3-9258-1ef6edd7915c tempest-GroupSnapshotsTest-1187820760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:45:28 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-6fee3270-0367-44b3-9258-1ef6edd7915c tempest-GroupSnapshotsTest-1187820760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:45:28 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-6fee3270-0367-44b3-9258-1ef6edd7915c tempest-GroupSnapshotsTest-1187820760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:45:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6fee3270-0367-44b3-9258-1ef6edd7915c tempest-GroupSnapshotsTest-1187820760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:45:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6fee3270-0367-44b3-9258-1ef6edd7915c tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:28 devstack sudo[97227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:45:28 devstack sudo[97227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-7d847900-6820-466c-bb39-e7a0b6aa0cda tempest-VolumesExtendTest-1228408462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:45:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-7d847900-6820-466c-bb39-e7a0b6aa0cda tempest-VolumesExtendTest-1228408462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:45:29 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[307a646f-b922-44cb-ac1c-88f30b41b3cb]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:45:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-7d847900-6820-466c-bb39-e7a0b6aa0cda tempest-VolumesExtendTest-1228408462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f6df86b0-0d70-4340-9d8e-d96190fdea5a {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:29 devstack sudo[97227]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:29 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-fad79a87-e78f-414e-bf0a-ab29ea68ecc7 tempest-GroupSnapshotsTest-1187820760 None] Group tempest-GroupSnapshotsTest-Group-344969297: creating Jul 08 18:45:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6fee3270-0367-44b3-9258-1ef6edd7915c tempest-GroupSnapshotsTest-1187820760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.719s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:29 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-6fee3270-0367-44b3-9258-1ef6edd7915c tempest-GroupSnapshotsTest-1187820760 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:45:29 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-6fee3270-0367-44b3-9258-1ef6edd7915c tempest-GroupSnapshotsTest-1187820760 None] Delete group completed successfully. Jul 08 18:45:29 devstack sudo[97230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f6df86b0-0d70-4340-9d8e-d96190fdea5a Jul 08 18:45:29 devstack sudo[97230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:29 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-fad79a87-e78f-414e-bf0a-ab29ea68ecc7 tempest-GroupSnapshotsTest-1187820760 None] Group tempest-GroupSnapshotsTest-Group-344969297: created successfully Jul 08 18:45:29 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-fad79a87-e78f-414e-bf0a-ab29ea68ecc7 tempest-GroupSnapshotsTest-1187820760 None] Create group completed successfully. Jul 08 18:45:29 devstack sudo[97230]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-7d847900-6820-466c-bb39-e7a0b6aa0cda tempest-VolumesExtendTest-1228408462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f6df86b0-0d70-4340-9d8e-d96190fdea5a" returned: 0 in 0.767s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-7d847900-6820-466c-bb39-e7a0b6aa0cda tempest-VolumesExtendTest-1228408462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f6df86b0-0d70-4340-9d8e-d96190fdea5a {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:29 devstack sudo[97234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f6df86b0-0d70-4340-9d8e-d96190fdea5a Jul 08 18:45:29 devstack sudo[97234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:30 devstack sudo[97234]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-7d847900-6820-466c-bb39-e7a0b6aa0cda tempest-VolumesExtendTest-1228408462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f6df86b0-0d70-4340-9d8e-d96190fdea5a" returned: 1 in 0.781s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-7d847900-6820-466c-bb39-e7a0b6aa0cda tempest-VolumesExtendTest-1228408462 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f6df86b0-0d70-4340-9d8e-d96190fdea5a' failed. Not Retrying. {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:45:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-7d847900-6820-466c-bb39-e7a0b6aa0cda tempest-VolumesExtendTest-1228408462 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f6df86b0-0d70-4340-9d8e-d96190fdea5a 2G {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-7d847900-6820-466c-bb39-e7a0b6aa0cda tempest-VolumesExtendTest-1228408462 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f6df86b0-0d70-4340-9d8e-d96190fdea5a 2G" returned: 0 in 0.091s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-7d847900-6820-466c-bb39-e7a0b6aa0cda tempest-VolumesExtendTest-1228408462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.701s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:45:30 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-7d847900-6820-466c-bb39-e7a0b6aa0cda tempest-VolumesExtendTest-1228408462 None] Extend volume completed successfully. Jul 08 18:45:30 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-0aee97a6-7fd3-49cd-bcc2-3821a6ab1a61 tempest-GroupSnapshotsTest-1187820760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:45:30 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-0aee97a6-7fd3-49cd-bcc2-3821a6ab1a61 tempest-GroupSnapshotsTest-1187820760 None] Flow 'volume_create_manager' (5545a91f-384b-41b2-a200-b8b780c9c75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:45:30 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-0aee97a6-7fd3-49cd-bcc2-3821a6ab1a61 tempest-GroupSnapshotsTest-1187820760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e6f8fe9-b2d8-4d2c-9923-e55dad2a63b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:45:30 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-0aee97a6-7fd3-49cd-bcc2-3821a6ab1a61 tempest-GroupSnapshotsTest-1187820760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e6f8fe9-b2d8-4d2c-9923-e55dad2a63b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:45:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-701138622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=46b799f2-fbda-4d83-b5cc-e298df4eae2d,host='devstack@QuobyteHD#QuobyteHD',id=2c7c32fb-a983-48eb-acff-d72ac7cebb52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c35e7af23bf148a78ff51789ffe3ca73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:45:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:45:31Z,use_quota=True,user_id='0adf784786744c4d8f6d6bb06f2f20fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cd9c2d57-adc0-4ec9-ad5b-98a7be0ed5f1),volume_type_id=cd9c2d57-adc0-4ec9-ad5b-98a7be0ed5f1)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:45:30 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-0aee97a6-7fd3-49cd-bcc2-3821a6ab1a61 tempest-GroupSnapshotsTest-1187820760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9d14236-eb14-4473-81ea-e44efd60340b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:45:30 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-0aee97a6-7fd3-49cd-bcc2-3821a6ab1a61 tempest-GroupSnapshotsTest-1187820760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9d14236-eb14-4473-81ea-e44efd60340b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:45:30 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-0aee97a6-7fd3-49cd-bcc2-3821a6ab1a61 tempest-GroupSnapshotsTest-1187820760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adf8029a-94a2-4270-8584-28f427743097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:45:30 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-0aee97a6-7fd3-49cd-bcc2-3821a6ab1a61 tempest-GroupSnapshotsTest-1187820760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adf8029a-94a2-4270-8584-28f427743097) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c7c32fb-a983-48eb-acff-d72ac7cebb52', 'volume_name': 'volume-2c7c32fb-a983-48eb-acff-d72ac7cebb52', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:45:30 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-0aee97a6-7fd3-49cd-bcc2-3821a6ab1a61 tempest-GroupSnapshotsTest-1187820760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f77de09-ec89-47a4-bc19-4fbb43356829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:45:30 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-0aee97a6-7fd3-49cd-bcc2-3821a6ab1a61 tempest-GroupSnapshotsTest-1187820760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f77de09-ec89-47a4-bc19-4fbb43356829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:45:30 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-0aee97a6-7fd3-49cd-bcc2-3821a6ab1a61 tempest-GroupSnapshotsTest-1187820760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (662cebff-d367-43e0-b036-626318eda6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:45:30 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-0aee97a6-7fd3-49cd-bcc2-3821a6ab1a61 tempest-GroupSnapshotsTest-1187820760 None] Volume 2c7c32fb-a983-48eb-acff-d72ac7cebb52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c7c32fb-a983-48eb-acff-d72ac7cebb52', 'volume_size': 1} Jul 08 18:45:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-0aee97a6-7fd3-49cd-bcc2-3821a6ab1a61 tempest-GroupSnapshotsTest-1187820760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:45:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-0aee97a6-7fd3-49cd-bcc2-3821a6ab1a61 tempest-GroupSnapshotsTest-1187820760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:45:30 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-0aee97a6-7fd3-49cd-bcc2-3821a6ab1a61 tempest-GroupSnapshotsTest-1187820760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=46b799f2-fbda-4d83-b5cc-e298df4eae2d,created_at=2026-07-08T16:45:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-701138622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=46b799f2-fbda-4d83-b5cc-e298df4eae2d,host='devstack@QuobyteHD#QuobyteHD',id=2c7c32fb-a983-48eb-acff-d72ac7cebb52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c35e7af23bf148a78ff51789ffe3ca73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:45:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:45:31Z,use_quota=True,user_id='0adf784786744c4d8f6d6bb06f2f20fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cd9c2d57-adc0-4ec9-ad5b-98a7be0ed5f1),volume_type_id=cd9c2d57-adc0-4ec9-ad5b-98a7be0ed5f1)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:45:30 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-0aee97a6-7fd3-49cd-bcc2-3821a6ab1a61 tempest-GroupSnapshotsTest-1187820760 None] Creating volume 2c7c32fb-a983-48eb-acff-d72ac7cebb52 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:45:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-0aee97a6-7fd3-49cd-bcc2-3821a6ab1a61 tempest-GroupSnapshotsTest-1187820760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:45:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-0aee97a6-7fd3-49cd-bcc2-3821a6ab1a61 tempest-GroupSnapshotsTest-1187820760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:45:30 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-0aee97a6-7fd3-49cd-bcc2-3821a6ab1a61 tempest-GroupSnapshotsTest-1187820760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:45:30 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-0aee97a6-7fd3-49cd-bcc2-3821a6ab1a61 tempest-GroupSnapshotsTest-1187820760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:45:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-0aee97a6-7fd3-49cd-bcc2-3821a6ab1a61 tempest-GroupSnapshotsTest-1187820760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:45:30 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-0aee97a6-7fd3-49cd-bcc2-3821a6ab1a61 tempest-GroupSnapshotsTest-1187820760 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:45:30 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-0aee97a6-7fd3-49cd-bcc2-3821a6ab1a61 tempest-GroupSnapshotsTest-1187820760 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:45:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-0aee97a6-7fd3-49cd-bcc2-3821a6ab1a61 tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2c7c32fb-a983-48eb-acff-d72ac7cebb52 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:30 devstack sudo[97242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2c7c32fb-a983-48eb-acff-d72ac7cebb52 1073741824 Jul 08 18:45:30 devstack sudo[97242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:31 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ecd1b87b-12ed-451d-a546-d0546721e1f8 tempest-VolumesExtendTest-1228408462 None] Acquiring lock "cinder-f6df86b0-0d70-4340-9d8e-d96190fdea5a-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:45:31 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ecd1b87b-12ed-451d-a546-d0546721e1f8 tempest-VolumesExtendTest-1228408462 None] Lock "cinder-f6df86b0-0d70-4340-9d8e-d96190fdea5a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:45:31 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ecd1b87b-12ed-451d-a546-d0546721e1f8 tempest-VolumesExtendTest-1228408462 None] Acquiring lock "cinder-quobyte-f6df86b0-0d70-4340-9d8e-d96190fdea5a" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:45:31 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ecd1b87b-12ed-451d-a546-d0546721e1f8 tempest-VolumesExtendTest-1228408462 None] Lock "cinder-quobyte-f6df86b0-0d70-4340-9d8e-d96190fdea5a" acquired by "delete_volume" :: waited 0.015s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:45:31 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3f8928-de8d-4480-a329-fec6b16d82a3]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:45:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ecd1b87b-12ed-451d-a546-d0546721e1f8 tempest-VolumesExtendTest-1228408462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f6df86b0-0d70-4340-9d8e-d96190fdea5a {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:31 devstack sudo[97247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f6df86b0-0d70-4340-9d8e-d96190fdea5a Jul 08 18:45:31 devstack sudo[97247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:31 devstack sudo[97242]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-0aee97a6-7fd3-49cd-bcc2-3821a6ab1a61 tempest-GroupSnapshotsTest-1187820760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2c7c32fb-a983-48eb-acff-d72ac7cebb52 1073741824" returned: 0 in 0.830s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-0aee97a6-7fd3-49cd-bcc2-3821a6ab1a61 tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2c7c32fb-a983-48eb-acff-d72ac7cebb52 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:31 devstack sudo[97249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2c7c32fb-a983-48eb-acff-d72ac7cebb52 Jul 08 18:45:31 devstack sudo[97249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:32 devstack sudo[97247]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:32 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ecd1b87b-12ed-451d-a546-d0546721e1f8 tempest-VolumesExtendTest-1228408462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f6df86b0-0d70-4340-9d8e-d96190fdea5a" returned: 0 in 0.818s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:32 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ecd1b87b-12ed-451d-a546-d0546721e1f8 tempest-VolumesExtendTest-1228408462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f6df86b0-0d70-4340-9d8e-d96190fdea5a {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:32 devstack sudo[97254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f6df86b0-0d70-4340-9d8e-d96190fdea5a Jul 08 18:45:32 devstack sudo[97254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:32 devstack sudo[97249]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:32 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-0aee97a6-7fd3-49cd-bcc2-3821a6ab1a61 tempest-GroupSnapshotsTest-1187820760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2c7c32fb-a983-48eb-acff-d72ac7cebb52" returned: 0 in 0.710s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:32 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-0aee97a6-7fd3-49cd-bcc2-3821a6ab1a61 tempest-GroupSnapshotsTest-1187820760 None] <== create_volume: return (1590ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:45:32 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-0aee97a6-7fd3-49cd-bcc2-3821a6ab1a61 tempest-GroupSnapshotsTest-1187820760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.592s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:45:32 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-0aee97a6-7fd3-49cd-bcc2-3821a6ab1a61 tempest-GroupSnapshotsTest-1187820760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (662cebff-d367-43e0-b036-626318eda6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c7c32fb-a983-48eb-acff-d72ac7cebb52', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:45:32 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-0aee97a6-7fd3-49cd-bcc2-3821a6ab1a61 tempest-GroupSnapshotsTest-1187820760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8998661d-a204-4eb9-8ca1-f3a5548beec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:45:32 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-0aee97a6-7fd3-49cd-bcc2-3821a6ab1a61 tempest-GroupSnapshotsTest-1187820760 None] Volume volume-2c7c32fb-a983-48eb-acff-d72ac7cebb52 (2c7c32fb-a983-48eb-acff-d72ac7cebb52): created successfully Jul 08 18:45:32 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-0aee97a6-7fd3-49cd-bcc2-3821a6ab1a61 tempest-GroupSnapshotsTest-1187820760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8998661d-a204-4eb9-8ca1-f3a5548beec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:45:32 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-0aee97a6-7fd3-49cd-bcc2-3821a6ab1a61 tempest-GroupSnapshotsTest-1187820760 None] Flow 'volume_create_manager' (5545a91f-384b-41b2-a200-b8b780c9c75f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:45:32 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-0aee97a6-7fd3-49cd-bcc2-3821a6ab1a61 tempest-GroupSnapshotsTest-1187820760 None] Created volume successfully. Jul 08 18:45:33 devstack sudo[97254]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ecd1b87b-12ed-451d-a546-d0546721e1f8 tempest-VolumesExtendTest-1228408462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f6df86b0-0d70-4340-9d8e-d96190fdea5a" returned: 1 in 0.779s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ecd1b87b-12ed-451d-a546-d0546721e1f8 tempest-VolumesExtendTest-1228408462 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f6df86b0-0d70-4340-9d8e-d96190fdea5a' failed. Not Retrying. {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:45:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ecd1b87b-12ed-451d-a546-d0546721e1f8 tempest-VolumesExtendTest-1228408462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f6df86b0-0d70-4340-9d8e-d96190fdea5a {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:33 devstack sudo[97260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f6df86b0-0d70-4340-9d8e-d96190fdea5a Jul 08 18:45:33 devstack sudo[97260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:33 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-8a56559e-2be2-43ae-a996-6daf72a949f4 tempest-GroupSnapshotsTest-1187820760 None] GroupSnapshot 8a14c80f-b46a-449b-9f7f-916fa0ae2ac1: creating. Jul 08 18:45:33 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-8a56559e-2be2-43ae-a996-6daf72a949f4 tempest-GroupSnapshotsTest-1187820760 None] Group snapshot 8a14c80f-b46a-449b-9f7f-916fa0ae2ac1: creating. {{(pid=86873) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 08 18:45:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-8a56559e-2be2-43ae-a996-6daf72a949f4 tempest-GroupSnapshotsTest-1187820760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:45:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-8a56559e-2be2-43ae-a996-6daf72a949f4 tempest-GroupSnapshotsTest-1187820760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:45:33 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-8a56559e-2be2-43ae-a996-6daf72a949f4 tempest-GroupSnapshotsTest-1187820760 None] Creating offline snapshot 498cdc91-69c4-4279-ad66-c76244c25ab2 of volume 2c7c32fb-a983-48eb-acff-d72ac7cebb52 {{(pid=86873) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:45:33 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d6ab82-00d6-4908-b6dd-b6660613a931]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:45:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8a56559e-2be2-43ae-a996-6daf72a949f4 tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2c7c32fb-a983-48eb-acff-d72ac7cebb52 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:33 devstack sudo[97262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2c7c32fb-a983-48eb-acff-d72ac7cebb52 Jul 08 18:45:33 devstack sudo[97262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:33 devstack sudo[97260]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ecd1b87b-12ed-451d-a546-d0546721e1f8 tempest-VolumesExtendTest-1228408462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f6df86b0-0d70-4340-9d8e-d96190fdea5a" returned: 0 in 0.659s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:33 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ecd1b87b-12ed-451d-a546-d0546721e1f8 tempest-VolumesExtendTest-1228408462 None] Lock "cinder-quobyte-f6df86b0-0d70-4340-9d8e-d96190fdea5a" released by "delete_volume" :: held 2.328s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:45:33 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-ecd1b87b-12ed-451d-a546-d0546721e1f8 tempest-VolumesExtendTest-1228408462 None] Created reservations ['c2a880da-0da6-411f-85d1-6755670a4922', '6a6e03e5-7771-4e9f-8c1b-d4f8ce53675d', 'fafab35e-077e-4975-bbf4-5c58f2642b17', '5d2e1aab-ce57-4658-941d-8b81673b92aa'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:45:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-ecd1b87b-12ed-451d-a546-d0546721e1f8 tempest-VolumesExtendTest-1228408462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:45:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-ecd1b87b-12ed-451d-a546-d0546721e1f8 tempest-VolumesExtendTest-1228408462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:45:33 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-ecd1b87b-12ed-451d-a546-d0546721e1f8 tempest-VolumesExtendTest-1228408462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:45:33 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-ecd1b87b-12ed-451d-a546-d0546721e1f8 tempest-VolumesExtendTest-1228408462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:45:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-ecd1b87b-12ed-451d-a546-d0546721e1f8 tempest-VolumesExtendTest-1228408462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:45:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ecd1b87b-12ed-451d-a546-d0546721e1f8 tempest-VolumesExtendTest-1228408462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:33 devstack sudo[97265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:45:33 devstack sudo[97265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:34 devstack sudo[97262]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8a56559e-2be2-43ae-a996-6daf72a949f4 tempest-GroupSnapshotsTest-1187820760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2c7c32fb-a983-48eb-acff-d72ac7cebb52" returned: 0 in 0.811s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8a56559e-2be2-43ae-a996-6daf72a949f4 tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2c7c32fb-a983-48eb-acff-d72ac7cebb52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2c7c32fb-a983-48eb-acff-d72ac7cebb52.498cdc91-69c4-4279-ad66-c76244c25ab2 1G {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:34 devstack sudo[97270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2c7c32fb-a983-48eb-acff-d72ac7cebb52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2c7c32fb-a983-48eb-acff-d72ac7cebb52.498cdc91-69c4-4279-ad66-c76244c25ab2 1G Jul 08 18:45:34 devstack sudo[97270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:34 devstack sudo[97265]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ecd1b87b-12ed-451d-a546-d0546721e1f8 tempest-VolumesExtendTest-1228408462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.709s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:34 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-ecd1b87b-12ed-451d-a546-d0546721e1f8 tempest-VolumesExtendTest-1228408462 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:45:34 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-ecd1b87b-12ed-451d-a546-d0546721e1f8 tempest-VolumesExtendTest-1228408462 None] Deleted volume successfully. Jul 08 18:45:34 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ecd1b87b-12ed-451d-a546-d0546721e1f8 tempest-VolumesExtendTest-1228408462 None] Lock "cinder-f6df86b0-0d70-4340-9d8e-d96190fdea5a-delete_volume" released by "delete_volume" :: held 3.250s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:45:35 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a83b161-c657-47a6-9348-2f3aa2b6a0fc tempest-VolumesExtendTest-1228408462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:45:35 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-9a83b161-c657-47a6-9348-2f3aa2b6a0fc tempest-VolumesExtendTest-1228408462 None] Flow 'volume_create_manager' (abd813a8-08b7-4b0d-b418-74fd0cf8c1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:45:35 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-9a83b161-c657-47a6-9348-2f3aa2b6a0fc tempest-VolumesExtendTest-1228408462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c22e8ad-3dde-4bed-8093-b8cfbb8768c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:45:35 devstack sudo[97270]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8a56559e-2be2-43ae-a996-6daf72a949f4 tempest-GroupSnapshotsTest-1187820760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2c7c32fb-a983-48eb-acff-d72ac7cebb52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2c7c32fb-a983-48eb-acff-d72ac7cebb52.498cdc91-69c4-4279-ad66-c76244c25ab2 1G" returned: 0 in 0.964s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8a56559e-2be2-43ae-a996-6daf72a949f4 tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c7c32fb-a983-48eb-acff-d72ac7cebb52 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2c7c32fb-a983-48eb-acff-d72ac7cebb52.498cdc91-69c4-4279-ad66-c76244c25ab2 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:35 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-9a83b161-c657-47a6-9348-2f3aa2b6a0fc tempest-VolumesExtendTest-1228408462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c22e8ad-3dde-4bed-8093-b8cfbb8768c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:45:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1673452088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1fd8fee-1130-4cc5-a739-f5215698b1f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09e61d3f5e644d9f9c271369f8712202',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:45:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:45:35Z,use_quota=True,user_id='865715c2024e4e23840ee2e2cca79872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:45:35 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-9a83b161-c657-47a6-9348-2f3aa2b6a0fc tempest-VolumesExtendTest-1228408462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f7e595e-4b97-46a9-a763-333fc95652e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:45:35 devstack sudo[97277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c7c32fb-a983-48eb-acff-d72ac7cebb52 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2c7c32fb-a983-48eb-acff-d72ac7cebb52.498cdc91-69c4-4279-ad66-c76244c25ab2 Jul 08 18:45:35 devstack sudo[97277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:35 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-9a83b161-c657-47a6-9348-2f3aa2b6a0fc tempest-VolumesExtendTest-1228408462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f7e595e-4b97-46a9-a763-333fc95652e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:45:35 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-9a83b161-c657-47a6-9348-2f3aa2b6a0fc tempest-VolumesExtendTest-1228408462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37345018-f2f0-4afc-8de5-d1f287bd97ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:45:35 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-9a83b161-c657-47a6-9348-2f3aa2b6a0fc tempest-VolumesExtendTest-1228408462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37345018-f2f0-4afc-8de5-d1f287bd97ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1fd8fee-1130-4cc5-a739-f5215698b1f0', 'volume_name': 'volume-d1fd8fee-1130-4cc5-a739-f5215698b1f0', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:45:35 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-9a83b161-c657-47a6-9348-2f3aa2b6a0fc tempest-VolumesExtendTest-1228408462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4df4582-251f-4167-a259-44c7dc4108ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:45:35 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-9a83b161-c657-47a6-9348-2f3aa2b6a0fc tempest-VolumesExtendTest-1228408462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4df4582-251f-4167-a259-44c7dc4108ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:45:35 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-9a83b161-c657-47a6-9348-2f3aa2b6a0fc tempest-VolumesExtendTest-1228408462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82932495-f735-4836-83c3-672a852e73b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:45:35 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-9a83b161-c657-47a6-9348-2f3aa2b6a0fc tempest-VolumesExtendTest-1228408462 None] Volume d1fd8fee-1130-4cc5-a739-f5215698b1f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1fd8fee-1130-4cc5-a739-f5215698b1f0', 'volume_size': 1} Jul 08 18:45:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-9a83b161-c657-47a6-9348-2f3aa2b6a0fc tempest-VolumesExtendTest-1228408462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:45:35 devstack sudo[97277]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8a56559e-2be2-43ae-a996-6daf72a949f4 tempest-GroupSnapshotsTest-1187820760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c7c32fb-a983-48eb-acff-d72ac7cebb52 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2c7c32fb-a983-48eb-acff-d72ac7cebb52.498cdc91-69c4-4279-ad66-c76244c25ab2" returned: 0 in 0.696s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:35 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-8a56559e-2be2-43ae-a996-6daf72a949f4 tempest-GroupSnapshotsTest-1187820760 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2c7c32fb-a983-48eb-acff-d72ac7cebb52.498cdc91-69c4-4279-ad66-c76244c25ab2 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 18:45:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8a56559e-2be2-43ae-a996-6daf72a949f4 tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2c7c32fb-a983-48eb-acff-d72ac7cebb52.498cdc91-69c4-4279-ad66-c76244c25ab2 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:35 devstack sudo[97282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2c7c32fb-a983-48eb-acff-d72ac7cebb52.498cdc91-69c4-4279-ad66-c76244c25ab2 Jul 08 18:45:35 devstack sudo[97282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:36 devstack sudo[97282]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8a56559e-2be2-43ae-a996-6daf72a949f4 tempest-GroupSnapshotsTest-1187820760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2c7c32fb-a983-48eb-acff-d72ac7cebb52.498cdc91-69c4-4279-ad66-c76244c25ab2" returned: 0 in 0.655s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8a56559e-2be2-43ae-a996-6daf72a949f4 tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2c7c32fb-a983-48eb-acff-d72ac7cebb52.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:36 devstack sudo[97285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2c7c32fb-a983-48eb-acff-d72ac7cebb52.info Jul 08 18:45:36 devstack sudo[97285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:37 devstack sudo[97285]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8a56559e-2be2-43ae-a996-6daf72a949f4 tempest-GroupSnapshotsTest-1187820760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2c7c32fb-a983-48eb-acff-d72ac7cebb52.info" returned: 0 in 0.656s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:37 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-8a56559e-2be2-43ae-a996-6daf72a949f4 tempest-GroupSnapshotsTest-1187820760 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2c7c32fb-a983-48eb-acff-d72ac7cebb52.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 18:45:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8a56559e-2be2-43ae-a996-6daf72a949f4 tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2c7c32fb-a983-48eb-acff-d72ac7cebb52.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:37 devstack sudo[97288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2c7c32fb-a983-48eb-acff-d72ac7cebb52.info Jul 08 18:45:37 devstack sudo[97288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:37 devstack sudo[97288]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8a56559e-2be2-43ae-a996-6daf72a949f4 tempest-GroupSnapshotsTest-1187820760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2c7c32fb-a983-48eb-acff-d72ac7cebb52.info" returned: 0 in 0.651s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-8a56559e-2be2-43ae-a996-6daf72a949f4 tempest-GroupSnapshotsTest-1187820760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.513s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:45:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-9a83b161-c657-47a6-9348-2f3aa2b6a0fc tempest-VolumesExtendTest-1228408462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.650s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:45:37 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-9a83b161-c657-47a6-9348-2f3aa2b6a0fc tempest-VolumesExtendTest-1228408462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:45:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1673452088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1fd8fee-1130-4cc5-a739-f5215698b1f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09e61d3f5e644d9f9c271369f8712202',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:45:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:45:35Z,use_quota=True,user_id='865715c2024e4e23840ee2e2cca79872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:45:37 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-9a83b161-c657-47a6-9348-2f3aa2b6a0fc tempest-VolumesExtendTest-1228408462 None] Creating volume d1fd8fee-1130-4cc5-a739-f5215698b1f0 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:45:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-9a83b161-c657-47a6-9348-2f3aa2b6a0fc tempest-VolumesExtendTest-1228408462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:45:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-9a83b161-c657-47a6-9348-2f3aa2b6a0fc tempest-VolumesExtendTest-1228408462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:45:37 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-9a83b161-c657-47a6-9348-2f3aa2b6a0fc tempest-VolumesExtendTest-1228408462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:45:37 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-9a83b161-c657-47a6-9348-2f3aa2b6a0fc tempest-VolumesExtendTest-1228408462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:45:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-9a83b161-c657-47a6-9348-2f3aa2b6a0fc tempest-VolumesExtendTest-1228408462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:45:37 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-9a83b161-c657-47a6-9348-2f3aa2b6a0fc tempest-VolumesExtendTest-1228408462 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:45:37 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-9a83b161-c657-47a6-9348-2f3aa2b6a0fc tempest-VolumesExtendTest-1228408462 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:45:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9a83b161-c657-47a6-9348-2f3aa2b6a0fc tempest-VolumesExtendTest-1228408462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d1fd8fee-1130-4cc5-a739-f5215698b1f0 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:37 devstack sudo[97291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d1fd8fee-1130-4cc5-a739-f5215698b1f0 1073741824 Jul 08 18:45:37 devstack sudo[97291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:38 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-8a56559e-2be2-43ae-a996-6daf72a949f4 tempest-GroupSnapshotsTest-1187820760 None] group_snapshot 8a14c80f-b46a-449b-9f7f-916fa0ae2ac1: created successfully Jul 08 18:45:38 devstack sudo[97291]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:38 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-06ab4b7a-5c61-4ad9-b272-255e59854d06 tempest-GroupSnapshotsTest-1187820760 None] group_snapshot 8a14c80f-b46a-449b-9f7f-916fa0ae2ac1: deleting Jul 08 18:45:38 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9a83b161-c657-47a6-9348-2f3aa2b6a0fc tempest-VolumesExtendTest-1228408462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d1fd8fee-1130-4cc5-a739-f5215698b1f0 1073741824" returned: 0 in 0.859s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:38 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-06ab4b7a-5c61-4ad9-b272-255e59854d06 tempest-GroupSnapshotsTest-1187820760 None] group_snapshot 8a14c80f-b46a-449b-9f7f-916fa0ae2ac1: deleting {{(pid=86873) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 08 18:45:38 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9a83b161-c657-47a6-9348-2f3aa2b6a0fc tempest-VolumesExtendTest-1228408462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d1fd8fee-1130-4cc5-a739-f5215698b1f0 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:38 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-06ab4b7a-5c61-4ad9-b272-255e59854d06 tempest-GroupSnapshotsTest-1187820760 None] Acquiring lock "cinder-quobyte-2c7c32fb-a983-48eb-acff-d72ac7cebb52" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:45:38 devstack sudo[97297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d1fd8fee-1130-4cc5-a739-f5215698b1f0 Jul 08 18:45:38 devstack sudo[97297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:38 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-06ab4b7a-5c61-4ad9-b272-255e59854d06 tempest-GroupSnapshotsTest-1187820760 None] Lock "cinder-quobyte-2c7c32fb-a983-48eb-acff-d72ac7cebb52" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:45:38 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-06ab4b7a-5c61-4ad9-b272-255e59854d06 tempest-GroupSnapshotsTest-1187820760 None] Acquiring lock "cinder-quobyte-498cdc91-69c4-4279-ad66-c76244c25ab2" by "_delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:45:38 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-06ab4b7a-5c61-4ad9-b272-255e59854d06 tempest-GroupSnapshotsTest-1187820760 None] Lock "cinder-quobyte-498cdc91-69c4-4279-ad66-c76244c25ab2" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:45:38 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-06ab4b7a-5c61-4ad9-b272-255e59854d06 tempest-GroupSnapshotsTest-1187820760 None] Deleting offline snapshot 498cdc91-69c4-4279-ad66-c76244c25ab2 of volume 2c7c32fb-a983-48eb-acff-d72ac7cebb52 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:45:38 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-06ab4b7a-5c61-4ad9-b272-255e59854d06 tempest-GroupSnapshotsTest-1187820760 None] snapshot_file for this snap is: volume-2c7c32fb-a983-48eb-acff-d72ac7cebb52.498cdc91-69c4-4279-ad66-c76244c25ab2 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:45:38 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff236a1f-81ca-435a-b78c-e1608c681661]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:45:38 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-06ab4b7a-5c61-4ad9-b272-255e59854d06 tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2c7c32fb-a983-48eb-acff-d72ac7cebb52.498cdc91-69c4-4279-ad66-c76244c25ab2 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:39 devstack sudo[97299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2c7c32fb-a983-48eb-acff-d72ac7cebb52.498cdc91-69c4-4279-ad66-c76244c25ab2 Jul 08 18:45:39 devstack sudo[97299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:39 devstack sudo[97297]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:39 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9a83b161-c657-47a6-9348-2f3aa2b6a0fc tempest-VolumesExtendTest-1228408462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d1fd8fee-1130-4cc5-a739-f5215698b1f0" returned: 0 in 0.693s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:39 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-9a83b161-c657-47a6-9348-2f3aa2b6a0fc tempest-VolumesExtendTest-1228408462 None] <== create_volume: return (1612ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:45:39 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-9a83b161-c657-47a6-9348-2f3aa2b6a0fc tempest-VolumesExtendTest-1228408462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.616s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:45:39 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-9a83b161-c657-47a6-9348-2f3aa2b6a0fc tempest-VolumesExtendTest-1228408462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82932495-f735-4836-83c3-672a852e73b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1fd8fee-1130-4cc5-a739-f5215698b1f0', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:45:39 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-9a83b161-c657-47a6-9348-2f3aa2b6a0fc tempest-VolumesExtendTest-1228408462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48ecef55-4edb-4650-977f-3e5d8507801f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:45:39 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-9a83b161-c657-47a6-9348-2f3aa2b6a0fc tempest-VolumesExtendTest-1228408462 None] Volume volume-d1fd8fee-1130-4cc5-a739-f5215698b1f0 (d1fd8fee-1130-4cc5-a739-f5215698b1f0): created successfully Jul 08 18:45:39 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-9a83b161-c657-47a6-9348-2f3aa2b6a0fc tempest-VolumesExtendTest-1228408462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48ecef55-4edb-4650-977f-3e5d8507801f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:45:39 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-9a83b161-c657-47a6-9348-2f3aa2b6a0fc tempest-VolumesExtendTest-1228408462 None] Flow 'volume_create_manager' (abd813a8-08b7-4b0d-b418-74fd0cf8c1e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:45:39 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-9a83b161-c657-47a6-9348-2f3aa2b6a0fc tempest-VolumesExtendTest-1228408462 None] Created volume successfully. Jul 08 18:45:39 devstack sudo[97299]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:39 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-06ab4b7a-5c61-4ad9-b272-255e59854d06 tempest-GroupSnapshotsTest-1187820760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2c7c32fb-a983-48eb-acff-d72ac7cebb52.498cdc91-69c4-4279-ad66-c76244c25ab2" returned: 0 in 0.782s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:39 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-06ab4b7a-5c61-4ad9-b272-255e59854d06 tempest-GroupSnapshotsTest-1187820760 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c7c32fb-a983-48eb-acff-d72ac7cebb52(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:45:39 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a9f172-4690-4c25-928b-1003bd1fec4d]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:45:39 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-06ab4b7a-5c61-4ad9-b272-255e59854d06 tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2c7c32fb-a983-48eb-acff-d72ac7cebb52 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:39 devstack sudo[97305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2c7c32fb-a983-48eb-acff-d72ac7cebb52 Jul 08 18:45:39 devstack sudo[97305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:40 devstack sudo[97305]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-06ab4b7a-5c61-4ad9-b272-255e59854d06 tempest-GroupSnapshotsTest-1187820760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2c7c32fb-a983-48eb-acff-d72ac7cebb52" returned: 0 in 0.777s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-06ab4b7a-5c61-4ad9-b272-255e59854d06 tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2c7c32fb-a983-48eb-acff-d72ac7cebb52.498cdc91-69c4-4279-ad66-c76244c25ab2 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:40 devstack sudo[97310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2c7c32fb-a983-48eb-acff-d72ac7cebb52.498cdc91-69c4-4279-ad66-c76244c25ab2 Jul 08 18:45:40 devstack sudo[97310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c82af378-3d87-4dce-bbb8-dbb7e897b67f tempest-VolumesExtendTest-1228408462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:45:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c82af378-3d87-4dce-bbb8-dbb7e897b67f tempest-VolumesExtendTest-1228408462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:45:40 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-c82af378-3d87-4dce-bbb8-dbb7e897b67f tempest-VolumesExtendTest-1228408462 None] Creating offline snapshot 95372e23-0858-42a0-ac9a-852b19861596 of volume d1fd8fee-1130-4cc5-a739-f5215698b1f0 {{(pid=86873) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:45:40 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82c4a1e-544f-436b-bb94-ba71e46dd7f1]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:45:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c82af378-3d87-4dce-bbb8-dbb7e897b67f tempest-VolumesExtendTest-1228408462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d1fd8fee-1130-4cc5-a739-f5215698b1f0 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:40 devstack sudo[97312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d1fd8fee-1130-4cc5-a739-f5215698b1f0 Jul 08 18:45:40 devstack sudo[97312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:41 devstack sudo[97310]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-06ab4b7a-5c61-4ad9-b272-255e59854d06 tempest-GroupSnapshotsTest-1187820760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2c7c32fb-a983-48eb-acff-d72ac7cebb52.498cdc91-69c4-4279-ad66-c76244c25ab2" returned: 0 in 0.739s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-06ab4b7a-5c61-4ad9-b272-255e59854d06 tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2c7c32fb-a983-48eb-acff-d72ac7cebb52.498cdc91-69c4-4279-ad66-c76244c25ab2 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:41 devstack sudo[97317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2c7c32fb-a983-48eb-acff-d72ac7cebb52.498cdc91-69c4-4279-ad66-c76244c25ab2 Jul 08 18:45:41 devstack sudo[97317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:41 devstack sudo[97312]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c82af378-3d87-4dce-bbb8-dbb7e897b67f tempest-VolumesExtendTest-1228408462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d1fd8fee-1130-4cc5-a739-f5215698b1f0" returned: 0 in 0.813s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c82af378-3d87-4dce-bbb8-dbb7e897b67f tempest-VolumesExtendTest-1228408462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d1fd8fee-1130-4cc5-a739-f5215698b1f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d1fd8fee-1130-4cc5-a739-f5215698b1f0.95372e23-0858-42a0-ac9a-852b19861596 1G {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:41 devstack sudo[97322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d1fd8fee-1130-4cc5-a739-f5215698b1f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d1fd8fee-1130-4cc5-a739-f5215698b1f0.95372e23-0858-42a0-ac9a-852b19861596 1G Jul 08 18:45:41 devstack sudo[97322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:41 devstack sudo[97317]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-06ab4b7a-5c61-4ad9-b272-255e59854d06 tempest-GroupSnapshotsTest-1187820760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2c7c32fb-a983-48eb-acff-d72ac7cebb52.498cdc91-69c4-4279-ad66-c76244c25ab2" returned: 0 in 0.699s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:42 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-06ab4b7a-5c61-4ad9-b272-255e59854d06 tempest-GroupSnapshotsTest-1187820760 None] Lock "cinder-quobyte-498cdc91-69c4-4279-ad66-c76244c25ab2" released by "_delete_snapshot" :: held 3.097s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:45:42 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-06ab4b7a-5c61-4ad9-b272-255e59854d06 tempest-GroupSnapshotsTest-1187820760 None] Lock "cinder-quobyte-2c7c32fb-a983-48eb-acff-d72ac7cebb52" released by "delete_snapshot" :: held 3.126s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:45:42 devstack cinder-volume[86873]: WARNING cinder.quota [None req-06ab4b7a-5c61-4ad9-b272-255e59854d06 tempest-GroupSnapshotsTest-1187820760 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1878922788 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1878922788, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:45:42 devstack cinder-volume[86873]: WARNING cinder.quota [None req-06ab4b7a-5c61-4ad9-b272-255e59854d06 tempest-GroupSnapshotsTest-1187820760 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1878922788 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1878922788, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:45:42 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-06ab4b7a-5c61-4ad9-b272-255e59854d06 tempest-GroupSnapshotsTest-1187820760 None] Created reservations ['e5ea2101-4165-41a3-8328-0d4bf5416a56', '66836936-ee7c-43df-a3c2-19b5f710361a', '692887b8-73a7-4e5b-9b12-0c802d981cbf', '4f97cb71-8a69-4a06-8a06-d7dad4fd0097'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:45:42 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-06ab4b7a-5c61-4ad9-b272-255e59854d06 tempest-GroupSnapshotsTest-1187820760 None] group_snapshot 8a14c80f-b46a-449b-9f7f-916fa0ae2ac1: deleted successfully Jul 08 18:45:42 devstack sudo[97322]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c82af378-3d87-4dce-bbb8-dbb7e897b67f tempest-VolumesExtendTest-1228408462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d1fd8fee-1130-4cc5-a739-f5215698b1f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d1fd8fee-1130-4cc5-a739-f5215698b1f0.95372e23-0858-42a0-ac9a-852b19861596 1G" returned: 0 in 0.829s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c82af378-3d87-4dce-bbb8-dbb7e897b67f tempest-VolumesExtendTest-1228408462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1fd8fee-1130-4cc5-a739-f5215698b1f0 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d1fd8fee-1130-4cc5-a739-f5215698b1f0.95372e23-0858-42a0-ac9a-852b19861596 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:42 devstack sudo[97330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1fd8fee-1130-4cc5-a739-f5215698b1f0 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d1fd8fee-1130-4cc5-a739-f5215698b1f0.95372e23-0858-42a0-ac9a-852b19861596 Jul 08 18:45:42 devstack sudo[97330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:43 devstack sudo[97330]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c82af378-3d87-4dce-bbb8-dbb7e897b67f tempest-VolumesExtendTest-1228408462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1fd8fee-1130-4cc5-a739-f5215698b1f0 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d1fd8fee-1130-4cc5-a739-f5215698b1f0.95372e23-0858-42a0-ac9a-852b19861596" returned: 0 in 0.690s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:43 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-c82af378-3d87-4dce-bbb8-dbb7e897b67f tempest-VolumesExtendTest-1228408462 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d1fd8fee-1130-4cc5-a739-f5215698b1f0.95372e23-0858-42a0-ac9a-852b19861596 is being set with open permissions: ugo+rw Jul 08 18:45:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c82af378-3d87-4dce-bbb8-dbb7e897b67f tempest-VolumesExtendTest-1228408462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d1fd8fee-1130-4cc5-a739-f5215698b1f0.95372e23-0858-42a0-ac9a-852b19861596 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:43 devstack sudo[97335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d1fd8fee-1130-4cc5-a739-f5215698b1f0.95372e23-0858-42a0-ac9a-852b19861596 Jul 08 18:45:43 devstack sudo[97335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:43 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-885f7340-79c1-4594-86bc-fdb1828ce829 tempest-GroupSnapshotsTest-1187820760 None] Acquiring lock "cinder-quobyte-2c7c32fb-a983-48eb-acff-d72ac7cebb52" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:45:43 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-885f7340-79c1-4594-86bc-fdb1828ce829 tempest-GroupSnapshotsTest-1187820760 None] Lock "cinder-quobyte-2c7c32fb-a983-48eb-acff-d72ac7cebb52" acquired by "delete_volume" :: waited 0.018s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:45:43 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbd7e43-bce7-4bcf-8d51-c6b4c0efb6c6]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:45:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-885f7340-79c1-4594-86bc-fdb1828ce829 tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2c7c32fb-a983-48eb-acff-d72ac7cebb52 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:43 devstack sudo[97337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2c7c32fb-a983-48eb-acff-d72ac7cebb52 Jul 08 18:45:43 devstack sudo[97337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:43 devstack sudo[97335]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c82af378-3d87-4dce-bbb8-dbb7e897b67f tempest-VolumesExtendTest-1228408462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d1fd8fee-1130-4cc5-a739-f5215698b1f0.95372e23-0858-42a0-ac9a-852b19861596" returned: 0 in 0.656s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c82af378-3d87-4dce-bbb8-dbb7e897b67f tempest-VolumesExtendTest-1228408462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d1fd8fee-1130-4cc5-a739-f5215698b1f0.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:43 devstack sudo[97340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d1fd8fee-1130-4cc5-a739-f5215698b1f0.info Jul 08 18:45:43 devstack sudo[97340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:44 devstack sudo[97337]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-885f7340-79c1-4594-86bc-fdb1828ce829 tempest-GroupSnapshotsTest-1187820760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2c7c32fb-a983-48eb-acff-d72ac7cebb52" returned: 0 in 0.810s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-885f7340-79c1-4594-86bc-fdb1828ce829 tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2c7c32fb-a983-48eb-acff-d72ac7cebb52 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:44 devstack sudo[97346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2c7c32fb-a983-48eb-acff-d72ac7cebb52 Jul 08 18:45:44 devstack sudo[97346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:44 devstack sudo[97340]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c82af378-3d87-4dce-bbb8-dbb7e897b67f tempest-VolumesExtendTest-1228408462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d1fd8fee-1130-4cc5-a739-f5215698b1f0.info" returned: 0 in 0.669s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:44 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-c82af378-3d87-4dce-bbb8-dbb7e897b67f tempest-VolumesExtendTest-1228408462 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d1fd8fee-1130-4cc5-a739-f5215698b1f0.info is being set with open permissions: ugo+rw Jul 08 18:45:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c82af378-3d87-4dce-bbb8-dbb7e897b67f tempest-VolumesExtendTest-1228408462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d1fd8fee-1130-4cc5-a739-f5215698b1f0.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:44 devstack sudo[97348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d1fd8fee-1130-4cc5-a739-f5215698b1f0.info Jul 08 18:45:44 devstack sudo[97348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:45 devstack sudo[97346]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-885f7340-79c1-4594-86bc-fdb1828ce829 tempest-GroupSnapshotsTest-1187820760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2c7c32fb-a983-48eb-acff-d72ac7cebb52" returned: 0 in 0.669s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:45 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-885f7340-79c1-4594-86bc-fdb1828ce829 tempest-GroupSnapshotsTest-1187820760 None] Lock "cinder-quobyte-2c7c32fb-a983-48eb-acff-d72ac7cebb52" released by "delete_volume" :: held 1.538s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:45:45 devstack sudo[97348]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:45 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-885f7340-79c1-4594-86bc-fdb1828ce829 tempest-GroupSnapshotsTest-1187820760 None] Created reservations ['fa808060-7967-482b-8362-0c98aa80f778'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:45:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c82af378-3d87-4dce-bbb8-dbb7e897b67f tempest-VolumesExtendTest-1228408462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d1fd8fee-1130-4cc5-a739-f5215698b1f0.info" returned: 0 in 0.729s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c82af378-3d87-4dce-bbb8-dbb7e897b67f tempest-VolumesExtendTest-1228408462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.481s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:45:45 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-c82af378-3d87-4dce-bbb8-dbb7e897b67f tempest-VolumesExtendTest-1228408462 None] Create snapshot completed successfully Jul 08 18:45:45 devstack cinder-volume[86873]: WARNING cinder.quota [None req-885f7340-79c1-4594-86bc-fdb1828ce829 tempest-GroupSnapshotsTest-1187820760 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1878922788 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1878922788, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:45:45 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-885f7340-79c1-4594-86bc-fdb1828ce829 tempest-GroupSnapshotsTest-1187820760 None] Created reservations ['a318a868-03de-4c0d-bcf9-d34ac47c877f', 'ebd10c05-9e9e-45c1-abe9-c3bd2abacded', '0957ae3c-00a8-4c3c-abca-777e58ddfe15', '21ebf65f-c9f5-4bfd-8857-acb839812f6e'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:45:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-885f7340-79c1-4594-86bc-fdb1828ce829 tempest-GroupSnapshotsTest-1187820760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:45:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-885f7340-79c1-4594-86bc-fdb1828ce829 tempest-GroupSnapshotsTest-1187820760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:45:45 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-885f7340-79c1-4594-86bc-fdb1828ce829 tempest-GroupSnapshotsTest-1187820760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:45:45 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-885f7340-79c1-4594-86bc-fdb1828ce829 tempest-GroupSnapshotsTest-1187820760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:45:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-885f7340-79c1-4594-86bc-fdb1828ce829 tempest-GroupSnapshotsTest-1187820760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:45:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-885f7340-79c1-4594-86bc-fdb1828ce829 tempest-GroupSnapshotsTest-1187820760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:45 devstack sudo[97352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:45:45 devstack sudo[97352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:45 devstack sudo[97352]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-885f7340-79c1-4594-86bc-fdb1828ce829 tempest-GroupSnapshotsTest-1187820760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.696s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:46 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-885f7340-79c1-4594-86bc-fdb1828ce829 tempest-GroupSnapshotsTest-1187820760 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:45:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-00c40212-cf4b-46e9-b9dd-b4e93c3a5716 tempest-VolumesExtendTest-1228408462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:45:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-00c40212-cf4b-46e9-b9dd-b4e93c3a5716 tempest-VolumesExtendTest-1228408462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:45:46 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-885f7340-79c1-4594-86bc-fdb1828ce829 tempest-GroupSnapshotsTest-1187820760 None] Delete group completed successfully. Jul 08 18:45:46 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d9bf07-601d-4368-bfdd-4624d9e59078]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:45:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-00c40212-cf4b-46e9-b9dd-b4e93c3a5716 tempest-VolumesExtendTest-1228408462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d1fd8fee-1130-4cc5-a739-f5215698b1f0 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:46 devstack sudo[97355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d1fd8fee-1130-4cc5-a739-f5215698b1f0 Jul 08 18:45:46 devstack sudo[97355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:46 devstack sudo[97355]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-00c40212-cf4b-46e9-b9dd-b4e93c3a5716 tempest-VolumesExtendTest-1228408462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d1fd8fee-1130-4cc5-a739-f5215698b1f0" returned: 0 in 0.885s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-00c40212-cf4b-46e9-b9dd-b4e93c3a5716 tempest-VolumesExtendTest-1228408462 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d1fd8fee-1130-4cc5-a739-f5215698b1f0.95372e23-0858-42a0-ac9a-852b19861596 2G {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-00c40212-cf4b-46e9-b9dd-b4e93c3a5716 tempest-VolumesExtendTest-1228408462 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d1fd8fee-1130-4cc5-a739-f5215698b1f0.95372e23-0858-42a0-ac9a-852b19861596 2G" returned: 0 in 0.169s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-00c40212-cf4b-46e9-b9dd-b4e93c3a5716 tempest-VolumesExtendTest-1228408462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.088s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:45:47 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:UPDATE=92,cinder:SELECT=108,cinder:INSERT=28,cinder:DELETE=1 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:45:47 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:SELECT=86,cinder:INSERT=27,cinder:UPDATE=94,cinder:DELETE=6 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:45:47 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-00c40212-cf4b-46e9-b9dd-b4e93c3a5716 tempest-VolumesExtendTest-1228408462 None] Extend volume completed successfully. Jul 08 18:45:48 devstack cinder-volume[86873]: DEBUG oslo_service.periodic_task [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86873) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:45:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:45:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:45:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:45:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:45:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:45:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:48 devstack sudo[97363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:45:48 devstack sudo[97363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:48 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-aaf09849-9dad-4336-8405-5284b92b984c tempest-VolumesExtendTest-1228408462 None] Acquiring lock "cinder-95372e23-0858-42a0-ac9a-852b19861596-delete_snapshot" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:45:48 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-aaf09849-9dad-4336-8405-5284b92b984c tempest-VolumesExtendTest-1228408462 None] Lock "cinder-95372e23-0858-42a0-ac9a-852b19861596-delete_snapshot" acquired by "delete_snapshot" :: waited 0.102s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:45:48 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-aaf09849-9dad-4336-8405-5284b92b984c tempest-VolumesExtendTest-1228408462 None] Acquiring lock "cinder-quobyte-d1fd8fee-1130-4cc5-a739-f5215698b1f0" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:45:48 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-aaf09849-9dad-4336-8405-5284b92b984c tempest-VolumesExtendTest-1228408462 None] Lock "cinder-quobyte-d1fd8fee-1130-4cc5-a739-f5215698b1f0" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:45:48 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-aaf09849-9dad-4336-8405-5284b92b984c tempest-VolumesExtendTest-1228408462 None] Acquiring lock "cinder-quobyte-95372e23-0858-42a0-ac9a-852b19861596" by "_delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:45:48 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-aaf09849-9dad-4336-8405-5284b92b984c tempest-VolumesExtendTest-1228408462 None] Lock "cinder-quobyte-95372e23-0858-42a0-ac9a-852b19861596" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:45:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-aaf09849-9dad-4336-8405-5284b92b984c tempest-VolumesExtendTest-1228408462 None] Deleting offline snapshot 95372e23-0858-42a0-ac9a-852b19861596 of volume d1fd8fee-1130-4cc5-a739-f5215698b1f0 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:45:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-aaf09849-9dad-4336-8405-5284b92b984c tempest-VolumesExtendTest-1228408462 None] snapshot_file for this snap is: volume-d1fd8fee-1130-4cc5-a739-f5215698b1f0.95372e23-0858-42a0-ac9a-852b19861596 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:45:48 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cfdee43-dc28-4b36-bb72-728ddba3a933]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:45:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-aaf09849-9dad-4336-8405-5284b92b984c tempest-VolumesExtendTest-1228408462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d1fd8fee-1130-4cc5-a739-f5215698b1f0.95372e23-0858-42a0-ac9a-852b19861596 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:48 devstack sudo[97365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d1fd8fee-1130-4cc5-a739-f5215698b1f0.95372e23-0858-42a0-ac9a-852b19861596 Jul 08 18:45:48 devstack sudo[97365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:48 devstack sudo[97363]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.698s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:48 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:45:48 devstack cinder-volume[86873]: DEBUG oslo_service.periodic_task [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running periodic task VolumeManager._thread_info {{(pid=86873) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:45:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] thread count: 29 {{(pid=86873) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:45:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] thread info: [<_MainThread(MainThread, started 138577734545536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86873) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:45:49 devstack sudo[97365]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-aaf09849-9dad-4336-8405-5284b92b984c tempest-VolumesExtendTest-1228408462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d1fd8fee-1130-4cc5-a739-f5215698b1f0.95372e23-0858-42a0-ac9a-852b19861596" returned: 0 in 0.818s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:49 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-aaf09849-9dad-4336-8405-5284b92b984c tempest-VolumesExtendTest-1228408462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1fd8fee-1130-4cc5-a739-f5215698b1f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:45:49 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[b847d467-bfe5-45c4-ae22-df6c64e06275]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:45:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-aaf09849-9dad-4336-8405-5284b92b984c tempest-VolumesExtendTest-1228408462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d1fd8fee-1130-4cc5-a739-f5215698b1f0 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:49 devstack sudo[97371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d1fd8fee-1130-4cc5-a739-f5215698b1f0 Jul 08 18:45:49 devstack sudo[97371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:50 devstack sudo[97371]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-aaf09849-9dad-4336-8405-5284b92b984c tempest-VolumesExtendTest-1228408462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d1fd8fee-1130-4cc5-a739-f5215698b1f0" returned: 0 in 0.783s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-aaf09849-9dad-4336-8405-5284b92b984c tempest-VolumesExtendTest-1228408462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d1fd8fee-1130-4cc5-a739-f5215698b1f0.95372e23-0858-42a0-ac9a-852b19861596 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:50 devstack sudo[97376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d1fd8fee-1130-4cc5-a739-f5215698b1f0.95372e23-0858-42a0-ac9a-852b19861596 Jul 08 18:45:50 devstack sudo[97376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:51 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-9b4056f6-642f-42f8-9d38-69cd9644f3ce tempest-GroupsTest-1311975393 None] Group tempest-Group1-142208090: creating Jul 08 18:45:51 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-9b4056f6-642f-42f8-9d38-69cd9644f3ce tempest-GroupsTest-1311975393 None] Group tempest-Group1-142208090: created successfully Jul 08 18:45:51 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-9b4056f6-642f-42f8-9d38-69cd9644f3ce tempest-GroupsTest-1311975393 None] Create group completed successfully. Jul 08 18:45:51 devstack sudo[97376]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-aaf09849-9dad-4336-8405-5284b92b984c tempest-VolumesExtendTest-1228408462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d1fd8fee-1130-4cc5-a739-f5215698b1f0.95372e23-0858-42a0-ac9a-852b19861596" returned: 0 in 0.914s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-aaf09849-9dad-4336-8405-5284b92b984c tempest-VolumesExtendTest-1228408462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d1fd8fee-1130-4cc5-a739-f5215698b1f0.95372e23-0858-42a0-ac9a-852b19861596 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:51 devstack sudo[97382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d1fd8fee-1130-4cc5-a739-f5215698b1f0.95372e23-0858-42a0-ac9a-852b19861596 Jul 08 18:45:51 devstack sudo[97382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:51 devstack sudo[97382]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-aaf09849-9dad-4336-8405-5284b92b984c tempest-VolumesExtendTest-1228408462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d1fd8fee-1130-4cc5-a739-f5215698b1f0.95372e23-0858-42a0-ac9a-852b19861596" returned: 0 in 0.634s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:51 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-aaf09849-9dad-4336-8405-5284b92b984c tempest-VolumesExtendTest-1228408462 None] Lock "cinder-quobyte-95372e23-0858-42a0-ac9a-852b19861596" released by "_delete_snapshot" :: held 3.269s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:45:51 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-aaf09849-9dad-4336-8405-5284b92b984c tempest-VolumesExtendTest-1228408462 None] Lock "cinder-quobyte-d1fd8fee-1130-4cc5-a739-f5215698b1f0" released by "delete_snapshot" :: held 3.295s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:45:51 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-aaf09849-9dad-4336-8405-5284b92b984c tempest-VolumesExtendTest-1228408462 None] Created reservations ['7d12eb93-621b-4d73-a2a0-1b8acd58f3f1', '436153ea-7a58-40c8-bcce-943c9569a462', '32f40d6d-3d1a-480b-8652-4c29287a7205', '3de9da83-d2ba-4ea7-b2d8-fafe10b30081'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:45:51 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-aaf09849-9dad-4336-8405-5284b92b984c tempest-VolumesExtendTest-1228408462 None] Delete snapshot completed successfully. Jul 08 18:45:51 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-aaf09849-9dad-4336-8405-5284b92b984c tempest-VolumesExtendTest-1228408462 None] Lock "cinder-95372e23-0858-42a0-ac9a-852b19861596-delete_snapshot" released by "delete_snapshot" :: held 3.431s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:45:52 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-5c4694b0-af0b-4cef-a531-fe7257489cd4 tempest-GroupsTest-1311975393 None] Group tempest-Group2-1065420160: creating Jul 08 18:45:52 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-5c4694b0-af0b-4cef-a531-fe7257489cd4 tempest-GroupsTest-1311975393 None] Group tempest-Group2-1065420160: created successfully Jul 08 18:45:52 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-5c4694b0-af0b-4cef-a531-fe7257489cd4 tempest-GroupsTest-1311975393 None] Create group completed successfully. Jul 08 18:45:52 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-97d2d3b9-3131-4e1a-9c75-4ce3e9df8e0b tempest-VolumesExtendTest-1228408462 None] Acquiring lock "cinder-d1fd8fee-1130-4cc5-a739-f5215698b1f0-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:45:52 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-97d2d3b9-3131-4e1a-9c75-4ce3e9df8e0b tempest-VolumesExtendTest-1228408462 None] Lock "cinder-d1fd8fee-1130-4cc5-a739-f5215698b1f0-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:45:52 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-97d2d3b9-3131-4e1a-9c75-4ce3e9df8e0b tempest-VolumesExtendTest-1228408462 None] Acquiring lock "cinder-quobyte-d1fd8fee-1130-4cc5-a739-f5215698b1f0" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:45:52 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-97d2d3b9-3131-4e1a-9c75-4ce3e9df8e0b tempest-VolumesExtendTest-1228408462 None] Lock "cinder-quobyte-d1fd8fee-1130-4cc5-a739-f5215698b1f0" acquired by "delete_volume" :: waited 0.015s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:45:52 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[11047173-be35-46c1-8203-05a483636244]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:45:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-97d2d3b9-3131-4e1a-9c75-4ce3e9df8e0b tempest-VolumesExtendTest-1228408462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d1fd8fee-1130-4cc5-a739-f5215698b1f0 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:52 devstack sudo[97386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d1fd8fee-1130-4cc5-a739-f5215698b1f0 Jul 08 18:45:52 devstack sudo[97386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:53 devstack sudo[97386]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:53 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-97d2d3b9-3131-4e1a-9c75-4ce3e9df8e0b tempest-VolumesExtendTest-1228408462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d1fd8fee-1130-4cc5-a739-f5215698b1f0" returned: 0 in 0.767s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:53 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-97d2d3b9-3131-4e1a-9c75-4ce3e9df8e0b tempest-VolumesExtendTest-1228408462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d1fd8fee-1130-4cc5-a739-f5215698b1f0 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:53 devstack sudo[97392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d1fd8fee-1130-4cc5-a739-f5215698b1f0 Jul 08 18:45:53 devstack sudo[97392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:53 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-56183f70-96a4-41d7-ba69-ca88652ed4e6 tempest-GroupsTest-1311975393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:45:53 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-56183f70-96a4-41d7-ba69-ca88652ed4e6 tempest-GroupsTest-1311975393 None] Flow 'volume_create_manager' (a6ff5940-b972-4c49-9ad9-9c3042a8e37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:45:53 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-56183f70-96a4-41d7-ba69-ca88652ed4e6 tempest-GroupsTest-1311975393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a76b5f31-47bb-461d-b0b9-401b70ea5324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:45:53 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-56183f70-96a4-41d7-ba69-ca88652ed4e6 tempest-GroupsTest-1311975393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a76b5f31-47bb-461d-b0b9-401b70ea5324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:45:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-967104959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d28bf668-8a43-4b96-af36-88a8da0f6be8,host='devstack@QuobyteHD#QuobyteHD',id=85b49f24-41aa-48b0-aebb-5692d3751e54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1d9e2f723d46a48e2b72a28a56cfa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:45:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:45:54Z,use_quota=True,user_id='7b03f29f01754a00943c35f41706e570',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(65c595ff-79c2-48d8-9c01-d3a3058cd773),volume_type_id=65c595ff-79c2-48d8-9c01-d3a3058cd773)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:45:53 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-56183f70-96a4-41d7-ba69-ca88652ed4e6 tempest-GroupsTest-1311975393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85954316-b89f-4c9a-ac50-11cd8ba6e662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:45:53 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-56183f70-96a4-41d7-ba69-ca88652ed4e6 tempest-GroupsTest-1311975393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85954316-b89f-4c9a-ac50-11cd8ba6e662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:45:53 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-56183f70-96a4-41d7-ba69-ca88652ed4e6 tempest-GroupsTest-1311975393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5cbf7e7-2b4f-4ebb-9bb8-59017dbd7486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:45:53 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-56183f70-96a4-41d7-ba69-ca88652ed4e6 tempest-GroupsTest-1311975393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5cbf7e7-2b4f-4ebb-9bb8-59017dbd7486) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85b49f24-41aa-48b0-aebb-5692d3751e54', 'volume_name': 'volume-85b49f24-41aa-48b0-aebb-5692d3751e54', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:45:54 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-56183f70-96a4-41d7-ba69-ca88652ed4e6 tempest-GroupsTest-1311975393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92a1efbf-a9a6-4b00-90f9-7e530956762e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:45:54 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-56183f70-96a4-41d7-ba69-ca88652ed4e6 tempest-GroupsTest-1311975393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92a1efbf-a9a6-4b00-90f9-7e530956762e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:45:54 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-56183f70-96a4-41d7-ba69-ca88652ed4e6 tempest-GroupsTest-1311975393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d06e5758-9698-4797-a6ba-ca4cf1eae745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:45:54 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-56183f70-96a4-41d7-ba69-ca88652ed4e6 tempest-GroupsTest-1311975393 None] Volume 85b49f24-41aa-48b0-aebb-5692d3751e54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85b49f24-41aa-48b0-aebb-5692d3751e54', 'volume_size': 1} Jul 08 18:45:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-56183f70-96a4-41d7-ba69-ca88652ed4e6 tempest-GroupsTest-1311975393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:45:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-56183f70-96a4-41d7-ba69-ca88652ed4e6 tempest-GroupsTest-1311975393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:45:54 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-56183f70-96a4-41d7-ba69-ca88652ed4e6 tempest-GroupsTest-1311975393 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d28bf668-8a43-4b96-af36-88a8da0f6be8,created_at=2026-07-08T16:45:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-967104959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d28bf668-8a43-4b96-af36-88a8da0f6be8,host='devstack@QuobyteHD#QuobyteHD',id=85b49f24-41aa-48b0-aebb-5692d3751e54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1d9e2f723d46a48e2b72a28a56cfa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:45:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:45:54Z,use_quota=True,user_id='7b03f29f01754a00943c35f41706e570',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(65c595ff-79c2-48d8-9c01-d3a3058cd773),volume_type_id=65c595ff-79c2-48d8-9c01-d3a3058cd773)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:45:54 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-56183f70-96a4-41d7-ba69-ca88652ed4e6 tempest-GroupsTest-1311975393 None] Creating volume 85b49f24-41aa-48b0-aebb-5692d3751e54 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:45:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-56183f70-96a4-41d7-ba69-ca88652ed4e6 tempest-GroupsTest-1311975393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:45:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-56183f70-96a4-41d7-ba69-ca88652ed4e6 tempest-GroupsTest-1311975393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:45:54 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-56183f70-96a4-41d7-ba69-ca88652ed4e6 tempest-GroupsTest-1311975393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:45:54 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-56183f70-96a4-41d7-ba69-ca88652ed4e6 tempest-GroupsTest-1311975393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:45:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-56183f70-96a4-41d7-ba69-ca88652ed4e6 tempest-GroupsTest-1311975393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:45:54 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-56183f70-96a4-41d7-ba69-ca88652ed4e6 tempest-GroupsTest-1311975393 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:45:54 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-56183f70-96a4-41d7-ba69-ca88652ed4e6 tempest-GroupsTest-1311975393 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:45:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-56183f70-96a4-41d7-ba69-ca88652ed4e6 tempest-GroupsTest-1311975393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-85b49f24-41aa-48b0-aebb-5692d3751e54 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:54 devstack sudo[97394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-85b49f24-41aa-48b0-aebb-5692d3751e54 1073741824 Jul 08 18:45:54 devstack sudo[97394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:54 devstack sudo[97392]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-97d2d3b9-3131-4e1a-9c75-4ce3e9df8e0b tempest-VolumesExtendTest-1228408462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d1fd8fee-1130-4cc5-a739-f5215698b1f0" returned: 0 in 0.728s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:54 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-97d2d3b9-3131-4e1a-9c75-4ce3e9df8e0b tempest-VolumesExtendTest-1228408462 None] Lock "cinder-quobyte-d1fd8fee-1130-4cc5-a739-f5215698b1f0" released by "delete_volume" :: held 1.559s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:45:54 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-97d2d3b9-3131-4e1a-9c75-4ce3e9df8e0b tempest-VolumesExtendTest-1228408462 None] Created reservations ['2f7883ac-7fc6-4eb7-bbb9-9567549e1300', 'a87cf782-d8f8-4493-8390-54b0b099d94c', '8863d429-e256-45a9-a554-4ea647703f2d', '30c2bc72-32b9-4963-a1c7-90f05cfc570c'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:45:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-97d2d3b9-3131-4e1a-9c75-4ce3e9df8e0b tempest-VolumesExtendTest-1228408462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:45:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-97d2d3b9-3131-4e1a-9c75-4ce3e9df8e0b tempest-VolumesExtendTest-1228408462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:45:54 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-97d2d3b9-3131-4e1a-9c75-4ce3e9df8e0b tempest-VolumesExtendTest-1228408462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:45:54 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-97d2d3b9-3131-4e1a-9c75-4ce3e9df8e0b tempest-VolumesExtendTest-1228408462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:45:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-97d2d3b9-3131-4e1a-9c75-4ce3e9df8e0b tempest-VolumesExtendTest-1228408462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:45:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-97d2d3b9-3131-4e1a-9c75-4ce3e9df8e0b tempest-VolumesExtendTest-1228408462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:54 devstack sudo[97397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:45:54 devstack sudo[97397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:54 devstack sudo[97394]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-56183f70-96a4-41d7-ba69-ca88652ed4e6 tempest-GroupsTest-1311975393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-85b49f24-41aa-48b0-aebb-5692d3751e54 1073741824" returned: 0 in 0.818s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-56183f70-96a4-41d7-ba69-ca88652ed4e6 tempest-GroupsTest-1311975393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-85b49f24-41aa-48b0-aebb-5692d3751e54 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:54 devstack sudo[97403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-85b49f24-41aa-48b0-aebb-5692d3751e54 Jul 08 18:45:54 devstack sudo[97403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:55 devstack sudo[97397]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-97d2d3b9-3131-4e1a-9c75-4ce3e9df8e0b tempest-VolumesExtendTest-1228408462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.704s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:55 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-97d2d3b9-3131-4e1a-9c75-4ce3e9df8e0b tempest-VolumesExtendTest-1228408462 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:45:55 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-97d2d3b9-3131-4e1a-9c75-4ce3e9df8e0b tempest-VolumesExtendTest-1228408462 None] Deleted volume successfully. Jul 08 18:45:55 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-97d2d3b9-3131-4e1a-9c75-4ce3e9df8e0b tempest-VolumesExtendTest-1228408462 None] Lock "cinder-d1fd8fee-1130-4cc5-a739-f5215698b1f0-delete_volume" released by "delete_volume" :: held 2.483s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:45:55 devstack sudo[97403]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-56183f70-96a4-41d7-ba69-ca88652ed4e6 tempest-GroupsTest-1311975393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-85b49f24-41aa-48b0-aebb-5692d3751e54" returned: 0 in 0.733s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:55 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-56183f70-96a4-41d7-ba69-ca88652ed4e6 tempest-GroupsTest-1311975393 None] <== create_volume: return (1609ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:45:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-56183f70-96a4-41d7-ba69-ca88652ed4e6 tempest-GroupsTest-1311975393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.612s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:45:55 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-56183f70-96a4-41d7-ba69-ca88652ed4e6 tempest-GroupsTest-1311975393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d06e5758-9698-4797-a6ba-ca4cf1eae745) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85b49f24-41aa-48b0-aebb-5692d3751e54', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:45:55 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-56183f70-96a4-41d7-ba69-ca88652ed4e6 tempest-GroupsTest-1311975393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b36ca92e-7572-4e3c-a3f6-ed7b701bdac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:45:55 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-56183f70-96a4-41d7-ba69-ca88652ed4e6 tempest-GroupsTest-1311975393 None] Volume volume-85b49f24-41aa-48b0-aebb-5692d3751e54 (85b49f24-41aa-48b0-aebb-5692d3751e54): created successfully Jul 08 18:45:55 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-56183f70-96a4-41d7-ba69-ca88652ed4e6 tempest-GroupsTest-1311975393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b36ca92e-7572-4e3c-a3f6-ed7b701bdac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:45:55 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-56183f70-96a4-41d7-ba69-ca88652ed4e6 tempest-GroupsTest-1311975393 None] Flow 'volume_create_manager' (a6ff5940-b972-4c49-9ad9-9c3042a8e37f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:45:55 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-56183f70-96a4-41d7-ba69-ca88652ed4e6 tempest-GroupsTest-1311975393 None] Created volume successfully. Jul 08 18:45:56 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b62fcf59-6a1b-42fb-b5dc-332d9a0c25cd tempest-GroupsTest-1311975393 None] Acquiring lock "cinder-quobyte-85b49f24-41aa-48b0-aebb-5692d3751e54" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:45:56 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b62fcf59-6a1b-42fb-b5dc-332d9a0c25cd tempest-GroupsTest-1311975393 None] Lock "cinder-quobyte-85b49f24-41aa-48b0-aebb-5692d3751e54" acquired by "delete_volume" :: waited 0.016s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:45:57 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98ff029-5039-4b8b-84d7-2aea481c3add]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:45:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b62fcf59-6a1b-42fb-b5dc-332d9a0c25cd tempest-GroupsTest-1311975393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-85b49f24-41aa-48b0-aebb-5692d3751e54 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:57 devstack sudo[97408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-85b49f24-41aa-48b0-aebb-5692d3751e54 Jul 08 18:45:57 devstack sudo[97408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:57 devstack sudo[97408]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b62fcf59-6a1b-42fb-b5dc-332d9a0c25cd tempest-GroupsTest-1311975393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-85b49f24-41aa-48b0-aebb-5692d3751e54" returned: 0 in 0.837s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b62fcf59-6a1b-42fb-b5dc-332d9a0c25cd tempest-GroupsTest-1311975393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-85b49f24-41aa-48b0-aebb-5692d3751e54 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:57 devstack sudo[97413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-85b49f24-41aa-48b0-aebb-5692d3751e54 Jul 08 18:45:57 devstack sudo[97413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:57 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b20e2ab-2a4a-4816-a8c9-7f2fc1ffea38 tempest-VolumesGetTest-918879318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:45:58 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-7b20e2ab-2a4a-4816-a8c9-7f2fc1ffea38 tempest-VolumesGetTest-918879318 None] Flow 'volume_create_manager' (4f4143d8-7666-4f8f-86ef-26e49ffcdeb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:45:58 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-7b20e2ab-2a4a-4816-a8c9-7f2fc1ffea38 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25cc3743-5501-4bfc-a35e-a8601cb650d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:45:58 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-7b20e2ab-2a4a-4816-a8c9-7f2fc1ffea38 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25cc3743-5501-4bfc-a35e-a8601cb650d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:45:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2039671954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0863c560-21c8-4181-8687-2ad551a0cd4b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d63739f7006c405dbae689336b310415',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:45:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:45:58Z,use_quota=True,user_id='e367efa8acbb469090ec3d08f284912c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:45:58 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-7b20e2ab-2a4a-4816-a8c9-7f2fc1ffea38 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7d9ad8f-fe8e-4767-952b-52c1b992f332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:45:58 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-7b20e2ab-2a4a-4816-a8c9-7f2fc1ffea38 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7d9ad8f-fe8e-4767-952b-52c1b992f332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:45:58 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-7b20e2ab-2a4a-4816-a8c9-7f2fc1ffea38 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (396f38a3-b01f-44c5-b2ba-86940b6cd9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:45:58 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-7b20e2ab-2a4a-4816-a8c9-7f2fc1ffea38 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (396f38a3-b01f-44c5-b2ba-86940b6cd9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0863c560-21c8-4181-8687-2ad551a0cd4b', 'volume_name': 'volume-0863c560-21c8-4181-8687-2ad551a0cd4b', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:45:58 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-7b20e2ab-2a4a-4816-a8c9-7f2fc1ffea38 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26747f81-c89c-4e6c-b7f3-339aa278fbf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:45:58 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-7b20e2ab-2a4a-4816-a8c9-7f2fc1ffea38 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26747f81-c89c-4e6c-b7f3-339aa278fbf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:45:58 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-7b20e2ab-2a4a-4816-a8c9-7f2fc1ffea38 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3426690b-0c1d-4b7c-b5f0-1245e2796e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:45:58 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-7b20e2ab-2a4a-4816-a8c9-7f2fc1ffea38 tempest-VolumesGetTest-918879318 None] Volume 0863c560-21c8-4181-8687-2ad551a0cd4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0863c560-21c8-4181-8687-2ad551a0cd4b', 'volume_size': 1} Jul 08 18:45:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-7b20e2ab-2a4a-4816-a8c9-7f2fc1ffea38 tempest-VolumesGetTest-918879318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:45:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-7b20e2ab-2a4a-4816-a8c9-7f2fc1ffea38 tempest-VolumesGetTest-918879318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:45:58 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-7b20e2ab-2a4a-4816-a8c9-7f2fc1ffea38 tempest-VolumesGetTest-918879318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:45:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2039671954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0863c560-21c8-4181-8687-2ad551a0cd4b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d63739f7006c405dbae689336b310415',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:45:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:45:58Z,use_quota=True,user_id='e367efa8acbb469090ec3d08f284912c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:45:58 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-7b20e2ab-2a4a-4816-a8c9-7f2fc1ffea38 tempest-VolumesGetTest-918879318 None] Creating volume 0863c560-21c8-4181-8687-2ad551a0cd4b {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:45:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-7b20e2ab-2a4a-4816-a8c9-7f2fc1ffea38 tempest-VolumesGetTest-918879318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:45:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-7b20e2ab-2a4a-4816-a8c9-7f2fc1ffea38 tempest-VolumesGetTest-918879318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:45:58 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-7b20e2ab-2a4a-4816-a8c9-7f2fc1ffea38 tempest-VolumesGetTest-918879318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:45:58 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-7b20e2ab-2a4a-4816-a8c9-7f2fc1ffea38 tempest-VolumesGetTest-918879318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:45:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-7b20e2ab-2a4a-4816-a8c9-7f2fc1ffea38 tempest-VolumesGetTest-918879318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:45:58 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-7b20e2ab-2a4a-4816-a8c9-7f2fc1ffea38 tempest-VolumesGetTest-918879318 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:45:58 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-7b20e2ab-2a4a-4816-a8c9-7f2fc1ffea38 tempest-VolumesGetTest-918879318 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:45:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-7b20e2ab-2a4a-4816-a8c9-7f2fc1ffea38 tempest-VolumesGetTest-918879318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0863c560-21c8-4181-8687-2ad551a0cd4b 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:58 devstack sudo[97415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0863c560-21c8-4181-8687-2ad551a0cd4b 1073741824 Jul 08 18:45:58 devstack sudo[97415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:58 devstack sudo[97413]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b62fcf59-6a1b-42fb-b5dc-332d9a0c25cd tempest-GroupsTest-1311975393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-85b49f24-41aa-48b0-aebb-5692d3751e54" returned: 0 in 0.731s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:58 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b62fcf59-6a1b-42fb-b5dc-332d9a0c25cd tempest-GroupsTest-1311975393 None] Lock "cinder-quobyte-85b49f24-41aa-48b0-aebb-5692d3751e54" released by "delete_volume" :: held 1.619s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:45:58 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-b62fcf59-6a1b-42fb-b5dc-332d9a0c25cd tempest-GroupsTest-1311975393 None] Created reservations ['a58db702-cbc0-40ad-9c48-f22ce09a5ea5'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:45:58 devstack cinder-volume[86873]: WARNING cinder.quota [None req-b62fcf59-6a1b-42fb-b5dc-332d9a0c25cd tempest-GroupsTest-1311975393 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1326232915 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1326232915, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:45:58 devstack cinder-volume[86873]: WARNING cinder.quota [None req-b62fcf59-6a1b-42fb-b5dc-332d9a0c25cd tempest-GroupsTest-1311975393 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1326232915 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1326232915, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:45:58 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-b62fcf59-6a1b-42fb-b5dc-332d9a0c25cd tempest-GroupsTest-1311975393 None] Created reservations ['fb50d1c3-9b62-49bd-9300-74a86f6e0fe4', 'b5825981-e282-406f-8148-fcda9336a607', '39231355-cdb7-45ab-9214-b2193ad7808b', '1cfef469-2c8e-49c0-88d2-93066d8dc623'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:45:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b62fcf59-6a1b-42fb-b5dc-332d9a0c25cd tempest-GroupsTest-1311975393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:45:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b62fcf59-6a1b-42fb-b5dc-332d9a0c25cd tempest-GroupsTest-1311975393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:45:58 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b62fcf59-6a1b-42fb-b5dc-332d9a0c25cd tempest-GroupsTest-1311975393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:45:58 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b62fcf59-6a1b-42fb-b5dc-332d9a0c25cd tempest-GroupsTest-1311975393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:45:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b62fcf59-6a1b-42fb-b5dc-332d9a0c25cd tempest-GroupsTest-1311975393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:45:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b62fcf59-6a1b-42fb-b5dc-332d9a0c25cd tempest-GroupsTest-1311975393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:58 devstack sudo[97422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:45:58 devstack sudo[97422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:58 devstack sudo[97415]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-7b20e2ab-2a4a-4816-a8c9-7f2fc1ffea38 tempest-VolumesGetTest-918879318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0863c560-21c8-4181-8687-2ad551a0cd4b 1073741824" returned: 0 in 0.899s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-7b20e2ab-2a4a-4816-a8c9-7f2fc1ffea38 tempest-VolumesGetTest-918879318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0863c560-21c8-4181-8687-2ad551a0cd4b {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:59 devstack sudo[97424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0863c560-21c8-4181-8687-2ad551a0cd4b Jul 08 18:45:59 devstack sudo[97424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:59 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-5683eedd-0908-4f9d-9da7-3aa6f3c9e94c tempest-GroupsTest-1311975393 None] Created reservations ['bf2b4023-5a14-4d7c-a9dc-cf02f0d7e44d'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:45:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5683eedd-0908-4f9d-9da7-3aa6f3c9e94c tempest-GroupsTest-1311975393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:45:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5683eedd-0908-4f9d-9da7-3aa6f3c9e94c tempest-GroupsTest-1311975393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:45:59 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-5683eedd-0908-4f9d-9da7-3aa6f3c9e94c tempest-GroupsTest-1311975393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:45:59 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-5683eedd-0908-4f9d-9da7-3aa6f3c9e94c tempest-GroupsTest-1311975393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:45:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5683eedd-0908-4f9d-9da7-3aa6f3c9e94c tempest-GroupsTest-1311975393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:45:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5683eedd-0908-4f9d-9da7-3aa6f3c9e94c tempest-GroupsTest-1311975393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:59 devstack sudo[97422]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b62fcf59-6a1b-42fb-b5dc-332d9a0c25cd tempest-GroupsTest-1311975393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.745s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:59 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-b62fcf59-6a1b-42fb-b5dc-332d9a0c25cd tempest-GroupsTest-1311975393 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:45:59 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-b62fcf59-6a1b-42fb-b5dc-332d9a0c25cd tempest-GroupsTest-1311975393 None] Delete group completed successfully. Jul 08 18:45:59 devstack sudo[97428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:45:59 devstack sudo[97428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:59 devstack sudo[97424]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-7b20e2ab-2a4a-4816-a8c9-7f2fc1ffea38 tempest-VolumesGetTest-918879318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0863c560-21c8-4181-8687-2ad551a0cd4b" returned: 0 in 0.668s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:59 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-7b20e2ab-2a4a-4816-a8c9-7f2fc1ffea38 tempest-VolumesGetTest-918879318 None] <== create_volume: return (1605ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:45:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-7b20e2ab-2a4a-4816-a8c9-7f2fc1ffea38 tempest-VolumesGetTest-918879318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.608s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:45:59 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-7b20e2ab-2a4a-4816-a8c9-7f2fc1ffea38 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3426690b-0c1d-4b7c-b5f0-1245e2796e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0863c560-21c8-4181-8687-2ad551a0cd4b', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:45:59 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-7b20e2ab-2a4a-4816-a8c9-7f2fc1ffea38 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87436bd8-bec6-4fca-9772-9ae53087a388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:45:59 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-7b20e2ab-2a4a-4816-a8c9-7f2fc1ffea38 tempest-VolumesGetTest-918879318 None] Volume volume-0863c560-21c8-4181-8687-2ad551a0cd4b (0863c560-21c8-4181-8687-2ad551a0cd4b): created successfully Jul 08 18:45:59 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-7b20e2ab-2a4a-4816-a8c9-7f2fc1ffea38 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87436bd8-bec6-4fca-9772-9ae53087a388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:45:59 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-7b20e2ab-2a4a-4816-a8c9-7f2fc1ffea38 tempest-VolumesGetTest-918879318 None] Flow 'volume_create_manager' (4f4143d8-7666-4f8f-86ef-26e49ffcdeb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:45:59 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-7b20e2ab-2a4a-4816-a8c9-7f2fc1ffea38 tempest-VolumesGetTest-918879318 None] Created volume successfully. Jul 08 18:46:00 devstack sudo[97428]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5683eedd-0908-4f9d-9da7-3aa6f3c9e94c tempest-GroupsTest-1311975393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.671s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:00 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-5683eedd-0908-4f9d-9da7-3aa6f3c9e94c tempest-GroupsTest-1311975393 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:46:00 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-5683eedd-0908-4f9d-9da7-3aa6f3c9e94c tempest-GroupsTest-1311975393 None] Delete group completed successfully. Jul 08 18:46:00 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-d106b304-a7d4-4824-9760-9510d29eba65 tempest-VolumesGetTest-918879318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:46:00 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d106b304-a7d4-4824-9760-9510d29eba65 tempest-VolumesGetTest-918879318 None] Flow 'volume_create_manager' (feaaa884-87e6-4ed7-92d0-637f5d685cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:46:00 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d106b304-a7d4-4824-9760-9510d29eba65 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d7cb6df-78bb-4385-a398-b355abc8f0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:00 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d106b304-a7d4-4824-9760-9510d29eba65 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d7cb6df-78bb-4385-a398-b355abc8f0af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:46:00Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1398116267',display_name='tempest-VolumesGetTest-Volume-1776906119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ede370e2-9600-45cc-8410-4968ac6fbbf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d63739f7006c405dbae689336b310415',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:46:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:46:01Z,use_quota=True,user_id='e367efa8acbb469090ec3d08f284912c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:00 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d106b304-a7d4-4824-9760-9510d29eba65 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c2119d2-6851-4518-9018-d39d074b57f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:00 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d106b304-a7d4-4824-9760-9510d29eba65 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c2119d2-6851-4518-9018-d39d074b57f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:00 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d106b304-a7d4-4824-9760-9510d29eba65 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a689039-cbde-4479-bcfd-88bb66a1f3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:00 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d106b304-a7d4-4824-9760-9510d29eba65 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a689039-cbde-4479-bcfd-88bb66a1f3aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ede370e2-9600-45cc-8410-4968ac6fbbf1', 'volume_name': 'volume-ede370e2-9600-45cc-8410-4968ac6fbbf1', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:00 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d106b304-a7d4-4824-9760-9510d29eba65 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4b48eb2-4adf-41e7-bab8-bb22c7d61c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:00 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d106b304-a7d4-4824-9760-9510d29eba65 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4b48eb2-4adf-41e7-bab8-bb22c7d61c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:00 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d106b304-a7d4-4824-9760-9510d29eba65 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a2c04db-1e9b-4f83-b984-a38d9f6134b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:00 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-d106b304-a7d4-4824-9760-9510d29eba65 tempest-VolumesGetTest-918879318 None] Volume ede370e2-9600-45cc-8410-4968ac6fbbf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ede370e2-9600-45cc-8410-4968ac6fbbf1', 'volume_size': 1} Jul 08 18:46:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-d106b304-a7d4-4824-9760-9510d29eba65 tempest-VolumesGetTest-918879318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:46:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-d106b304-a7d4-4824-9760-9510d29eba65 tempest-VolumesGetTest-918879318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:46:00 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-d106b304-a7d4-4824-9760-9510d29eba65 tempest-VolumesGetTest-918879318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:46:00Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1398116267',display_name='tempest-VolumesGetTest-Volume-1776906119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ede370e2-9600-45cc-8410-4968ac6fbbf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d63739f7006c405dbae689336b310415',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:46:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:46:01Z,use_quota=True,user_id='e367efa8acbb469090ec3d08f284912c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:46:00 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-d106b304-a7d4-4824-9760-9510d29eba65 tempest-VolumesGetTest-918879318 None] Creating volume ede370e2-9600-45cc-8410-4968ac6fbbf1 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:46:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-d106b304-a7d4-4824-9760-9510d29eba65 tempest-VolumesGetTest-918879318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:46:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-d106b304-a7d4-4824-9760-9510d29eba65 tempest-VolumesGetTest-918879318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:46:00 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-d106b304-a7d4-4824-9760-9510d29eba65 tempest-VolumesGetTest-918879318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:46:00 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-d106b304-a7d4-4824-9760-9510d29eba65 tempest-VolumesGetTest-918879318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:46:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-d106b304-a7d4-4824-9760-9510d29eba65 tempest-VolumesGetTest-918879318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:46:00 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-d106b304-a7d4-4824-9760-9510d29eba65 tempest-VolumesGetTest-918879318 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:46:00 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-d106b304-a7d4-4824-9760-9510d29eba65 tempest-VolumesGetTest-918879318 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:46:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d106b304-a7d4-4824-9760-9510d29eba65 tempest-VolumesGetTest-918879318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ede370e2-9600-45cc-8410-4968ac6fbbf1 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:00 devstack sudo[97432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ede370e2-9600-45cc-8410-4968ac6fbbf1 1073741824 Jul 08 18:46:00 devstack sudo[97432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:01 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-2613e25f-d6f7-444a-a4ac-4cce381af868 tempest-GroupsTest-1311975393 None] Group tempest-GroupsTest-Group-1653143560: creating Jul 08 18:46:01 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-2613e25f-d6f7-444a-a4ac-4cce381af868 tempest-GroupsTest-1311975393 None] Group tempest-GroupsTest-Group-1653143560: created successfully Jul 08 18:46:01 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-2613e25f-d6f7-444a-a4ac-4cce381af868 tempest-GroupsTest-1311975393 None] Create group completed successfully. Jul 08 18:46:01 devstack sudo[97432]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d106b304-a7d4-4824-9760-9510d29eba65 tempest-VolumesGetTest-918879318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ede370e2-9600-45cc-8410-4968ac6fbbf1 1073741824" returned: 0 in 0.855s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d106b304-a7d4-4824-9760-9510d29eba65 tempest-VolumesGetTest-918879318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ede370e2-9600-45cc-8410-4968ac6fbbf1 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:01 devstack sudo[97473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ede370e2-9600-45cc-8410-4968ac6fbbf1 Jul 08 18:46:01 devstack sudo[97473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:02 devstack sudo[97473]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d106b304-a7d4-4824-9760-9510d29eba65 tempest-VolumesGetTest-918879318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ede370e2-9600-45cc-8410-4968ac6fbbf1" returned: 0 in 0.667s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:02 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-d106b304-a7d4-4824-9760-9510d29eba65 tempest-VolumesGetTest-918879318 None] <== create_volume: return (1559ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:46:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-d106b304-a7d4-4824-9760-9510d29eba65 tempest-VolumesGetTest-918879318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.561s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:46:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d106b304-a7d4-4824-9760-9510d29eba65 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a2c04db-1e9b-4f83-b984-a38d9f6134b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ede370e2-9600-45cc-8410-4968ac6fbbf1', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d106b304-a7d4-4824-9760-9510d29eba65 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c02a8871-51b9-41af-8e7d-707c0fa1981f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:02 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-d106b304-a7d4-4824-9760-9510d29eba65 tempest-VolumesGetTest-918879318 None] Volume volume-ede370e2-9600-45cc-8410-4968ac6fbbf1 (ede370e2-9600-45cc-8410-4968ac6fbbf1): created successfully Jul 08 18:46:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d106b304-a7d4-4824-9760-9510d29eba65 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c02a8871-51b9-41af-8e7d-707c0fa1981f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d106b304-a7d4-4824-9760-9510d29eba65 tempest-VolumesGetTest-918879318 None] Flow 'volume_create_manager' (feaaa884-87e6-4ed7-92d0-637f5d685cc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:46:02 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-d106b304-a7d4-4824-9760-9510d29eba65 tempest-VolumesGetTest-918879318 None] Created volume successfully. Jul 08 18:46:02 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a1e8d0e-10c8-4ea1-9b8e-a451b5ea67cc tempest-GroupsTest-1311975393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:46:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3a1e8d0e-10c8-4ea1-9b8e-a451b5ea67cc tempest-GroupsTest-1311975393 None] Flow 'volume_create_manager' (c38791f1-8db4-467a-a3e0-96f4a6e545c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:46:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3a1e8d0e-10c8-4ea1-9b8e-a451b5ea67cc tempest-GroupsTest-1311975393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61c1c8c9-7a21-4ea7-bfe1-c93252a7832e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3a1e8d0e-10c8-4ea1-9b8e-a451b5ea67cc tempest-GroupsTest-1311975393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61c1c8c9-7a21-4ea7-bfe1-c93252a7832e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:46:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2123842286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5c4a6e01-501e-4f24-9eff-4fcc1e652b13,host='devstack@QuobyteHD#QuobyteHD',id=fb548e5d-86da-4c76-a8a1-8a4213a984b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1d9e2f723d46a48e2b72a28a56cfa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:46:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:46:03Z,use_quota=True,user_id='7b03f29f01754a00943c35f41706e570',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa63dd78-137e-4e4b-8422-519bd3754c52),volume_type_id=aa63dd78-137e-4e4b-8422-519bd3754c52)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3a1e8d0e-10c8-4ea1-9b8e-a451b5ea67cc tempest-GroupsTest-1311975393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75673b2f-ccd9-4b44-b58e-3413f27479aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3a1e8d0e-10c8-4ea1-9b8e-a451b5ea67cc tempest-GroupsTest-1311975393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75673b2f-ccd9-4b44-b58e-3413f27479aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3a1e8d0e-10c8-4ea1-9b8e-a451b5ea67cc tempest-GroupsTest-1311975393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e983f12-8f72-40cd-a1a4-a0c1124f3d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3a1e8d0e-10c8-4ea1-9b8e-a451b5ea67cc tempest-GroupsTest-1311975393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e983f12-8f72-40cd-a1a4-a0c1124f3d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb548e5d-86da-4c76-a8a1-8a4213a984b8', 'volume_name': 'volume-fb548e5d-86da-4c76-a8a1-8a4213a984b8', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3a1e8d0e-10c8-4ea1-9b8e-a451b5ea67cc tempest-GroupsTest-1311975393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f12e1ad-ad26-4e19-bf73-451e03377f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3a1e8d0e-10c8-4ea1-9b8e-a451b5ea67cc tempest-GroupsTest-1311975393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f12e1ad-ad26-4e19-bf73-451e03377f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3a1e8d0e-10c8-4ea1-9b8e-a451b5ea67cc tempest-GroupsTest-1311975393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e58cac0-67e6-4f7f-b51f-dffafc1ff76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:02 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-3a1e8d0e-10c8-4ea1-9b8e-a451b5ea67cc tempest-GroupsTest-1311975393 None] Volume fb548e5d-86da-4c76-a8a1-8a4213a984b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb548e5d-86da-4c76-a8a1-8a4213a984b8', 'volume_size': 1} Jul 08 18:46:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3a1e8d0e-10c8-4ea1-9b8e-a451b5ea67cc tempest-GroupsTest-1311975393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:46:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3a1e8d0e-10c8-4ea1-9b8e-a451b5ea67cc tempest-GroupsTest-1311975393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:46:02 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-3a1e8d0e-10c8-4ea1-9b8e-a451b5ea67cc tempest-GroupsTest-1311975393 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5c4a6e01-501e-4f24-9eff-4fcc1e652b13,created_at=2026-07-08T16:46:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2123842286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5c4a6e01-501e-4f24-9eff-4fcc1e652b13,host='devstack@QuobyteHD#QuobyteHD',id=fb548e5d-86da-4c76-a8a1-8a4213a984b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1d9e2f723d46a48e2b72a28a56cfa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:46:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:46:03Z,use_quota=True,user_id='7b03f29f01754a00943c35f41706e570',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa63dd78-137e-4e4b-8422-519bd3754c52),volume_type_id=aa63dd78-137e-4e4b-8422-519bd3754c52)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:46:02 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-3a1e8d0e-10c8-4ea1-9b8e-a451b5ea67cc tempest-GroupsTest-1311975393 None] Creating volume fb548e5d-86da-4c76-a8a1-8a4213a984b8 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:46:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3a1e8d0e-10c8-4ea1-9b8e-a451b5ea67cc tempest-GroupsTest-1311975393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:46:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3a1e8d0e-10c8-4ea1-9b8e-a451b5ea67cc tempest-GroupsTest-1311975393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:46:02 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-3a1e8d0e-10c8-4ea1-9b8e-a451b5ea67cc tempest-GroupsTest-1311975393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:46:02 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-3a1e8d0e-10c8-4ea1-9b8e-a451b5ea67cc tempest-GroupsTest-1311975393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:46:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3a1e8d0e-10c8-4ea1-9b8e-a451b5ea67cc tempest-GroupsTest-1311975393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:46:02 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-3a1e8d0e-10c8-4ea1-9b8e-a451b5ea67cc tempest-GroupsTest-1311975393 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:46:02 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-3a1e8d0e-10c8-4ea1-9b8e-a451b5ea67cc tempest-GroupsTest-1311975393 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:46:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3a1e8d0e-10c8-4ea1-9b8e-a451b5ea67cc tempest-GroupsTest-1311975393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-fb548e5d-86da-4c76-a8a1-8a4213a984b8 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:02 devstack sudo[97479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-fb548e5d-86da-4c76-a8a1-8a4213a984b8 1073741824 Jul 08 18:46:02 devstack sudo[97479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:02 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-3c36dd31-b6ed-4735-9149-4a31b7afcc0a tempest-VolumesGetTest-918879318 None] Acquiring lock "cinder-ede370e2-9600-45cc-8410-4968ac6fbbf1-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:46:02 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-3c36dd31-b6ed-4735-9149-4a31b7afcc0a tempest-VolumesGetTest-918879318 None] Lock "cinder-ede370e2-9600-45cc-8410-4968ac6fbbf1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:46:02 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-3c36dd31-b6ed-4735-9149-4a31b7afcc0a tempest-VolumesGetTest-918879318 None] Acquiring lock "cinder-quobyte-ede370e2-9600-45cc-8410-4968ac6fbbf1" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:46:03 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-3c36dd31-b6ed-4735-9149-4a31b7afcc0a tempest-VolumesGetTest-918879318 None] Lock "cinder-quobyte-ede370e2-9600-45cc-8410-4968ac6fbbf1" acquired by "delete_volume" :: waited 0.019s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:46:03 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef16a34a-8a19-40d2-87ec-9380ba5610d9]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:46:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3c36dd31-b6ed-4735-9149-4a31b7afcc0a tempest-VolumesGetTest-918879318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ede370e2-9600-45cc-8410-4968ac6fbbf1 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:03 devstack sudo[97481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ede370e2-9600-45cc-8410-4968ac6fbbf1 Jul 08 18:46:03 devstack sudo[97481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:03 devstack sudo[97479]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3a1e8d0e-10c8-4ea1-9b8e-a451b5ea67cc tempest-GroupsTest-1311975393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-fb548e5d-86da-4c76-a8a1-8a4213a984b8 1073741824" returned: 0 in 0.854s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3a1e8d0e-10c8-4ea1-9b8e-a451b5ea67cc tempest-GroupsTest-1311975393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-fb548e5d-86da-4c76-a8a1-8a4213a984b8 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:03 devstack sudo[97486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-fb548e5d-86da-4c76-a8a1-8a4213a984b8 Jul 08 18:46:03 devstack sudo[97486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:03 devstack sudo[97481]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3c36dd31-b6ed-4735-9149-4a31b7afcc0a tempest-VolumesGetTest-918879318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ede370e2-9600-45cc-8410-4968ac6fbbf1" returned: 0 in 0.798s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3c36dd31-b6ed-4735-9149-4a31b7afcc0a tempest-VolumesGetTest-918879318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ede370e2-9600-45cc-8410-4968ac6fbbf1 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:03 devstack sudo[97491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ede370e2-9600-45cc-8410-4968ac6fbbf1 Jul 08 18:46:03 devstack sudo[97491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:04 devstack sudo[97486]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3a1e8d0e-10c8-4ea1-9b8e-a451b5ea67cc tempest-GroupsTest-1311975393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-fb548e5d-86da-4c76-a8a1-8a4213a984b8" returned: 0 in 0.654s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:04 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-3a1e8d0e-10c8-4ea1-9b8e-a451b5ea67cc tempest-GroupsTest-1311975393 None] <== create_volume: return (1553ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:46:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3a1e8d0e-10c8-4ea1-9b8e-a451b5ea67cc tempest-GroupsTest-1311975393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:46:04 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3a1e8d0e-10c8-4ea1-9b8e-a451b5ea67cc tempest-GroupsTest-1311975393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e58cac0-67e6-4f7f-b51f-dffafc1ff76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb548e5d-86da-4c76-a8a1-8a4213a984b8', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:04 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3a1e8d0e-10c8-4ea1-9b8e-a451b5ea67cc tempest-GroupsTest-1311975393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a0dfed8-15b4-429a-8d45-f429a54c6c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:04 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-3a1e8d0e-10c8-4ea1-9b8e-a451b5ea67cc tempest-GroupsTest-1311975393 None] Volume volume-fb548e5d-86da-4c76-a8a1-8a4213a984b8 (fb548e5d-86da-4c76-a8a1-8a4213a984b8): created successfully Jul 08 18:46:04 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3a1e8d0e-10c8-4ea1-9b8e-a451b5ea67cc tempest-GroupsTest-1311975393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a0dfed8-15b4-429a-8d45-f429a54c6c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:04 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3a1e8d0e-10c8-4ea1-9b8e-a451b5ea67cc tempest-GroupsTest-1311975393 None] Flow 'volume_create_manager' (c38791f1-8db4-467a-a3e0-96f4a6e545c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:46:04 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-3a1e8d0e-10c8-4ea1-9b8e-a451b5ea67cc tempest-GroupsTest-1311975393 None] Created volume successfully. Jul 08 18:46:04 devstack sudo[97491]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3c36dd31-b6ed-4735-9149-4a31b7afcc0a tempest-VolumesGetTest-918879318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ede370e2-9600-45cc-8410-4968ac6fbbf1" returned: 0 in 0.641s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:04 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-3c36dd31-b6ed-4735-9149-4a31b7afcc0a tempest-VolumesGetTest-918879318 None] Lock "cinder-quobyte-ede370e2-9600-45cc-8410-4968ac6fbbf1" released by "delete_volume" :: held 1.490s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:46:04 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-3c36dd31-b6ed-4735-9149-4a31b7afcc0a tempest-VolumesGetTest-918879318 None] Created reservations ['a9a92202-abca-47b4-bd82-c42fcc733599', '944791a9-bfdd-4985-84af-e069b490d460', '81b23e70-6f87-426e-959d-dde6884c6587', '1c4eedbc-1026-4cfe-8977-63210a3ea84f'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:46:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3c36dd31-b6ed-4735-9149-4a31b7afcc0a tempest-VolumesGetTest-918879318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:46:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3c36dd31-b6ed-4735-9149-4a31b7afcc0a tempest-VolumesGetTest-918879318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:46:04 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-3c36dd31-b6ed-4735-9149-4a31b7afcc0a tempest-VolumesGetTest-918879318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:46:04 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-3c36dd31-b6ed-4735-9149-4a31b7afcc0a tempest-VolumesGetTest-918879318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:46:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3c36dd31-b6ed-4735-9149-4a31b7afcc0a tempest-VolumesGetTest-918879318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:46:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3c36dd31-b6ed-4735-9149-4a31b7afcc0a tempest-VolumesGetTest-918879318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:04 devstack sudo[97495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:46:04 devstack sudo[97495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:05 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-618ea675-a8ad-4096-98c3-9cbe0fdc3ca8 tempest-VolumesGetTest-918879318 None] Acquiring lock "cinder-0863c560-21c8-4181-8687-2ad551a0cd4b-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:46:05 devstack sudo[97495]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:05 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-618ea675-a8ad-4096-98c3-9cbe0fdc3ca8 tempest-VolumesGetTest-918879318 None] Lock "cinder-0863c560-21c8-4181-8687-2ad551a0cd4b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:46:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3c36dd31-b6ed-4735-9149-4a31b7afcc0a tempest-VolumesGetTest-918879318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.691s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:05 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-3c36dd31-b6ed-4735-9149-4a31b7afcc0a tempest-VolumesGetTest-918879318 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:46:05 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-3c36dd31-b6ed-4735-9149-4a31b7afcc0a tempest-VolumesGetTest-918879318 None] Deleted volume successfully. Jul 08 18:46:05 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-3c36dd31-b6ed-4735-9149-4a31b7afcc0a tempest-VolumesGetTest-918879318 None] Lock "cinder-ede370e2-9600-45cc-8410-4968ac6fbbf1-delete_volume" released by "delete_volume" :: held 2.379s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:46:05 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-618ea675-a8ad-4096-98c3-9cbe0fdc3ca8 tempest-VolumesGetTest-918879318 None] Acquiring lock "cinder-quobyte-0863c560-21c8-4181-8687-2ad551a0cd4b" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:46:05 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-618ea675-a8ad-4096-98c3-9cbe0fdc3ca8 tempest-VolumesGetTest-918879318 None] Lock "cinder-quobyte-0863c560-21c8-4181-8687-2ad551a0cd4b" acquired by "delete_volume" :: waited 0.015s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:46:05 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[5762a22a-1460-40f8-886e-32e84be2f437]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:46:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-618ea675-a8ad-4096-98c3-9cbe0fdc3ca8 tempest-VolumesGetTest-918879318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0863c560-21c8-4181-8687-2ad551a0cd4b {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:05 devstack sudo[97498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0863c560-21c8-4181-8687-2ad551a0cd4b Jul 08 18:46:05 devstack sudo[97498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:05 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4029200-a16a-4e56-8e68-109e6525c94e tempest-GroupsTest-1311975393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:46:05 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-a4029200-a16a-4e56-8e68-109e6525c94e tempest-GroupsTest-1311975393 None] Flow 'volume_create_manager' (7b8fc1cf-45f5-487f-bf5d-ec4029da55b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:46:05 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-a4029200-a16a-4e56-8e68-109e6525c94e tempest-GroupsTest-1311975393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34999979-2882-44fd-8461-b790aab493aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:05 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-a4029200-a16a-4e56-8e68-109e6525c94e tempest-GroupsTest-1311975393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34999979-2882-44fd-8461-b790aab493aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:46:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-367608206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5c4a6e01-501e-4f24-9eff-4fcc1e652b13,host='devstack@QuobyteHD#QuobyteHD',id=ed6ef234-5a2e-44b5-a9ca-0212926d872f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1d9e2f723d46a48e2b72a28a56cfa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:46:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:46:06Z,use_quota=True,user_id='7b03f29f01754a00943c35f41706e570',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa63dd78-137e-4e4b-8422-519bd3754c52),volume_type_id=aa63dd78-137e-4e4b-8422-519bd3754c52)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:05 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-a4029200-a16a-4e56-8e68-109e6525c94e tempest-GroupsTest-1311975393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (654a066a-26fd-4e32-b15a-0abd4bc83c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:05 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-a4029200-a16a-4e56-8e68-109e6525c94e tempest-GroupsTest-1311975393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (654a066a-26fd-4e32-b15a-0abd4bc83c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:05 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-a4029200-a16a-4e56-8e68-109e6525c94e tempest-GroupsTest-1311975393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (209f375a-0a75-4f5e-b6d8-fabe6a7bf51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:05 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-a4029200-a16a-4e56-8e68-109e6525c94e tempest-GroupsTest-1311975393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (209f375a-0a75-4f5e-b6d8-fabe6a7bf51c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed6ef234-5a2e-44b5-a9ca-0212926d872f', 'volume_name': 'volume-ed6ef234-5a2e-44b5-a9ca-0212926d872f', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:05 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-a4029200-a16a-4e56-8e68-109e6525c94e tempest-GroupsTest-1311975393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93c65739-4a9c-44d2-9c9f-76585db33380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:05 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-a4029200-a16a-4e56-8e68-109e6525c94e tempest-GroupsTest-1311975393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93c65739-4a9c-44d2-9c9f-76585db33380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:05 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-a4029200-a16a-4e56-8e68-109e6525c94e tempest-GroupsTest-1311975393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (150ee779-dd31-4e5e-98c5-3e50cb5af527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:05 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-a4029200-a16a-4e56-8e68-109e6525c94e tempest-GroupsTest-1311975393 None] Volume ed6ef234-5a2e-44b5-a9ca-0212926d872f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed6ef234-5a2e-44b5-a9ca-0212926d872f', 'volume_size': 1} Jul 08 18:46:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-a4029200-a16a-4e56-8e68-109e6525c94e tempest-GroupsTest-1311975393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:46:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-a4029200-a16a-4e56-8e68-109e6525c94e tempest-GroupsTest-1311975393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:46:05 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-a4029200-a16a-4e56-8e68-109e6525c94e tempest-GroupsTest-1311975393 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5c4a6e01-501e-4f24-9eff-4fcc1e652b13,created_at=2026-07-08T16:46:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-367608206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5c4a6e01-501e-4f24-9eff-4fcc1e652b13,host='devstack@QuobyteHD#QuobyteHD',id=ed6ef234-5a2e-44b5-a9ca-0212926d872f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1d9e2f723d46a48e2b72a28a56cfa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:46:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:46:06Z,use_quota=True,user_id='7b03f29f01754a00943c35f41706e570',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa63dd78-137e-4e4b-8422-519bd3754c52),volume_type_id=aa63dd78-137e-4e4b-8422-519bd3754c52)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:46:05 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-a4029200-a16a-4e56-8e68-109e6525c94e tempest-GroupsTest-1311975393 None] Creating volume ed6ef234-5a2e-44b5-a9ca-0212926d872f {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:46:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-a4029200-a16a-4e56-8e68-109e6525c94e tempest-GroupsTest-1311975393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:46:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-a4029200-a16a-4e56-8e68-109e6525c94e tempest-GroupsTest-1311975393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:46:05 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-a4029200-a16a-4e56-8e68-109e6525c94e tempest-GroupsTest-1311975393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:46:05 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-a4029200-a16a-4e56-8e68-109e6525c94e tempest-GroupsTest-1311975393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:46:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-a4029200-a16a-4e56-8e68-109e6525c94e tempest-GroupsTest-1311975393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:46:05 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-a4029200-a16a-4e56-8e68-109e6525c94e tempest-GroupsTest-1311975393 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:46:05 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-a4029200-a16a-4e56-8e68-109e6525c94e tempest-GroupsTest-1311975393 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:46:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-a4029200-a16a-4e56-8e68-109e6525c94e tempest-GroupsTest-1311975393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ed6ef234-5a2e-44b5-a9ca-0212926d872f 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:05 devstack sudo[97500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ed6ef234-5a2e-44b5-a9ca-0212926d872f 1073741824 Jul 08 18:46:05 devstack sudo[97500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:06 devstack sudo[97498]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-618ea675-a8ad-4096-98c3-9cbe0fdc3ca8 tempest-VolumesGetTest-918879318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0863c560-21c8-4181-8687-2ad551a0cd4b" returned: 0 in 0.776s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-618ea675-a8ad-4096-98c3-9cbe0fdc3ca8 tempest-VolumesGetTest-918879318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0863c560-21c8-4181-8687-2ad551a0cd4b {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:06 devstack sudo[97505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0863c560-21c8-4181-8687-2ad551a0cd4b Jul 08 18:46:06 devstack sudo[97505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:06 devstack sudo[97500]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-a4029200-a16a-4e56-8e68-109e6525c94e tempest-GroupsTest-1311975393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ed6ef234-5a2e-44b5-a9ca-0212926d872f 1073741824" returned: 0 in 0.825s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-a4029200-a16a-4e56-8e68-109e6525c94e tempest-GroupsTest-1311975393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ed6ef234-5a2e-44b5-a9ca-0212926d872f {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:06 devstack sudo[97510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ed6ef234-5a2e-44b5-a9ca-0212926d872f Jul 08 18:46:06 devstack sudo[97510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:06 devstack sudo[97505]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-618ea675-a8ad-4096-98c3-9cbe0fdc3ca8 tempest-VolumesGetTest-918879318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-0863c560-21c8-4181-8687-2ad551a0cd4b" returned: 0 in 0.703s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:06 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-618ea675-a8ad-4096-98c3-9cbe0fdc3ca8 tempest-VolumesGetTest-918879318 None] Lock "cinder-quobyte-0863c560-21c8-4181-8687-2ad551a0cd4b" released by "delete_volume" :: held 1.524s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:46:06 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-618ea675-a8ad-4096-98c3-9cbe0fdc3ca8 tempest-VolumesGetTest-918879318 None] Created reservations ['cfbad955-df02-4981-9723-c55b898453f7', '073d491d-020c-4146-bbeb-92077a71cf24', 'fa4bb900-4617-430a-a6d0-beda965a41bd', '2ed019e6-a0a7-4e0d-812e-b2ba496625c3'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:46:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-618ea675-a8ad-4096-98c3-9cbe0fdc3ca8 tempest-VolumesGetTest-918879318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:46:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-618ea675-a8ad-4096-98c3-9cbe0fdc3ca8 tempest-VolumesGetTest-918879318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:46:06 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-618ea675-a8ad-4096-98c3-9cbe0fdc3ca8 tempest-VolumesGetTest-918879318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:46:07 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-618ea675-a8ad-4096-98c3-9cbe0fdc3ca8 tempest-VolumesGetTest-918879318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:46:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-618ea675-a8ad-4096-98c3-9cbe0fdc3ca8 tempest-VolumesGetTest-918879318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:46:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-618ea675-a8ad-4096-98c3-9cbe0fdc3ca8 tempest-VolumesGetTest-918879318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:07 devstack sudo[97513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:46:07 devstack sudo[97513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:07 devstack sudo[97510]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-a4029200-a16a-4e56-8e68-109e6525c94e tempest-GroupsTest-1311975393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ed6ef234-5a2e-44b5-a9ca-0212926d872f" returned: 0 in 0.709s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:07 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-a4029200-a16a-4e56-8e68-109e6525c94e tempest-GroupsTest-1311975393 None] <== create_volume: return (1588ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:46:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-a4029200-a16a-4e56-8e68-109e6525c94e tempest-GroupsTest-1311975393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.591s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:46:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-a4029200-a16a-4e56-8e68-109e6525c94e tempest-GroupsTest-1311975393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (150ee779-dd31-4e5e-98c5-3e50cb5af527) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed6ef234-5a2e-44b5-a9ca-0212926d872f', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-a4029200-a16a-4e56-8e68-109e6525c94e tempest-GroupsTest-1311975393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3a0ba1f-b79b-4a8e-a5d2-8e52adb5a884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:07 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-a4029200-a16a-4e56-8e68-109e6525c94e tempest-GroupsTest-1311975393 None] Volume volume-ed6ef234-5a2e-44b5-a9ca-0212926d872f (ed6ef234-5a2e-44b5-a9ca-0212926d872f): created successfully Jul 08 18:46:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-a4029200-a16a-4e56-8e68-109e6525c94e tempest-GroupsTest-1311975393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3a0ba1f-b79b-4a8e-a5d2-8e52adb5a884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-a4029200-a16a-4e56-8e68-109e6525c94e tempest-GroupsTest-1311975393 None] Flow 'volume_create_manager' (7b8fc1cf-45f5-487f-bf5d-ec4029da55b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:46:07 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-a4029200-a16a-4e56-8e68-109e6525c94e tempest-GroupsTest-1311975393 None] Created volume successfully. Jul 08 18:46:07 devstack sudo[97513]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-618ea675-a8ad-4096-98c3-9cbe0fdc3ca8 tempest-VolumesGetTest-918879318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.702s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:07 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-618ea675-a8ad-4096-98c3-9cbe0fdc3ca8 tempest-VolumesGetTest-918879318 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:46:07 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-618ea675-a8ad-4096-98c3-9cbe0fdc3ca8 tempest-VolumesGetTest-918879318 None] Deleted volume successfully. Jul 08 18:46:07 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-618ea675-a8ad-4096-98c3-9cbe0fdc3ca8 tempest-VolumesGetTest-918879318 None] Lock "cinder-0863c560-21c8-4181-8687-2ad551a0cd4b-delete_volume" released by "delete_volume" :: held 2.471s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:46:07 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-403dd2c8-4c87-4cd6-94ca-9a671c73e7db tempest-VolumesGetTest-918879318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:46:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-403dd2c8-4c87-4cd6-94ca-9a671c73e7db tempest-VolumesGetTest-918879318 None] Flow 'volume_create_manager' (150adbef-a3d3-4be3-8c46-86bd28ec99b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:46:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-403dd2c8-4c87-4cd6-94ca-9a671c73e7db tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba4c3d6f-6e64-4df2-b35d-128f3a2ff4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-403dd2c8-4c87-4cd6-94ca-9a671c73e7db tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba4c3d6f-6e64-4df2-b35d-128f3a2ff4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-453350808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99a7cb1e-a3f4-4f98-8779-ece92779bee3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d63739f7006c405dbae689336b310415',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:46:08Z,use_quota=True,user_id='e367efa8acbb469090ec3d08f284912c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-403dd2c8-4c87-4cd6-94ca-9a671c73e7db tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bea4cc64-e67c-4f7b-a33f-6a0b9df5861d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-403dd2c8-4c87-4cd6-94ca-9a671c73e7db tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bea4cc64-e67c-4f7b-a33f-6a0b9df5861d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-403dd2c8-4c87-4cd6-94ca-9a671c73e7db tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70396c58-eb9f-43a1-8684-5106b9f20126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-403dd2c8-4c87-4cd6-94ca-9a671c73e7db tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70396c58-eb9f-43a1-8684-5106b9f20126) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99a7cb1e-a3f4-4f98-8779-ece92779bee3', 'volume_name': 'volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-403dd2c8-4c87-4cd6-94ca-9a671c73e7db tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16247361-742f-47b4-9993-8187e718d9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-403dd2c8-4c87-4cd6-94ca-9a671c73e7db tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16247361-742f-47b4-9993-8187e718d9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:08 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-403dd2c8-4c87-4cd6-94ca-9a671c73e7db tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cbe3f14-4822-4dee-a4ad-1fd43294a902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:08 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-403dd2c8-4c87-4cd6-94ca-9a671c73e7db tempest-VolumesGetTest-918879318 None] Volume 99a7cb1e-a3f4-4f98-8779-ece92779bee3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3', 'volume_size': 1} Jul 08 18:46:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-403dd2c8-4c87-4cd6-94ca-9a671c73e7db tempest-VolumesGetTest-918879318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:46:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-403dd2c8-4c87-4cd6-94ca-9a671c73e7db tempest-VolumesGetTest-918879318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:46:08 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-403dd2c8-4c87-4cd6-94ca-9a671c73e7db tempest-VolumesGetTest-918879318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-453350808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99a7cb1e-a3f4-4f98-8779-ece92779bee3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d63739f7006c405dbae689336b310415',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:46:08Z,use_quota=True,user_id='e367efa8acbb469090ec3d08f284912c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:46:08 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-403dd2c8-4c87-4cd6-94ca-9a671c73e7db tempest-VolumesGetTest-918879318 None] Creating volume 99a7cb1e-a3f4-4f98-8779-ece92779bee3 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:46:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-403dd2c8-4c87-4cd6-94ca-9a671c73e7db tempest-VolumesGetTest-918879318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:46:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-403dd2c8-4c87-4cd6-94ca-9a671c73e7db tempest-VolumesGetTest-918879318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:46:08 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-403dd2c8-4c87-4cd6-94ca-9a671c73e7db tempest-VolumesGetTest-918879318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:46:08 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-403dd2c8-4c87-4cd6-94ca-9a671c73e7db tempest-VolumesGetTest-918879318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:46:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-403dd2c8-4c87-4cd6-94ca-9a671c73e7db tempest-VolumesGetTest-918879318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:46:08 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-403dd2c8-4c87-4cd6-94ca-9a671c73e7db tempest-VolumesGetTest-918879318 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:46:08 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-403dd2c8-4c87-4cd6-94ca-9a671c73e7db tempest-VolumesGetTest-918879318 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:46:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-403dd2c8-4c87-4cd6-94ca-9a671c73e7db tempest-VolumesGetTest-918879318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:08 devstack sudo[97517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3 1073741824 Jul 08 18:46:08 devstack sudo[97517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:08 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-a0cfbbfb-b572-4fa7-ae2c-17da81103cd3 tempest-GroupsTest-1311975393 None] Update group completed successfully. Jul 08 18:46:08 devstack sudo[97517]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-403dd2c8-4c87-4cd6-94ca-9a671c73e7db tempest-VolumesGetTest-918879318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3 1073741824" returned: 0 in 0.818s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-403dd2c8-4c87-4cd6-94ca-9a671c73e7db tempest-VolumesGetTest-918879318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:08 devstack sudo[97522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3 Jul 08 18:46:08 devstack sudo[97522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:09 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-42b40347-dae9-4315-a15c-202a2e13cda5 tempest-GroupsTest-1311975393 None] Update group completed successfully. Jul 08 18:46:09 devstack sudo[97522]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-403dd2c8-4c87-4cd6-94ca-9a671c73e7db tempest-VolumesGetTest-918879318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3" returned: 0 in 0.667s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:09 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-403dd2c8-4c87-4cd6-94ca-9a671c73e7db tempest-VolumesGetTest-918879318 None] <== create_volume: return (1536ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:46:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-403dd2c8-4c87-4cd6-94ca-9a671c73e7db tempest-VolumesGetTest-918879318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:46:09 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-403dd2c8-4c87-4cd6-94ca-9a671c73e7db tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cbe3f14-4822-4dee-a4ad-1fd43294a902) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:09 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-403dd2c8-4c87-4cd6-94ca-9a671c73e7db tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (401f7e39-c5a9-4ac2-98c0-22bf53e15e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:09 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-403dd2c8-4c87-4cd6-94ca-9a671c73e7db tempest-VolumesGetTest-918879318 None] Volume volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3 (99a7cb1e-a3f4-4f98-8779-ece92779bee3): created successfully Jul 08 18:46:09 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-403dd2c8-4c87-4cd6-94ca-9a671c73e7db tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (401f7e39-c5a9-4ac2-98c0-22bf53e15e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:09 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-403dd2c8-4c87-4cd6-94ca-9a671c73e7db tempest-VolumesGetTest-918879318 None] Flow 'volume_create_manager' (150adbef-a3d3-4be3-8c46-86bd28ec99b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:46:09 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-403dd2c8-4c87-4cd6-94ca-9a671c73e7db tempest-VolumesGetTest-918879318 None] Created volume successfully. Jul 08 18:46:10 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:46:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] Flow 'volume_create_manager' (432e1a6b-81bf-4c27-9fcb-47ede75fd902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:46:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4f4f878-9488-410f-8b74-cf16b3a009d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4f4f878-9488-410f-8b74-cf16b3a009d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:46:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-883200523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b2dfea8-5feb-406d-a2a4-acffd9376779,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d63739f7006c405dbae689336b310415',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:46:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=99a7cb1e-a3f4-4f98-8779-ece92779bee3,status='creating',terminated_at=None,updated_at=2026-07-08T16:46:10Z,use_quota=True,user_id='e367efa8acbb469090ec3d08f284912c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5ad58d6-5ce8-435d-ad77-dd8d63342ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5ad58d6-5ce8-435d-ad77-dd8d63342ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed033717-4b10-4c5e-a001-e4850c8f1962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed033717-4b10-4c5e-a001-e4850c8f1962) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '6b2dfea8-5feb-406d-a2a4-acffd9376779', 'volume_name': 'volume-6b2dfea8-5feb-406d-a2a4-acffd9376779', 'volume_size': 1, 'source_volid': '99a7cb1e-a3f4-4f98-8779-ece92779bee3', 'source_volstatus': 'available'}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43ce254b-5d09-46c7-934c-b3b9f3b82e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43ce254b-5d09-46c7-934c-b3b9f3b82e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f8287f7-819d-44e0-8b62-164dd3165222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:10 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] Volume 6b2dfea8-5feb-406d-a2a4-acffd9376779: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-6b2dfea8-5feb-406d-a2a4-acffd9376779', 'volume_size': 1, 'source_volid': '99a7cb1e-a3f4-4f98-8779-ece92779bee3', 'source_volstatus': 'available'} Jul 08 18:46:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:46:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:46:10 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] Cloning volume 99a7cb1e-a3f4-4f98-8779-ece92779bee3 to volume 6b2dfea8-5feb-406d-a2a4-acffd9376779 Jul 08 18:46:10 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] Creating offline snapshot d2a1c719-5db6-4d4c-b099-d94d87bb38f5 of volume 99a7cb1e-a3f4-4f98-8779-ece92779bee3 {{(pid=86873) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:46:10 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8757847-6e8b-4204-9553-6c36bf28521b]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:46:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:10 devstack sudo[97526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3 Jul 08 18:46:10 devstack sudo[97526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:11 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-bf1c1250-ff64-41e9-ae28-d56148cfca3d tempest-GroupsTest-1311975393 None] Acquiring lock "cinder-quobyte-ed6ef234-5a2e-44b5-a9ca-0212926d872f" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:46:11 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-bf1c1250-ff64-41e9-ae28-d56148cfca3d tempest-GroupsTest-1311975393 None] Lock "cinder-quobyte-ed6ef234-5a2e-44b5-a9ca-0212926d872f" acquired by "delete_volume" :: waited 0.015s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:46:11 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3251be6-39be-4a5a-8bf7-8dcc043360f6]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:46:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-bf1c1250-ff64-41e9-ae28-d56148cfca3d tempest-GroupsTest-1311975393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ed6ef234-5a2e-44b5-a9ca-0212926d872f {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:11 devstack sudo[97528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ed6ef234-5a2e-44b5-a9ca-0212926d872f Jul 08 18:46:11 devstack sudo[97528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:11 devstack sudo[97526]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3" returned: 0 in 0.848s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3.d2a1c719-5db6-4d4c-b099-d94d87bb38f5 1G {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:11 devstack sudo[97533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3.d2a1c719-5db6-4d4c-b099-d94d87bb38f5 1G Jul 08 18:46:11 devstack sudo[97533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:11 devstack sudo[97528]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-bf1c1250-ff64-41e9-ae28-d56148cfca3d tempest-GroupsTest-1311975393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ed6ef234-5a2e-44b5-a9ca-0212926d872f" returned: 0 in 0.799s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-bf1c1250-ff64-41e9-ae28-d56148cfca3d tempest-GroupsTest-1311975393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ed6ef234-5a2e-44b5-a9ca-0212926d872f {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:12 devstack sudo[97538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ed6ef234-5a2e-44b5-a9ca-0212926d872f Jul 08 18:46:12 devstack sudo[97538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:12 devstack sudo[97533]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3.d2a1c719-5db6-4d4c-b099-d94d87bb38f5 1G" returned: 0 in 0.798s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3.d2a1c719-5db6-4d4c-b099-d94d87bb38f5 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:12 devstack sudo[97544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3.d2a1c719-5db6-4d4c-b099-d94d87bb38f5 Jul 08 18:46:12 devstack sudo[97544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:12 devstack sudo[97538]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-bf1c1250-ff64-41e9-ae28-d56148cfca3d tempest-GroupsTest-1311975393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ed6ef234-5a2e-44b5-a9ca-0212926d872f" returned: 0 in 0.676s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:12 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-bf1c1250-ff64-41e9-ae28-d56148cfca3d tempest-GroupsTest-1311975393 None] Lock "cinder-quobyte-ed6ef234-5a2e-44b5-a9ca-0212926d872f" released by "delete_volume" :: held 1.529s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:46:12 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-bf1c1250-ff64-41e9-ae28-d56148cfca3d tempest-GroupsTest-1311975393 None] Acquiring lock "cinder-quobyte-fb548e5d-86da-4c76-a8a1-8a4213a984b8" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:46:12 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-bf1c1250-ff64-41e9-ae28-d56148cfca3d tempest-GroupsTest-1311975393 None] Lock "cinder-quobyte-fb548e5d-86da-4c76-a8a1-8a4213a984b8" acquired by "delete_volume" :: waited 0.019s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:46:12 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[839ca57d-e45f-481c-bbf0-498c72ac8c1d]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:46:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-bf1c1250-ff64-41e9-ae28-d56148cfca3d tempest-GroupsTest-1311975393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-fb548e5d-86da-4c76-a8a1-8a4213a984b8 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:12 devstack sudo[97547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-fb548e5d-86da-4c76-a8a1-8a4213a984b8 Jul 08 18:46:12 devstack sudo[97547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:12 devstack sudo[97544]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3.d2a1c719-5db6-4d4c-b099-d94d87bb38f5" returned: 0 in 0.707s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:12 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3.d2a1c719-5db6-4d4c-b099-d94d87bb38f5 is being set with open permissions: ugo+rw Jul 08 18:46:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3.d2a1c719-5db6-4d4c-b099-d94d87bb38f5 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:13 devstack sudo[97553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3.d2a1c719-5db6-4d4c-b099-d94d87bb38f5 Jul 08 18:46:13 devstack sudo[97553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:13 devstack sudo[97547]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-bf1c1250-ff64-41e9-ae28-d56148cfca3d tempest-GroupsTest-1311975393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-fb548e5d-86da-4c76-a8a1-8a4213a984b8" returned: 0 in 0.876s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-bf1c1250-ff64-41e9-ae28-d56148cfca3d tempest-GroupsTest-1311975393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-fb548e5d-86da-4c76-a8a1-8a4213a984b8 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:13 devstack sudo[97559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-fb548e5d-86da-4c76-a8a1-8a4213a984b8 Jul 08 18:46:13 devstack sudo[97559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:13 devstack sudo[97553]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3.d2a1c719-5db6-4d4c-b099-d94d87bb38f5" returned: 0 in 0.670s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:13 devstack sudo[97561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3.info Jul 08 18:46:13 devstack sudo[97561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:14 devstack sudo[97559]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-bf1c1250-ff64-41e9-ae28-d56148cfca3d tempest-GroupsTest-1311975393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-fb548e5d-86da-4c76-a8a1-8a4213a984b8" returned: 0 in 0.683s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:14 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-bf1c1250-ff64-41e9-ae28-d56148cfca3d tempest-GroupsTest-1311975393 None] Lock "cinder-quobyte-fb548e5d-86da-4c76-a8a1-8a4213a984b8" released by "delete_volume" :: held 1.604s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:46:14 devstack sudo[97561]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3.info" returned: 0 in 0.654s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:14 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3.info is being set with open permissions: ugo+rw Jul 08 18:46:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:14 devstack sudo[97565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3.info Jul 08 18:46:14 devstack sudo[97565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:14 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-bf1c1250-ff64-41e9-ae28-d56148cfca3d tempest-GroupsTest-1311975393 None] Created reservations ['ac6b6c59-83a4-4872-ac7a-acf114fcd284'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:46:14 devstack cinder-volume[86873]: WARNING cinder.quota [None req-bf1c1250-ff64-41e9-ae28-d56148cfca3d tempest-GroupsTest-1311975393 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1209208295 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1209208295, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:46:14 devstack cinder-volume[86873]: WARNING cinder.quota [None req-bf1c1250-ff64-41e9-ae28-d56148cfca3d tempest-GroupsTest-1311975393 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1209208295 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1209208295, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:46:14 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-bf1c1250-ff64-41e9-ae28-d56148cfca3d tempest-GroupsTest-1311975393 None] Created reservations ['0659ee7c-5035-44ea-a8c9-dcffd5ae04c2', '8b78f236-9501-4d3f-865c-a08f8c3e2371', 'a47f6563-2319-4f8e-8c1d-a11c8da42caf', '8db9d6a3-130b-49e3-94b5-f8db9ffaf458'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:46:14 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-bf1c1250-ff64-41e9-ae28-d56148cfca3d tempest-GroupsTest-1311975393 None] Created reservations ['9a44912d-4a56-427f-9858-d9f26eaa2c79', '0bde3007-485e-4691-9283-e6716dc27c3c', '3238a66c-bd10-4cfa-b445-2e99255ce895', 'd3e3497a-2b47-4d6a-9e22-43ede6c0443a'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:46:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-bf1c1250-ff64-41e9-ae28-d56148cfca3d tempest-GroupsTest-1311975393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:46:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-bf1c1250-ff64-41e9-ae28-d56148cfca3d tempest-GroupsTest-1311975393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:46:14 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-bf1c1250-ff64-41e9-ae28-d56148cfca3d tempest-GroupsTest-1311975393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:46:14 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-bf1c1250-ff64-41e9-ae28-d56148cfca3d tempest-GroupsTest-1311975393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:46:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-bf1c1250-ff64-41e9-ae28-d56148cfca3d tempest-GroupsTest-1311975393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:46:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-bf1c1250-ff64-41e9-ae28-d56148cfca3d tempest-GroupsTest-1311975393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:14 devstack sudo[97567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:46:14 devstack sudo[97567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:14 devstack sudo[97565]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3.info" returned: 0 in 0.643s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:15 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] Acquiring lock "cinder-quobyte-6b2dfea8-5feb-406d-a2a4-acffd9376779" by "_copy_volume_from_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:46:15 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] Lock "cinder-quobyte-6b2dfea8-5feb-406d-a2a4-acffd9376779" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:46:15 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] snapshot: d2a1c719-5db6-4d4c-b099-d94d87bb38f5, volume: 6b2dfea8-5feb-406d-a2a4-acffd9376779, {{(pid=86873) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 18:46:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:46:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:46:15 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:46:15 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:46:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:46:15 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54c958d-0432-426f-83af-5ae46e40dda9]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:46:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3.d2a1c719-5db6-4d4c-b099-d94d87bb38f5 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:15 devstack sudo[97570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3.d2a1c719-5db6-4d4c-b099-d94d87bb38f5 Jul 08 18:46:15 devstack sudo[97570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:15 devstack sudo[97567]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-bf1c1250-ff64-41e9-ae28-d56148cfca3d tempest-GroupsTest-1311975393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.727s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:15 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-bf1c1250-ff64-41e9-ae28-d56148cfca3d tempest-GroupsTest-1311975393 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:46:15 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-bf1c1250-ff64-41e9-ae28-d56148cfca3d tempest-GroupsTest-1311975393 None] Delete group completed successfully. Jul 08 18:46:15 devstack sudo[97570]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3.d2a1c719-5db6-4d4c-b099-d94d87bb38f5" returned: 0 in 0.843s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:15 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:46:15 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3 {{(pid=86873) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 18:46:15 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] Creating direct copy from snapshot {{(pid=86873) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 18:46:15 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[442edf24-abae-4ba1-9474-d20908533307]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:46:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:16 devstack sudo[97582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3 Jul 08 18:46:16 devstack sudo[97582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:16 devstack sudo[97582]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3" returned: 0 in 0.889s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:16 devstack cinder-volume[86873]: DEBUG cinder.utils [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] Path /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6b2dfea8-5feb-406d-a2a4-acffd9376779 not found in is_blk_device check {{(pid=86873) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 18:46:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6b2dfea8-5feb-406d-a2a4-acffd9376779 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:16 devstack sudo[97588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6b2dfea8-5feb-406d-a2a4-acffd9376779 Jul 08 18:46:16 devstack sudo[97588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:21 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-b264293e-cd60-438e-95aa-cd570191b305 tempest-GroupsV314Test-1373522334 None] Group tempest-GroupsV314Test-Group-786863438: creating Jul 08 18:46:21 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-b264293e-cd60-438e-95aa-cd570191b305 tempest-GroupsV314Test-1373522334 None] Group tempest-GroupsV314Test-Group-786863438: created successfully Jul 08 18:46:21 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-b264293e-cd60-438e-95aa-cd570191b305 tempest-GroupsV314Test-1373522334 None] Create group completed successfully. Jul 08 18:46:22 devstack sudo[97588]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6b2dfea8-5feb-406d-a2a4-acffd9376779" returned: 0 in 5.321s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:22 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8c2476-e140-4c61-9ac8-59b73440f2a7]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:46:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:22 devstack sudo[97602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3 Jul 08 18:46:22 devstack sudo[97602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:23 devstack sudo[97602]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3" returned: 0 in 0.957s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:23 devstack cinder-volume[86873]: DEBUG cinder.image.image_utils [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] Image conversion details: src /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3, size 1024.00 MB, duration 5.32 sec, destination /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6b2dfea8-5feb-406d-a2a4-acffd9376779 {{(pid=86873) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:46:23 devstack cinder-volume[86873]: INFO cinder.image.image_utils [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] Converted 1024.00 MB image at 192.41 MB/s Jul 08 18:46:23 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6b2dfea8-5feb-406d-a2a4-acffd9376779 is being set with open permissions: ugo+rw Jul 08 18:46:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6b2dfea8-5feb-406d-a2a4-acffd9376779 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:23 devstack sudo[97608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6b2dfea8-5feb-406d-a2a4-acffd9376779 Jul 08 18:46:23 devstack sudo[97608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:23 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac8941c3-b57f-4035-a1ad-c70937526812 tempest-GroupsV314Test-1373522334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:46:23 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ac8941c3-b57f-4035-a1ad-c70937526812 tempest-GroupsV314Test-1373522334 None] Flow 'volume_create_manager' (d40ed9c7-a165-4be5-ab69-b1e611e666fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:46:23 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ac8941c3-b57f-4035-a1ad-c70937526812 tempest-GroupsV314Test-1373522334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88633109-5148-4fe8-9a4c-863596b15747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:23 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ac8941c3-b57f-4035-a1ad-c70937526812 tempest-GroupsV314Test-1373522334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88633109-5148-4fe8-9a4c-863596b15747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1160369641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=10ad1a70-adfb-48fa-8d2a-af6151f82a12,host='devstack@QuobyteHD#QuobyteHD',id=496249c6-8e75-4f5e-a444-9201c5360a52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7e03f59be72466da0eafde8cb2f44b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:46:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:46:23Z,use_quota=True,user_id='61d807e2c8c64a118e052300310eb9c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3169ba4-ed0f-4ef6-a8e4-102df21e460b),volume_type_id=c3169ba4-ed0f-4ef6-a8e4-102df21e460b)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:23 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ac8941c3-b57f-4035-a1ad-c70937526812 tempest-GroupsV314Test-1373522334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (271e29c1-b5ac-4858-8c92-3a53a2a3a323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:23 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ac8941c3-b57f-4035-a1ad-c70937526812 tempest-GroupsV314Test-1373522334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (271e29c1-b5ac-4858-8c92-3a53a2a3a323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:23 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ac8941c3-b57f-4035-a1ad-c70937526812 tempest-GroupsV314Test-1373522334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e714ae5-d2b0-44a3-8786-249c536add75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:23 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ac8941c3-b57f-4035-a1ad-c70937526812 tempest-GroupsV314Test-1373522334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e714ae5-d2b0-44a3-8786-249c536add75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '496249c6-8e75-4f5e-a444-9201c5360a52', 'volume_name': 'volume-496249c6-8e75-4f5e-a444-9201c5360a52', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:23 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ac8941c3-b57f-4035-a1ad-c70937526812 tempest-GroupsV314Test-1373522334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (967a8f8a-b853-444b-bb28-09b5e9460aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:23 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ac8941c3-b57f-4035-a1ad-c70937526812 tempest-GroupsV314Test-1373522334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (967a8f8a-b853-444b-bb28-09b5e9460aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:23 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ac8941c3-b57f-4035-a1ad-c70937526812 tempest-GroupsV314Test-1373522334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bc12e8d-f659-49cb-bbf9-41666689f6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:23 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-ac8941c3-b57f-4035-a1ad-c70937526812 tempest-GroupsV314Test-1373522334 None] Volume 496249c6-8e75-4f5e-a444-9201c5360a52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-496249c6-8e75-4f5e-a444-9201c5360a52', 'volume_size': 1} Jul 08 18:46:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-ac8941c3-b57f-4035-a1ad-c70937526812 tempest-GroupsV314Test-1373522334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:46:23 devstack sudo[97608]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6b2dfea8-5feb-406d-a2a4-acffd9376779" returned: 0 in 0.642s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:23 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] Lock "cinder-quobyte-6b2dfea8-5feb-406d-a2a4-acffd9376779" released by "_copy_volume_from_snapshot" :: held 8.746s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:46:23 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] Acquiring lock "cinder-quobyte-d2a1c719-5db6-4d4c-b099-d94d87bb38f5" by "_delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:46:23 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] Lock "cinder-quobyte-d2a1c719-5db6-4d4c-b099-d94d87bb38f5" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:46:23 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] Deleting offline snapshot d2a1c719-5db6-4d4c-b099-d94d87bb38f5 of volume 99a7cb1e-a3f4-4f98-8779-ece92779bee3 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:46:23 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] snapshot_file for this snap is: volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3.d2a1c719-5db6-4d4c-b099-d94d87bb38f5 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:46:23 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5a5878-bf01-470e-9740-b797c82156f1]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:46:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3.d2a1c719-5db6-4d4c-b099-d94d87bb38f5 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:23 devstack sudo[97611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3.d2a1c719-5db6-4d4c-b099-d94d87bb38f5 Jul 08 18:46:23 devstack sudo[97611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:24 devstack sudo[97611]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3.d2a1c719-5db6-4d4c-b099-d94d87bb38f5" returned: 0 in 0.798s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:24 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:46:24 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[45df0b0c-7feb-4602-a043-781be9cbb9ed]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:46:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:24 devstack sudo[97616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3 Jul 08 18:46:24 devstack sudo[97616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:25 devstack sudo[97616]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3" returned: 0 in 0.738s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3.d2a1c719-5db6-4d4c-b099-d94d87bb38f5 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:25 devstack sudo[97621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3.d2a1c719-5db6-4d4c-b099-d94d87bb38f5 Jul 08 18:46:25 devstack sudo[97621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:26 devstack sudo[97621]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3.d2a1c719-5db6-4d4c-b099-d94d87bb38f5" returned: 0 in 0.726s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3.d2a1c719-5db6-4d4c-b099-d94d87bb38f5 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:26 devstack sudo[97626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3.d2a1c719-5db6-4d4c-b099-d94d87bb38f5 Jul 08 18:46:26 devstack sudo[97626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:26 devstack sudo[97626]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3.d2a1c719-5db6-4d4c-b099-d94d87bb38f5" returned: 0 in 0.643s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:26 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] Lock "cinder-quobyte-d2a1c719-5db6-4d4c-b099-d94d87bb38f5" released by "_delete_snapshot" :: held 2.995s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:46:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.258s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:46:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-ac8941c3-b57f-4035-a1ad-c70937526812 tempest-GroupsV314Test-1373522334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.406s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:46:26 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-ac8941c3-b57f-4035-a1ad-c70937526812 tempest-GroupsV314Test-1373522334 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=10ad1a70-adfb-48fa-8d2a-af6151f82a12,created_at=2026-07-08T16:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1160369641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=10ad1a70-adfb-48fa-8d2a-af6151f82a12,host='devstack@QuobyteHD#QuobyteHD',id=496249c6-8e75-4f5e-a444-9201c5360a52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7e03f59be72466da0eafde8cb2f44b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:46:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:46:23Z,use_quota=True,user_id='61d807e2c8c64a118e052300310eb9c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3169ba4-ed0f-4ef6-a8e4-102df21e460b),volume_type_id=c3169ba4-ed0f-4ef6-a8e4-102df21e460b)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:46:26 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-ac8941c3-b57f-4035-a1ad-c70937526812 tempest-GroupsV314Test-1373522334 None] Creating volume 496249c6-8e75-4f5e-a444-9201c5360a52 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:46:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-ac8941c3-b57f-4035-a1ad-c70937526812 tempest-GroupsV314Test-1373522334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:46:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-ac8941c3-b57f-4035-a1ad-c70937526812 tempest-GroupsV314Test-1373522334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:46:26 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-ac8941c3-b57f-4035-a1ad-c70937526812 tempest-GroupsV314Test-1373522334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:46:26 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-ac8941c3-b57f-4035-a1ad-c70937526812 tempest-GroupsV314Test-1373522334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:46:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-ac8941c3-b57f-4035-a1ad-c70937526812 tempest-GroupsV314Test-1373522334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:46:26 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-ac8941c3-b57f-4035-a1ad-c70937526812 tempest-GroupsV314Test-1373522334 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:46:26 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-ac8941c3-b57f-4035-a1ad-c70937526812 tempest-GroupsV314Test-1373522334 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:46:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ac8941c3-b57f-4035-a1ad-c70937526812 tempest-GroupsV314Test-1373522334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-496249c6-8e75-4f5e-a444-9201c5360a52 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:26 devstack sudo[97629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-496249c6-8e75-4f5e-a444-9201c5360a52 1073741824 Jul 08 18:46:26 devstack sudo[97629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:26 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f8287f7-819d-44e0-8b62-164dd3165222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b2dfea8-5feb-406d-a2a4-acffd9376779', 'volume_size': 1, 'source_volid': '99a7cb1e-a3f4-4f98-8779-ece92779bee3', 'source_volstatus': 'available'}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:26 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (558e76f3-d119-452c-81a6-37a0cb25768f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:26 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] Volume volume-6b2dfea8-5feb-406d-a2a4-acffd9376779 (6b2dfea8-5feb-406d-a2a4-acffd9376779): created successfully Jul 08 18:46:26 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (558e76f3-d119-452c-81a6-37a0cb25768f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:26 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] Flow 'volume_create_manager' (432e1a6b-81bf-4c27-9fcb-47ede75fd902) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:46:26 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-5a26f479-ea5b-4db8-bf38-7ccbc57a2252 tempest-VolumesGetTest-918879318 None] Created volume successfully. Jul 08 18:46:27 devstack sudo[97629]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ac8941c3-b57f-4035-a1ad-c70937526812 tempest-GroupsV314Test-1373522334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-496249c6-8e75-4f5e-a444-9201c5360a52 1073741824" returned: 0 in 0.816s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ac8941c3-b57f-4035-a1ad-c70937526812 tempest-GroupsV314Test-1373522334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-496249c6-8e75-4f5e-a444-9201c5360a52 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:27 devstack sudo[97635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-496249c6-8e75-4f5e-a444-9201c5360a52 Jul 08 18:46:27 devstack sudo[97635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:28 devstack sudo[97635]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ac8941c3-b57f-4035-a1ad-c70937526812 tempest-GroupsV314Test-1373522334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-496249c6-8e75-4f5e-a444-9201c5360a52" returned: 0 in 0.662s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:28 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-ac8941c3-b57f-4035-a1ad-c70937526812 tempest-GroupsV314Test-1373522334 None] <== create_volume: return (1517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:46:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-ac8941c3-b57f-4035-a1ad-c70937526812 tempest-GroupsV314Test-1373522334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.520s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:46:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ac8941c3-b57f-4035-a1ad-c70937526812 tempest-GroupsV314Test-1373522334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bc12e8d-f659-49cb-bbf9-41666689f6a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-496249c6-8e75-4f5e-a444-9201c5360a52', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ac8941c3-b57f-4035-a1ad-c70937526812 tempest-GroupsV314Test-1373522334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09844ed8-6d6f-438b-9dec-d25cb8e35c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:28 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-ac8941c3-b57f-4035-a1ad-c70937526812 tempest-GroupsV314Test-1373522334 None] Volume volume-496249c6-8e75-4f5e-a444-9201c5360a52 (496249c6-8e75-4f5e-a444-9201c5360a52): created successfully Jul 08 18:46:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ac8941c3-b57f-4035-a1ad-c70937526812 tempest-GroupsV314Test-1373522334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09844ed8-6d6f-438b-9dec-d25cb8e35c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ac8941c3-b57f-4035-a1ad-c70937526812 tempest-GroupsV314Test-1373522334 None] Flow 'volume_create_manager' (d40ed9c7-a165-4be5-ab69-b1e611e666fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:46:28 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-ac8941c3-b57f-4035-a1ad-c70937526812 tempest-GroupsV314Test-1373522334 None] Created volume successfully. Jul 08 18:46:28 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-faed84e5-2b0f-4815-90b3-92e8bcd34807 tempest-VolumesGetTest-918879318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:46:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-faed84e5-2b0f-4815-90b3-92e8bcd34807 tempest-VolumesGetTest-918879318 None] Flow 'volume_create_manager' (34d4c891-74c7-4539-ba14-dd3a509a0c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:46:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-faed84e5-2b0f-4815-90b3-92e8bcd34807 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (278db660-87e3-4bee-8798-1bd600d16205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-faed84e5-2b0f-4815-90b3-92e8bcd34807 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (278db660-87e3-4bee-8798-1bd600d16205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:46:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-612655056',display_name='tempest-VolumesGetTest-Volume-811498099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d66a2aa6-106e-4752-b959-563104dd1609,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d63739f7006c405dbae689336b310415',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:46:28Z,use_quota=True,user_id='e367efa8acbb469090ec3d08f284912c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-faed84e5-2b0f-4815-90b3-92e8bcd34807 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea90a04c-2192-4b85-8baa-c2e6c1039d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-faed84e5-2b0f-4815-90b3-92e8bcd34807 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea90a04c-2192-4b85-8baa-c2e6c1039d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-faed84e5-2b0f-4815-90b3-92e8bcd34807 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cdcbeef-5600-43ae-b2f3-a6d25cf84480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-faed84e5-2b0f-4815-90b3-92e8bcd34807 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cdcbeef-5600-43ae-b2f3-a6d25cf84480) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd66a2aa6-106e-4752-b959-563104dd1609', 'volume_name': 'volume-d66a2aa6-106e-4752-b959-563104dd1609', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-faed84e5-2b0f-4815-90b3-92e8bcd34807 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddcac257-8988-4d1f-8d0b-c661455ca3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-faed84e5-2b0f-4815-90b3-92e8bcd34807 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddcac257-8988-4d1f-8d0b-c661455ca3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-faed84e5-2b0f-4815-90b3-92e8bcd34807 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35027159-2b56-4b2f-9512-0e9014c43ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:28 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-faed84e5-2b0f-4815-90b3-92e8bcd34807 tempest-VolumesGetTest-918879318 None] Volume d66a2aa6-106e-4752-b959-563104dd1609: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d66a2aa6-106e-4752-b959-563104dd1609', 'volume_size': 1} Jul 08 18:46:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-faed84e5-2b0f-4815-90b3-92e8bcd34807 tempest-VolumesGetTest-918879318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:46:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-faed84e5-2b0f-4815-90b3-92e8bcd34807 tempest-VolumesGetTest-918879318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:46:28 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-faed84e5-2b0f-4815-90b3-92e8bcd34807 tempest-VolumesGetTest-918879318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:46:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-612655056',display_name='tempest-VolumesGetTest-Volume-811498099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d66a2aa6-106e-4752-b959-563104dd1609,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d63739f7006c405dbae689336b310415',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:46:28Z,use_quota=True,user_id='e367efa8acbb469090ec3d08f284912c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:46:28 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-faed84e5-2b0f-4815-90b3-92e8bcd34807 tempest-VolumesGetTest-918879318 None] Creating volume d66a2aa6-106e-4752-b959-563104dd1609 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:46:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-faed84e5-2b0f-4815-90b3-92e8bcd34807 tempest-VolumesGetTest-918879318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:46:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-faed84e5-2b0f-4815-90b3-92e8bcd34807 tempest-VolumesGetTest-918879318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:46:28 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-faed84e5-2b0f-4815-90b3-92e8bcd34807 tempest-VolumesGetTest-918879318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:46:28 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-faed84e5-2b0f-4815-90b3-92e8bcd34807 tempest-VolumesGetTest-918879318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:46:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-faed84e5-2b0f-4815-90b3-92e8bcd34807 tempest-VolumesGetTest-918879318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:46:28 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-faed84e5-2b0f-4815-90b3-92e8bcd34807 tempest-VolumesGetTest-918879318 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:46:28 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-faed84e5-2b0f-4815-90b3-92e8bcd34807 tempest-VolumesGetTest-918879318 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:46:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-faed84e5-2b0f-4815-90b3-92e8bcd34807 tempest-VolumesGetTest-918879318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d66a2aa6-106e-4752-b959-563104dd1609 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:28 devstack sudo[97638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d66a2aa6-106e-4752-b959-563104dd1609 1073741824 Jul 08 18:46:28 devstack sudo[97638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:29 devstack sudo[97638]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-faed84e5-2b0f-4815-90b3-92e8bcd34807 tempest-VolumesGetTest-918879318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d66a2aa6-106e-4752-b959-563104dd1609 1073741824" returned: 0 in 0.840s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-faed84e5-2b0f-4815-90b3-92e8bcd34807 tempest-VolumesGetTest-918879318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d66a2aa6-106e-4752-b959-563104dd1609 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:29 devstack sudo[97643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d66a2aa6-106e-4752-b959-563104dd1609 Jul 08 18:46:29 devstack sudo[97643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:30 devstack sudo[97643]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-faed84e5-2b0f-4815-90b3-92e8bcd34807 tempest-VolumesGetTest-918879318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d66a2aa6-106e-4752-b959-563104dd1609" returned: 0 in 0.642s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:30 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-faed84e5-2b0f-4815-90b3-92e8bcd34807 tempest-VolumesGetTest-918879318 None] <== create_volume: return (1523ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:46:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-faed84e5-2b0f-4815-90b3-92e8bcd34807 tempest-VolumesGetTest-918879318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.526s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:46:30 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-faed84e5-2b0f-4815-90b3-92e8bcd34807 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35027159-2b56-4b2f-9512-0e9014c43ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d66a2aa6-106e-4752-b959-563104dd1609', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:30 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-faed84e5-2b0f-4815-90b3-92e8bcd34807 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2c0a41e-b062-4c43-af64-0ed0df61b9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:30 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-faed84e5-2b0f-4815-90b3-92e8bcd34807 tempest-VolumesGetTest-918879318 None] Volume volume-d66a2aa6-106e-4752-b959-563104dd1609 (d66a2aa6-106e-4752-b959-563104dd1609): created successfully Jul 08 18:46:30 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-faed84e5-2b0f-4815-90b3-92e8bcd34807 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2c0a41e-b062-4c43-af64-0ed0df61b9e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:30 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-faed84e5-2b0f-4815-90b3-92e8bcd34807 tempest-VolumesGetTest-918879318 None] Flow 'volume_create_manager' (34d4c891-74c7-4539-ba14-dd3a509a0c48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:46:30 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-faed84e5-2b0f-4815-90b3-92e8bcd34807 tempest-VolumesGetTest-918879318 None] Created volume successfully. Jul 08 18:46:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-66d2eba8-fb17-4b28-bddb-7c545203f433 tempest-GroupsV314Test-1373522334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:46:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-66d2eba8-fb17-4b28-bddb-7c545203f433 tempest-GroupsV314Test-1373522334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:46:30 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-66d2eba8-fb17-4b28-bddb-7c545203f433 tempest-GroupsV314Test-1373522334 None] Cloning volume 496249c6-8e75-4f5e-a444-9201c5360a52 to volume fdb51c3d-b380-469f-afcb-649b7d72b78e Jul 08 18:46:30 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-66d2eba8-fb17-4b28-bddb-7c545203f433 tempest-GroupsV314Test-1373522334 None] Creating offline snapshot fb503f55-bd8e-407c-8457-8bff5fc3a139 of volume 496249c6-8e75-4f5e-a444-9201c5360a52 {{(pid=86873) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:46:30 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[108a2817-bc48-4f36-8bff-a19c7dc47f72]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:46:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-66d2eba8-fb17-4b28-bddb-7c545203f433 tempest-GroupsV314Test-1373522334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-496249c6-8e75-4f5e-a444-9201c5360a52 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:30 devstack sudo[97646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-496249c6-8e75-4f5e-a444-9201c5360a52 Jul 08 18:46:30 devstack sudo[97646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:30 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-4927805a-87a7-41fd-a9e3-7b9bda61b0ca tempest-VolumesGetTest-918879318 None] Acquiring lock "cinder-d66a2aa6-106e-4752-b959-563104dd1609-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:46:30 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-4927805a-87a7-41fd-a9e3-7b9bda61b0ca tempest-VolumesGetTest-918879318 None] Lock "cinder-d66a2aa6-106e-4752-b959-563104dd1609-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:46:30 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-4927805a-87a7-41fd-a9e3-7b9bda61b0ca tempest-VolumesGetTest-918879318 None] Acquiring lock "cinder-quobyte-d66a2aa6-106e-4752-b959-563104dd1609" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:46:30 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-4927805a-87a7-41fd-a9e3-7b9bda61b0ca tempest-VolumesGetTest-918879318 None] Lock "cinder-quobyte-d66a2aa6-106e-4752-b959-563104dd1609" acquired by "delete_volume" :: waited 0.022s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:46:30 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[635ad3f6-8a3f-4349-a51b-ff05bf1669a9]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:46:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-4927805a-87a7-41fd-a9e3-7b9bda61b0ca tempest-VolumesGetTest-918879318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d66a2aa6-106e-4752-b959-563104dd1609 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:30 devstack sudo[97648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d66a2aa6-106e-4752-b959-563104dd1609 Jul 08 18:46:30 devstack sudo[97648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:31 devstack sudo[97646]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-66d2eba8-fb17-4b28-bddb-7c545203f433 tempest-GroupsV314Test-1373522334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-496249c6-8e75-4f5e-a444-9201c5360a52" returned: 0 in 0.780s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-66d2eba8-fb17-4b28-bddb-7c545203f433 tempest-GroupsV314Test-1373522334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-496249c6-8e75-4f5e-a444-9201c5360a52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-496249c6-8e75-4f5e-a444-9201c5360a52.fb503f55-bd8e-407c-8457-8bff5fc3a139 1G {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:31 devstack sudo[97653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-496249c6-8e75-4f5e-a444-9201c5360a52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-496249c6-8e75-4f5e-a444-9201c5360a52.fb503f55-bd8e-407c-8457-8bff5fc3a139 1G Jul 08 18:46:31 devstack sudo[97653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:31 devstack sudo[97648]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-4927805a-87a7-41fd-a9e3-7b9bda61b0ca tempest-VolumesGetTest-918879318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d66a2aa6-106e-4752-b959-563104dd1609" returned: 0 in 0.762s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-4927805a-87a7-41fd-a9e3-7b9bda61b0ca tempest-VolumesGetTest-918879318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d66a2aa6-106e-4752-b959-563104dd1609 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:31 devstack sudo[97661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d66a2aa6-106e-4752-b959-563104dd1609 Jul 08 18:46:31 devstack sudo[97661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:31 devstack sudo[97653]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-66d2eba8-fb17-4b28-bddb-7c545203f433 tempest-GroupsV314Test-1373522334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-496249c6-8e75-4f5e-a444-9201c5360a52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-496249c6-8e75-4f5e-a444-9201c5360a52.fb503f55-bd8e-407c-8457-8bff5fc3a139 1G" returned: 0 in 0.853s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-66d2eba8-fb17-4b28-bddb-7c545203f433 tempest-GroupsV314Test-1373522334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-496249c6-8e75-4f5e-a444-9201c5360a52 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-496249c6-8e75-4f5e-a444-9201c5360a52.fb503f55-bd8e-407c-8457-8bff5fc3a139 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:31 devstack sudo[97664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-496249c6-8e75-4f5e-a444-9201c5360a52 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-496249c6-8e75-4f5e-a444-9201c5360a52.fb503f55-bd8e-407c-8457-8bff5fc3a139 Jul 08 18:46:31 devstack sudo[97664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:32 devstack sudo[97661]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:32 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-4927805a-87a7-41fd-a9e3-7b9bda61b0ca tempest-VolumesGetTest-918879318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d66a2aa6-106e-4752-b959-563104dd1609" returned: 0 in 0.675s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:32 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-4927805a-87a7-41fd-a9e3-7b9bda61b0ca tempest-VolumesGetTest-918879318 None] Lock "cinder-quobyte-d66a2aa6-106e-4752-b959-563104dd1609" released by "delete_volume" :: held 1.490s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:46:32 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-4927805a-87a7-41fd-a9e3-7b9bda61b0ca tempest-VolumesGetTest-918879318 None] Created reservations ['60c69709-fd78-44b5-a45a-a60b3ef2a627', 'd4baf8c9-7071-47a2-9f78-6d006005c5b6', 'eb9ff2d8-4aad-448d-a904-2d80690abe88', '6033aca8-3029-4f06-8179-20e127977174'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:46:32 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-4927805a-87a7-41fd-a9e3-7b9bda61b0ca tempest-VolumesGetTest-918879318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:46:32 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-4927805a-87a7-41fd-a9e3-7b9bda61b0ca tempest-VolumesGetTest-918879318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:46:32 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-4927805a-87a7-41fd-a9e3-7b9bda61b0ca tempest-VolumesGetTest-918879318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:46:32 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-4927805a-87a7-41fd-a9e3-7b9bda61b0ca tempest-VolumesGetTest-918879318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:46:32 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-4927805a-87a7-41fd-a9e3-7b9bda61b0ca tempest-VolumesGetTest-918879318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:46:32 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-4927805a-87a7-41fd-a9e3-7b9bda61b0ca tempest-VolumesGetTest-918879318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:32 devstack sudo[97668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:46:32 devstack sudo[97668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:32 devstack sudo[97664]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:32 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-66d2eba8-fb17-4b28-bddb-7c545203f433 tempest-GroupsV314Test-1373522334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-496249c6-8e75-4f5e-a444-9201c5360a52 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-496249c6-8e75-4f5e-a444-9201c5360a52.fb503f55-bd8e-407c-8457-8bff5fc3a139" returned: 0 in 0.703s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:32 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-66d2eba8-fb17-4b28-bddb-7c545203f433 tempest-GroupsV314Test-1373522334 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-496249c6-8e75-4f5e-a444-9201c5360a52.fb503f55-bd8e-407c-8457-8bff5fc3a139 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 18:46:32 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-66d2eba8-fb17-4b28-bddb-7c545203f433 tempest-GroupsV314Test-1373522334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-496249c6-8e75-4f5e-a444-9201c5360a52.fb503f55-bd8e-407c-8457-8bff5fc3a139 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:32 devstack sudo[97674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-496249c6-8e75-4f5e-a444-9201c5360a52.fb503f55-bd8e-407c-8457-8bff5fc3a139 Jul 08 18:46:32 devstack sudo[97674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:33 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-1562dd8d-a144-48b1-a0de-9507ba2e1c81 tempest-VolumesGetTest-918879318 None] Acquiring lock "cinder-6b2dfea8-5feb-406d-a2a4-acffd9376779-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:46:33 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-1562dd8d-a144-48b1-a0de-9507ba2e1c81 tempest-VolumesGetTest-918879318 None] Lock "cinder-6b2dfea8-5feb-406d-a2a4-acffd9376779-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:46:33 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-1562dd8d-a144-48b1-a0de-9507ba2e1c81 tempest-VolumesGetTest-918879318 None] Acquiring lock "cinder-quobyte-6b2dfea8-5feb-406d-a2a4-acffd9376779" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:46:33 devstack sudo[97668]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-4927805a-87a7-41fd-a9e3-7b9bda61b0ca tempest-VolumesGetTest-918879318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.696s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:33 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-4927805a-87a7-41fd-a9e3-7b9bda61b0ca tempest-VolumesGetTest-918879318 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:46:33 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-1562dd8d-a144-48b1-a0de-9507ba2e1c81 tempest-VolumesGetTest-918879318 None] Lock "cinder-quobyte-6b2dfea8-5feb-406d-a2a4-acffd9376779" acquired by "delete_volume" :: waited 0.018s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:46:33 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-4927805a-87a7-41fd-a9e3-7b9bda61b0ca tempest-VolumesGetTest-918879318 None] Deleted volume successfully. Jul 08 18:46:33 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-4927805a-87a7-41fd-a9e3-7b9bda61b0ca tempest-VolumesGetTest-918879318 None] Lock "cinder-d66a2aa6-106e-4752-b959-563104dd1609-delete_volume" released by "delete_volume" :: held 2.412s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:46:33 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c2f5fc-d315-47f9-b1b5-0dfee0bb8741]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:46:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1562dd8d-a144-48b1-a0de-9507ba2e1c81 tempest-VolumesGetTest-918879318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6b2dfea8-5feb-406d-a2a4-acffd9376779 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:33 devstack sudo[97677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6b2dfea8-5feb-406d-a2a4-acffd9376779 Jul 08 18:46:33 devstack sudo[97677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:33 devstack sudo[97674]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-66d2eba8-fb17-4b28-bddb-7c545203f433 tempest-GroupsV314Test-1373522334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-496249c6-8e75-4f5e-a444-9201c5360a52.fb503f55-bd8e-407c-8457-8bff5fc3a139" returned: 0 in 0.711s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-66d2eba8-fb17-4b28-bddb-7c545203f433 tempest-GroupsV314Test-1373522334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-496249c6-8e75-4f5e-a444-9201c5360a52.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:33 devstack sudo[97680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-496249c6-8e75-4f5e-a444-9201c5360a52.info Jul 08 18:46:33 devstack sudo[97680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:33 devstack sudo[97677]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1562dd8d-a144-48b1-a0de-9507ba2e1c81 tempest-VolumesGetTest-918879318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6b2dfea8-5feb-406d-a2a4-acffd9376779" returned: 0 in 0.791s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1562dd8d-a144-48b1-a0de-9507ba2e1c81 tempest-VolumesGetTest-918879318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6b2dfea8-5feb-406d-a2a4-acffd9376779 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:33 devstack sudo[97686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6b2dfea8-5feb-406d-a2a4-acffd9376779 Jul 08 18:46:33 devstack sudo[97686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:34 devstack sudo[97680]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-66d2eba8-fb17-4b28-bddb-7c545203f433 tempest-GroupsV314Test-1373522334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-496249c6-8e75-4f5e-a444-9201c5360a52.info" returned: 0 in 0.667s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:34 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-66d2eba8-fb17-4b28-bddb-7c545203f433 tempest-GroupsV314Test-1373522334 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-496249c6-8e75-4f5e-a444-9201c5360a52.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 18:46:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-66d2eba8-fb17-4b28-bddb-7c545203f433 tempest-GroupsV314Test-1373522334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-496249c6-8e75-4f5e-a444-9201c5360a52.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:34 devstack sudo[97688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-496249c6-8e75-4f5e-a444-9201c5360a52.info Jul 08 18:46:34 devstack sudo[97688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:34 devstack sudo[97686]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1562dd8d-a144-48b1-a0de-9507ba2e1c81 tempest-VolumesGetTest-918879318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6b2dfea8-5feb-406d-a2a4-acffd9376779" returned: 0 in 0.659s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:34 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-1562dd8d-a144-48b1-a0de-9507ba2e1c81 tempest-VolumesGetTest-918879318 None] Lock "cinder-quobyte-6b2dfea8-5feb-406d-a2a4-acffd9376779" released by "delete_volume" :: held 1.505s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:46:34 devstack sudo[97688]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:34 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-1562dd8d-a144-48b1-a0de-9507ba2e1c81 tempest-VolumesGetTest-918879318 None] Created reservations ['0949b94b-2bfc-4c3f-b075-a60ad7696371', 'a52f9601-7e3c-4fc1-868d-5a8d0b071016', '55652bdf-f261-4c64-befc-ab123310b0d3', '170fc60f-a617-411d-86df-7d611cace18b'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:46:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-66d2eba8-fb17-4b28-bddb-7c545203f433 tempest-GroupsV314Test-1373522334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-496249c6-8e75-4f5e-a444-9201c5360a52.info" returned: 0 in 0.649s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:34 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-66d2eba8-fb17-4b28-bddb-7c545203f433 tempest-GroupsV314Test-1373522334 None] Acquiring lock "cinder-quobyte-fdb51c3d-b380-469f-afcb-649b7d72b78e" by "_copy_volume_from_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:46:34 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-66d2eba8-fb17-4b28-bddb-7c545203f433 tempest-GroupsV314Test-1373522334 None] Lock "cinder-quobyte-fdb51c3d-b380-469f-afcb-649b7d72b78e" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:46:34 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-66d2eba8-fb17-4b28-bddb-7c545203f433 tempest-GroupsV314Test-1373522334 None] snapshot: fb503f55-bd8e-407c-8457-8bff5fc3a139, volume: fdb51c3d-b380-469f-afcb-649b7d72b78e, {{(pid=86873) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 18:46:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-66d2eba8-fb17-4b28-bddb-7c545203f433 tempest-GroupsV314Test-1373522334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:46:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-66d2eba8-fb17-4b28-bddb-7c545203f433 tempest-GroupsV314Test-1373522334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:46:34 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-66d2eba8-fb17-4b28-bddb-7c545203f433 tempest-GroupsV314Test-1373522334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:46:34 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-66d2eba8-fb17-4b28-bddb-7c545203f433 tempest-GroupsV314Test-1373522334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:46:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-66d2eba8-fb17-4b28-bddb-7c545203f433 tempest-GroupsV314Test-1373522334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:46:34 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e71b0d-8573-4fcc-a7f9-9475c61eac6b]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:46:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-66d2eba8-fb17-4b28-bddb-7c545203f433 tempest-GroupsV314Test-1373522334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-496249c6-8e75-4f5e-a444-9201c5360a52.fb503f55-bd8e-407c-8457-8bff5fc3a139 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1562dd8d-a144-48b1-a0de-9507ba2e1c81 tempest-VolumesGetTest-918879318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:46:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1562dd8d-a144-48b1-a0de-9507ba2e1c81 tempest-VolumesGetTest-918879318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:46:34 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-1562dd8d-a144-48b1-a0de-9507ba2e1c81 tempest-VolumesGetTest-918879318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:46:34 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-1562dd8d-a144-48b1-a0de-9507ba2e1c81 tempest-VolumesGetTest-918879318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:46:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1562dd8d-a144-48b1-a0de-9507ba2e1c81 tempest-VolumesGetTest-918879318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:46:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1562dd8d-a144-48b1-a0de-9507ba2e1c81 tempest-VolumesGetTest-918879318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:34 devstack sudo[97693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:46:34 devstack sudo[97693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:34 devstack sudo[97692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-496249c6-8e75-4f5e-a444-9201c5360a52.fb503f55-bd8e-407c-8457-8bff5fc3a139 Jul 08 18:46:34 devstack sudo[97692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:35 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6e9b368b-a10e-4e12-8a11-fad57a334f75 tempest-VolumesGetTest-918879318 None] Acquiring lock "cinder-99a7cb1e-a3f4-4f98-8779-ece92779bee3-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:46:35 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6e9b368b-a10e-4e12-8a11-fad57a334f75 tempest-VolumesGetTest-918879318 None] Lock "cinder-99a7cb1e-a3f4-4f98-8779-ece92779bee3-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:46:35 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6e9b368b-a10e-4e12-8a11-fad57a334f75 tempest-VolumesGetTest-918879318 None] Acquiring lock "cinder-quobyte-99a7cb1e-a3f4-4f98-8779-ece92779bee3" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:46:35 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6e9b368b-a10e-4e12-8a11-fad57a334f75 tempest-VolumesGetTest-918879318 None] Lock "cinder-quobyte-99a7cb1e-a3f4-4f98-8779-ece92779bee3" acquired by "delete_volume" :: waited 0.018s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:46:35 devstack sudo[97693]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1562dd8d-a144-48b1-a0de-9507ba2e1c81 tempest-VolumesGetTest-918879318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.688s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:35 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-1562dd8d-a144-48b1-a0de-9507ba2e1c81 tempest-VolumesGetTest-918879318 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:46:35 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-1562dd8d-a144-48b1-a0de-9507ba2e1c81 tempest-VolumesGetTest-918879318 None] Deleted volume successfully. Jul 08 18:46:35 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b09043f-4247-4c28-a1ab-a4c4a08fe9e4]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:46:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6e9b368b-a10e-4e12-8a11-fad57a334f75 tempest-VolumesGetTest-918879318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:35 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-1562dd8d-a144-48b1-a0de-9507ba2e1c81 tempest-VolumesGetTest-918879318 None] Lock "cinder-6b2dfea8-5feb-406d-a2a4-acffd9376779-delete_volume" released by "delete_volume" :: held 2.475s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:46:35 devstack sudo[97692]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-66d2eba8-fb17-4b28-bddb-7c545203f433 tempest-GroupsV314Test-1373522334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-496249c6-8e75-4f5e-a444-9201c5360a52.fb503f55-bd8e-407c-8457-8bff5fc3a139" returned: 0 in 0.813s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:35 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-66d2eba8-fb17-4b28-bddb-7c545203f433 tempest-GroupsV314Test-1373522334 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-496249c6-8e75-4f5e-a444-9201c5360a52(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:46:35 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-66d2eba8-fb17-4b28-bddb-7c545203f433 tempest-GroupsV314Test-1373522334 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-496249c6-8e75-4f5e-a444-9201c5360a52 {{(pid=86873) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 18:46:35 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-66d2eba8-fb17-4b28-bddb-7c545203f433 tempest-GroupsV314Test-1373522334 None] Creating direct copy from snapshot {{(pid=86873) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 18:46:35 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[08fffd35-72f6-4387-8b7f-8c7cc9349305]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:46:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-66d2eba8-fb17-4b28-bddb-7c545203f433 tempest-GroupsV314Test-1373522334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-496249c6-8e75-4f5e-a444-9201c5360a52 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:35 devstack sudo[97705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3 Jul 08 18:46:35 devstack sudo[97705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:35 devstack sudo[97706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-496249c6-8e75-4f5e-a444-9201c5360a52 Jul 08 18:46:35 devstack sudo[97706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:36 devstack sudo[97705]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6e9b368b-a10e-4e12-8a11-fad57a334f75 tempest-VolumesGetTest-918879318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3" returned: 0 in 0.782s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6e9b368b-a10e-4e12-8a11-fad57a334f75 tempest-VolumesGetTest-918879318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:36 devstack sudo[97715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3 Jul 08 18:46:36 devstack sudo[97715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:36 devstack sudo[97706]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-66d2eba8-fb17-4b28-bddb-7c545203f433 tempest-GroupsV314Test-1373522334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-496249c6-8e75-4f5e-a444-9201c5360a52" returned: 0 in 0.770s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:36 devstack cinder-volume[86873]: DEBUG cinder.utils [None req-66d2eba8-fb17-4b28-bddb-7c545203f433 tempest-GroupsV314Test-1373522334 None] Path /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-fdb51c3d-b380-469f-afcb-649b7d72b78e not found in is_blk_device check {{(pid=86873) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 18:46:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-66d2eba8-fb17-4b28-bddb-7c545203f433 tempest-GroupsV314Test-1373522334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-496249c6-8e75-4f5e-a444-9201c5360a52 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-fdb51c3d-b380-469f-afcb-649b7d72b78e {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:36 devstack sudo[97717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-496249c6-8e75-4f5e-a444-9201c5360a52 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-fdb51c3d-b380-469f-afcb-649b7d72b78e Jul 08 18:46:36 devstack sudo[97717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:36 devstack sudo[97715]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6e9b368b-a10e-4e12-8a11-fad57a334f75 tempest-VolumesGetTest-918879318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-99a7cb1e-a3f4-4f98-8779-ece92779bee3" returned: 0 in 0.677s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:36 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6e9b368b-a10e-4e12-8a11-fad57a334f75 tempest-VolumesGetTest-918879318 None] Lock "cinder-quobyte-99a7cb1e-a3f4-4f98-8779-ece92779bee3" released by "delete_volume" :: held 1.534s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:46:37 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-6e9b368b-a10e-4e12-8a11-fad57a334f75 tempest-VolumesGetTest-918879318 None] Created reservations ['f8e792fb-036d-459b-b7e2-1170cd85e4f2', 'fb9848e3-26b0-4680-8fc3-fb19b74d4d28', 'b2188fbf-deb0-4df6-99d0-67202a0e11c9', '02431573-2773-4aac-b821-c132fcfde579'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:46:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6e9b368b-a10e-4e12-8a11-fad57a334f75 tempest-VolumesGetTest-918879318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:46:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6e9b368b-a10e-4e12-8a11-fad57a334f75 tempest-VolumesGetTest-918879318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:46:37 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-6e9b368b-a10e-4e12-8a11-fad57a334f75 tempest-VolumesGetTest-918879318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:46:37 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-6e9b368b-a10e-4e12-8a11-fad57a334f75 tempest-VolumesGetTest-918879318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:46:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6e9b368b-a10e-4e12-8a11-fad57a334f75 tempest-VolumesGetTest-918879318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:46:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6e9b368b-a10e-4e12-8a11-fad57a334f75 tempest-VolumesGetTest-918879318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:37 devstack sudo[97724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:46:37 devstack sudo[97724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:38 devstack sudo[97724]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:38 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6e9b368b-a10e-4e12-8a11-fad57a334f75 tempest-VolumesGetTest-918879318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 1.200s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:38 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-6e9b368b-a10e-4e12-8a11-fad57a334f75 tempest-VolumesGetTest-918879318 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:46:38 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-6e9b368b-a10e-4e12-8a11-fad57a334f75 tempest-VolumesGetTest-918879318 None] Deleted volume successfully. Jul 08 18:46:38 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6e9b368b-a10e-4e12-8a11-fad57a334f75 tempest-VolumesGetTest-918879318 None] Lock "cinder-99a7cb1e-a3f4-4f98-8779-ece92779bee3-delete_volume" released by "delete_volume" :: held 3.018s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:46:40 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:46:40 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] Flow 'volume_create_manager' (ddd68c3b-86c5-4e3c-8018-5cd3ab703cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:46:40 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f781212-9217-4731-9217-3f8b0648f66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:40 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f781212-9217-4731-9217-3f8b0648f66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:46:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1786831213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64f3009d-07ba-4cf3-aacb-932132fd9b18,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d63739f7006c405dbae689336b310415',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:46:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:46:40Z,use_quota=True,user_id='e367efa8acbb469090ec3d08f284912c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:40 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf1dab43-9f34-4fee-ab14-18728d4056b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:40 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf1dab43-9f34-4fee-ab14-18728d4056b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:40 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7f29a6e-9ad9-4e6f-8faa-7036e41949be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:40 devstack cinder-volume[86873]: DEBUG cinder.image.glance [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] Creating Keystone auth plugin from conf {{(pid=86873) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 18:46:41 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7f29a6e-9ad9-4e6f-8faa-7036e41949be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '64f3009d-07ba-4cf3-aacb-932132fd9b18', 'volume_name': 'volume-64f3009d-07ba-4cf3-aacb-932132fd9b18', 'volume_size': 1, 'image_id': '9af8b46e-3f06-4165-9812-4f0470d72624', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9af8b46e-3f06-4165-9812-4f0470d72624', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '14269f30917742408b75240392484938', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9af8b46e-3f06-4165-9812-4f0470d72624', 'created_at': datetime.datetime(2026, 7, 8, 16, 25, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 25, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9af8b46e-3f06-4165-9812-4f0470d72624/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:41 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ffe564b-05f7-4f3f-9b8e-dd7a27b7d273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:41 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ffe564b-05f7-4f3f-9b8e-dd7a27b7d273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:41 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c73dcaf-a468-4512-8de3-a51ea3b12123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:41 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] Volume 64f3009d-07ba-4cf3-aacb-932132fd9b18: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-64f3009d-07ba-4cf3-aacb-932132fd9b18', 'volume_size': 1, 'image_id': '9af8b46e-3f06-4165-9812-4f0470d72624', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9af8b46e-3f06-4165-9812-4f0470d72624', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '14269f30917742408b75240392484938', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9af8b46e-3f06-4165-9812-4f0470d72624', 'created_at': datetime.datetime(2026, 7, 8, 16, 25, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 25, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9af8b46e-3f06-4165-9812-4f0470d72624/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 18:46:41 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] Trying to clone 64f3009d-07ba-4cf3-aacb-932132fd9b18 from image 9af8b46e-3f06-4165-9812-4f0470d72624 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9af8b46e-3f06-4165-9812-4f0470d72624', 'metadata': {}}]). {{(pid=86873) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 18:46:41 devstack sudo[97717]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-66d2eba8-fb17-4b28-bddb-7c545203f433 tempest-GroupsV314Test-1373522334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-496249c6-8e75-4f5e-a444-9201c5360a52 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-fdb51c3d-b380-469f-afcb-649b7d72b78e" returned: 0 in 5.379s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:41 devstack cinder-volume[86873]: DEBUG cinder.image.image_utils [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9af8b46e-3f06-4165-9812-4f0470d72624_86jurzwjdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86873) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 18:46:41 devstack cinder-volume[86873]: INFO cinder.image.image_utils [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] Image download 20.69 MB at 20.69 MB/s Jul 08 18:46:41 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[73100e75-5b19-4750-93a9-7f2ac6acbcd0]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:46:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-66d2eba8-fb17-4b28-bddb-7c545203f433 tempest-GroupsV314Test-1373522334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-496249c6-8e75-4f5e-a444-9201c5360a52 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:41 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[754bca01-a8da-4279-b0e6-0bce54ceb059]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:46:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9af8b46e-3f06-4165-9812-4f0470d72624_86jurzwjdevstack@QuobyteHD {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:41 devstack sudo[97735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-496249c6-8e75-4f5e-a444-9201c5360a52 Jul 08 18:46:41 devstack sudo[97735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:41 devstack sudo[97736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9af8b46e-3f06-4165-9812-4f0470d72624_86jurzwjdevstack@QuobyteHD Jul 08 18:46:41 devstack sudo[97736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:42 devstack sudo[97736]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9af8b46e-3f06-4165-9812-4f0470d72624_86jurzwjdevstack@QuobyteHD" returned: 0 in 0.739s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:42 devstack cinder-volume[86873]: DEBUG cinder.image.image_utils [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] Temporary image 9af8b46e-3f06-4165-9812-4f0470d72624 is fetched for user e367efa8acbb469090ec3d08f284912c. {{(pid=86873) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 18:46:42 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a23f83-1a72-456e-8eac-8cec14d0f8cb]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:46:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9af8b46e-3f06-4165-9812-4f0470d72624_86jurzwjdevstack@QuobyteHD {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:42 devstack sudo[97735]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-66d2eba8-fb17-4b28-bddb-7c545203f433 tempest-GroupsV314Test-1373522334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-496249c6-8e75-4f5e-a444-9201c5360a52" returned: 0 in 0.993s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:42 devstack cinder-volume[86873]: DEBUG cinder.image.image_utils [None req-66d2eba8-fb17-4b28-bddb-7c545203f433 tempest-GroupsV314Test-1373522334 None] Image conversion details: src /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-496249c6-8e75-4f5e-a444-9201c5360a52, size 1024.00 MB, duration 5.38 sec, destination /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-fdb51c3d-b380-469f-afcb-649b7d72b78e {{(pid=86873) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:46:42 devstack sudo[97746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9af8b46e-3f06-4165-9812-4f0470d72624_86jurzwjdevstack@QuobyteHD Jul 08 18:46:42 devstack sudo[97746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:42 devstack cinder-volume[86873]: INFO cinder.image.image_utils [None req-66d2eba8-fb17-4b28-bddb-7c545203f433 tempest-GroupsV314Test-1373522334 None] Converted 1024.00 MB image at 190.34 MB/s Jul 08 18:46:42 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-66d2eba8-fb17-4b28-bddb-7c545203f433 tempest-GroupsV314Test-1373522334 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-fdb51c3d-b380-469f-afcb-649b7d72b78e is being set with open permissions: ugo+rw: NotImplementedError Jul 08 18:46:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-66d2eba8-fb17-4b28-bddb-7c545203f433 tempest-GroupsV314Test-1373522334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-fdb51c3d-b380-469f-afcb-649b7d72b78e {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:42 devstack sudo[97748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-fdb51c3d-b380-469f-afcb-649b7d72b78e Jul 08 18:46:42 devstack sudo[97748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:43 devstack sudo[97746]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9af8b46e-3f06-4165-9812-4f0470d72624_86jurzwjdevstack@QuobyteHD" returned: 0 in 0.749s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:46:43 devstack sudo[97748]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-66d2eba8-fb17-4b28-bddb-7c545203f433 tempest-GroupsV314Test-1373522334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-fdb51c3d-b380-469f-afcb-649b7d72b78e" returned: 0 in 0.647s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:43 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-66d2eba8-fb17-4b28-bddb-7c545203f433 tempest-GroupsV314Test-1373522334 None] Lock "cinder-quobyte-fdb51c3d-b380-469f-afcb-649b7d72b78e" released by "_copy_volume_from_snapshot" :: held 8.692s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:46:43 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-66d2eba8-fb17-4b28-bddb-7c545203f433 tempest-GroupsV314Test-1373522334 None] Acquiring lock "cinder-quobyte-fb503f55-bd8e-407c-8457-8bff5fc3a139" by "_delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:46:43 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-66d2eba8-fb17-4b28-bddb-7c545203f433 tempest-GroupsV314Test-1373522334 None] Lock "cinder-quobyte-fb503f55-bd8e-407c-8457-8bff5fc3a139" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:46:43 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-66d2eba8-fb17-4b28-bddb-7c545203f433 tempest-GroupsV314Test-1373522334 None] Deleting offline snapshot fb503f55-bd8e-407c-8457-8bff5fc3a139 of volume 496249c6-8e75-4f5e-a444-9201c5360a52 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:46:43 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-66d2eba8-fb17-4b28-bddb-7c545203f433 tempest-GroupsV314Test-1373522334 None] snapshot_file for this snap is: volume-496249c6-8e75-4f5e-a444-9201c5360a52.fb503f55-bd8e-407c-8457-8bff5fc3a139 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:46:43 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[a472c2ec-8608-452b-86ba-56717dc6e3b0]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:46:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-66d2eba8-fb17-4b28-bddb-7c545203f433 tempest-GroupsV314Test-1373522334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-496249c6-8e75-4f5e-a444-9201c5360a52.fb503f55-bd8e-407c-8457-8bff5fc3a139 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:43 devstack sudo[97754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-496249c6-8e75-4f5e-a444-9201c5360a52.fb503f55-bd8e-407c-8457-8bff5fc3a139 Jul 08 18:46:43 devstack sudo[97754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:44 devstack sudo[97754]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-66d2eba8-fb17-4b28-bddb-7c545203f433 tempest-GroupsV314Test-1373522334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-496249c6-8e75-4f5e-a444-9201c5360a52.fb503f55-bd8e-407c-8457-8bff5fc3a139" returned: 0 in 0.745s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:44 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-66d2eba8-fb17-4b28-bddb-7c545203f433 tempest-GroupsV314Test-1373522334 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-496249c6-8e75-4f5e-a444-9201c5360a52(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:46:44 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[1169615e-6ccf-4c6d-b78b-27fdd3175c51]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:46:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-66d2eba8-fb17-4b28-bddb-7c545203f433 tempest-GroupsV314Test-1373522334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-496249c6-8e75-4f5e-a444-9201c5360a52 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:44 devstack sudo[97759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-496249c6-8e75-4f5e-a444-9201c5360a52 Jul 08 18:46:44 devstack sudo[97759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:44 devstack sudo[97759]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-66d2eba8-fb17-4b28-bddb-7c545203f433 tempest-GroupsV314Test-1373522334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-496249c6-8e75-4f5e-a444-9201c5360a52" returned: 0 in 0.732s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-66d2eba8-fb17-4b28-bddb-7c545203f433 tempest-GroupsV314Test-1373522334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-496249c6-8e75-4f5e-a444-9201c5360a52.fb503f55-bd8e-407c-8457-8bff5fc3a139 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:44 devstack sudo[97764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-496249c6-8e75-4f5e-a444-9201c5360a52.fb503f55-bd8e-407c-8457-8bff5fc3a139 Jul 08 18:46:44 devstack sudo[97764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:45 devstack sudo[97764]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-66d2eba8-fb17-4b28-bddb-7c545203f433 tempest-GroupsV314Test-1373522334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-496249c6-8e75-4f5e-a444-9201c5360a52.fb503f55-bd8e-407c-8457-8bff5fc3a139" returned: 0 in 0.707s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-66d2eba8-fb17-4b28-bddb-7c545203f433 tempest-GroupsV314Test-1373522334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-496249c6-8e75-4f5e-a444-9201c5360a52.fb503f55-bd8e-407c-8457-8bff5fc3a139 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:45 devstack sudo[97769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-496249c6-8e75-4f5e-a444-9201c5360a52.fb503f55-bd8e-407c-8457-8bff5fc3a139 Jul 08 18:46:45 devstack sudo[97769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:46 devstack sudo[97769]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-66d2eba8-fb17-4b28-bddb-7c545203f433 tempest-GroupsV314Test-1373522334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-496249c6-8e75-4f5e-a444-9201c5360a52.fb503f55-bd8e-407c-8457-8bff5fc3a139" returned: 0 in 0.699s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:46 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-66d2eba8-fb17-4b28-bddb-7c545203f433 tempest-GroupsV314Test-1373522334 None] Lock "cinder-quobyte-fb503f55-bd8e-407c-8457-8bff5fc3a139" released by "_delete_snapshot" :: held 2.978s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:46:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-66d2eba8-fb17-4b28-bddb-7c545203f433 tempest-GroupsV314Test-1373522334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.211s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:46:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.052s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:46:46 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:46:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1786831213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64f3009d-07ba-4cf3-aacb-932132fd9b18,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d63739f7006c405dbae689336b310415',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:46:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:46:40Z,use_quota=True,user_id='e367efa8acbb469090ec3d08f284912c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:46:46 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] Creating volume 64f3009d-07ba-4cf3-aacb-932132fd9b18 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:46:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:46:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:46:46 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:46:46 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:46:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:46:46 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:46:46 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:46:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-64f3009d-07ba-4cf3-aacb-932132fd9b18 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:46 devstack sudo[97772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-64f3009d-07ba-4cf3-aacb-932132fd9b18 1073741824 Jul 08 18:46:46 devstack sudo[97772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:46 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-66d2eba8-fb17-4b28-bddb-7c545203f433 tempest-GroupsV314Test-1373522334 None] Create group from source-group-10ad1a70-adfb-48fa-8d2a-af6151f82a12 completed successfully. Jul 08 18:46:47 devstack sudo[97772]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-64f3009d-07ba-4cf3-aacb-932132fd9b18 1073741824" returned: 0 in 0.824s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:47 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:SELECT=103,cinder:UPDATE=120,cinder:INSERT=34,cinder:DELETE=8 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:46:47 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:SELECT=102,cinder:UPDATE=134,cinder:INSERT=23,cinder:DELETE=7 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:46:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-64f3009d-07ba-4cf3-aacb-932132fd9b18 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:47 devstack sudo[97777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-64f3009d-07ba-4cf3-aacb-932132fd9b18 Jul 08 18:46:47 devstack sudo[97777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:47 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-305b7edb-8997-48e8-8e89-21d92067e862 tempest-GroupsV314Test-1373522334 None] Acquiring lock "cinder-quobyte-fdb51c3d-b380-469f-afcb-649b7d72b78e" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:46:47 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-305b7edb-8997-48e8-8e89-21d92067e862 tempest-GroupsV314Test-1373522334 None] Lock "cinder-quobyte-fdb51c3d-b380-469f-afcb-649b7d72b78e" acquired by "delete_volume" :: waited 0.018s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:46:47 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56acf49-4401-4f67-b9d1-95d21063325f]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:46:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-305b7edb-8997-48e8-8e89-21d92067e862 tempest-GroupsV314Test-1373522334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-fdb51c3d-b380-469f-afcb-649b7d72b78e {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:47 devstack sudo[97779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-fdb51c3d-b380-469f-afcb-649b7d72b78e Jul 08 18:46:47 devstack sudo[97779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:47 devstack sudo[97777]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-64f3009d-07ba-4cf3-aacb-932132fd9b18" returned: 0 in 0.676s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:47 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] <== create_volume: return (1564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:46:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.567s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:46:48 devstack cinder-volume[86873]: DEBUG cinder.volume.volume_utils [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] Attempting download of 9af8b46e-3f06-4165-9812-4f0470d72624 ((None, [{'url': 'file:///opt/stack/data/glance/images/9af8b46e-3f06-4165-9812-4f0470d72624', 'metadata': {}}])) to volume 64f3009d-07ba-4cf3-aacb-932132fd9b18. {{(pid=86873) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 18:46:48 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a2a7fa-793f-45f8-abb4-0f84a40d4d8e]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:46:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9af8b46e-3f06-4165-9812-4f0470d72624_nyj17vo0 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:48 devstack sudo[97782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9af8b46e-3f06-4165-9812-4f0470d72624_nyj17vo0 Jul 08 18:46:48 devstack sudo[97782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:48 devstack cinder-volume[86873]: DEBUG oslo_service.periodic_task [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86873) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:46:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:46:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:46:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:46:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:46:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:46:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:48 devstack sudo[97784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:46:48 devstack sudo[97784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:48 devstack sudo[97779]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-305b7edb-8997-48e8-8e89-21d92067e862 tempest-GroupsV314Test-1373522334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-fdb51c3d-b380-469f-afcb-649b7d72b78e" returned: 0 in 0.810s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-305b7edb-8997-48e8-8e89-21d92067e862 tempest-GroupsV314Test-1373522334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-fdb51c3d-b380-469f-afcb-649b7d72b78e {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:48 devstack sudo[97789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-fdb51c3d-b380-469f-afcb-649b7d72b78e Jul 08 18:46:48 devstack sudo[97789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:48 devstack sudo[97782]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9af8b46e-3f06-4165-9812-4f0470d72624_nyj17vo0" returned: 0 in 0.755s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9af8b46e-3f06-4165-9812-4f0470d72624_nyj17vo0 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:48 devstack sudo[97784]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.649s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:48 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:46:48 devstack cinder-volume[86873]: DEBUG oslo_service.periodic_task [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running periodic task VolumeManager._thread_info {{(pid=86873) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:46:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] thread count: 29 {{(pid=86873) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:46:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] thread info: [<_MainThread(MainThread, started 138577734545536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86873) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:46:48 devstack sudo[97794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9af8b46e-3f06-4165-9812-4f0470d72624_nyj17vo0 Jul 08 18:46:48 devstack sudo[97794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:49 devstack sudo[97789]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-305b7edb-8997-48e8-8e89-21d92067e862 tempest-GroupsV314Test-1373522334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-fdb51c3d-b380-469f-afcb-649b7d72b78e" returned: 0 in 0.630s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:49 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-305b7edb-8997-48e8-8e89-21d92067e862 tempest-GroupsV314Test-1373522334 None] Lock "cinder-quobyte-fdb51c3d-b380-469f-afcb-649b7d72b78e" released by "delete_volume" :: held 1.502s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:46:49 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-305b7edb-8997-48e8-8e89-21d92067e862 tempest-GroupsV314Test-1373522334 None] Created reservations ['d0c9727e-3d83-4f78-9ce7-4bdbd79c1ca6'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:46:49 devstack cinder-volume[86873]: WARNING cinder.quota [None req-305b7edb-8997-48e8-8e89-21d92067e862 tempest-GroupsV314Test-1373522334 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1422266778 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1422266778, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:46:49 devstack cinder-volume[86873]: WARNING cinder.quota [None req-305b7edb-8997-48e8-8e89-21d92067e862 tempest-GroupsV314Test-1373522334 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1422266778 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1422266778, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:46:49 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-305b7edb-8997-48e8-8e89-21d92067e862 tempest-GroupsV314Test-1373522334 None] Created reservations ['34266825-f729-4052-96af-e6cf4b5a195e', '9c7265ff-937c-4000-aa46-008659639b7b', '6d2cfc3d-aee4-4a56-bc02-2338fb3709e8', 'f0c55b5c-76b6-4ce9-8792-dbbc0fb82658'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:46:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-305b7edb-8997-48e8-8e89-21d92067e862 tempest-GroupsV314Test-1373522334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:46:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-305b7edb-8997-48e8-8e89-21d92067e862 tempest-GroupsV314Test-1373522334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:46:49 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-305b7edb-8997-48e8-8e89-21d92067e862 tempest-GroupsV314Test-1373522334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:46:49 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-305b7edb-8997-48e8-8e89-21d92067e862 tempest-GroupsV314Test-1373522334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:46:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-305b7edb-8997-48e8-8e89-21d92067e862 tempest-GroupsV314Test-1373522334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:46:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-305b7edb-8997-48e8-8e89-21d92067e862 tempest-GroupsV314Test-1373522334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:49 devstack sudo[97799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:46:49 devstack sudo[97799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:49 devstack sudo[97794]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9af8b46e-3f06-4165-9812-4f0470d72624_nyj17vo0" returned: 1 in 0.757s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9af8b46e-3f06-4165-9812-4f0470d72624_nyj17vo0' failed. Not Retrying. {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:46:49 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbc224a-4a4f-47e7-9c8a-a8eda35edbe0]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:46:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9af8b46e-3f06-4165-9812-4f0470d72624_86jurzwjdevstack@QuobyteHD {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:49 devstack sudo[97801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9af8b46e-3f06-4165-9812-4f0470d72624_86jurzwjdevstack@QuobyteHD Jul 08 18:46:49 devstack sudo[97801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:50 devstack sudo[97799]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-305b7edb-8997-48e8-8e89-21d92067e862 tempest-GroupsV314Test-1373522334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.680s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:50 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-305b7edb-8997-48e8-8e89-21d92067e862 tempest-GroupsV314Test-1373522334 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:46:50 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-305b7edb-8997-48e8-8e89-21d92067e862 tempest-GroupsV314Test-1373522334 None] Delete group completed successfully. Jul 08 18:46:50 devstack sudo[97801]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9af8b46e-3f06-4165-9812-4f0470d72624_86jurzwjdevstack@QuobyteHD" returned: 0 in 0.759s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:50 devstack cinder-volume[86873]: DEBUG cinder.image.image_utils [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] 9af8b46e-3f06-4165-9812-4f0470d72624 was qcow2, converting to raw {{(pid=86873) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 18:46:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9af8b46e-3f06-4165-9812-4f0470d72624_86jurzwjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-64f3009d-07ba-4cf3-aacb-932132fd9b18 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:50 devstack sudo[97807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9af8b46e-3f06-4165-9812-4f0470d72624_86jurzwjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-64f3009d-07ba-4cf3-aacb-932132fd9b18 Jul 08 18:46:50 devstack sudo[97807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:50 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6b21f332-a15d-464c-8c49-b7d744a07790 tempest-GroupsV314Test-1373522334 None] Acquiring lock "cinder-quobyte-496249c6-8e75-4f5e-a444-9201c5360a52" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:46:50 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6b21f332-a15d-464c-8c49-b7d744a07790 tempest-GroupsV314Test-1373522334 None] Lock "cinder-quobyte-496249c6-8e75-4f5e-a444-9201c5360a52" acquired by "delete_volume" :: waited 0.017s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:46:50 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[33195c3f-6a25-4f2a-b79b-b1a062228d5c]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:46:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6b21f332-a15d-464c-8c49-b7d744a07790 tempest-GroupsV314Test-1373522334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-496249c6-8e75-4f5e-a444-9201c5360a52 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:50 devstack sudo[97809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-496249c6-8e75-4f5e-a444-9201c5360a52 Jul 08 18:46:50 devstack sudo[97809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:51 devstack sudo[97809]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6b21f332-a15d-464c-8c49-b7d744a07790 tempest-GroupsV314Test-1373522334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-496249c6-8e75-4f5e-a444-9201c5360a52" returned: 0 in 0.893s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6b21f332-a15d-464c-8c49-b7d744a07790 tempest-GroupsV314Test-1373522334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-496249c6-8e75-4f5e-a444-9201c5360a52 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:51 devstack sudo[97821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-496249c6-8e75-4f5e-a444-9201c5360a52 Jul 08 18:46:51 devstack sudo[97821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:52 devstack sudo[97821]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6b21f332-a15d-464c-8c49-b7d744a07790 tempest-GroupsV314Test-1373522334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-496249c6-8e75-4f5e-a444-9201c5360a52" returned: 0 in 0.687s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:52 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6b21f332-a15d-464c-8c49-b7d744a07790 tempest-GroupsV314Test-1373522334 None] Lock "cinder-quobyte-496249c6-8e75-4f5e-a444-9201c5360a52" released by "delete_volume" :: held 1.641s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:46:52 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-6b21f332-a15d-464c-8c49-b7d744a07790 tempest-GroupsV314Test-1373522334 None] Created reservations ['dc66bbe1-6fd9-431b-a1b3-a76293258cb1'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:46:52 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-6b21f332-a15d-464c-8c49-b7d744a07790 tempest-GroupsV314Test-1373522334 None] Created reservations ['081dda2a-9940-4e8b-b61b-78ac729b5e56', 'c344f73e-3b21-4b12-8ba7-f31aaf2cfbe5', '3edf7cb4-8704-478f-8eb7-c2c93d9c922e', 'e2bd5ed1-4717-471b-a14e-6eeda4151717'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:46:52 devstack sudo[97807]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9af8b46e-3f06-4165-9812-4f0470d72624_86jurzwjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-64f3009d-07ba-4cf3-aacb-932132fd9b18" returned: 0 in 1.938s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:52 devstack cinder-volume[86873]: DEBUG cinder.image.image_utils [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9af8b46e-3f06-4165-9812-4f0470d72624_86jurzwjdevstack@QuobyteHD, size 112.00 MB, duration 1.94 sec, destination /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-64f3009d-07ba-4cf3-aacb-932132fd9b18 {{(pid=86873) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:46:52 devstack cinder-volume[86873]: INFO cinder.image.image_utils [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] Converted 112.00 MB image at 57.76 MB/s Jul 08 18:46:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-64f3009d-07ba-4cf3-aacb-932132fd9b18 1G {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6b21f332-a15d-464c-8c49-b7d744a07790 tempest-GroupsV314Test-1373522334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:46:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6b21f332-a15d-464c-8c49-b7d744a07790 tempest-GroupsV314Test-1373522334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:46:52 devstack sudo[97825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-64f3009d-07ba-4cf3-aacb-932132fd9b18 1G Jul 08 18:46:52 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-6b21f332-a15d-464c-8c49-b7d744a07790 tempest-GroupsV314Test-1373522334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:46:52 devstack sudo[97825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:52 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-6b21f332-a15d-464c-8c49-b7d744a07790 tempest-GroupsV314Test-1373522334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:46:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6b21f332-a15d-464c-8c49-b7d744a07790 tempest-GroupsV314Test-1373522334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:46:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6b21f332-a15d-464c-8c49-b7d744a07790 tempest-GroupsV314Test-1373522334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:52 devstack sudo[97827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:46:52 devstack sudo[97827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:53 devstack sudo[97827]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:53 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6b21f332-a15d-464c-8c49-b7d744a07790 tempest-GroupsV314Test-1373522334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.676s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:53 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-6b21f332-a15d-464c-8c49-b7d744a07790 tempest-GroupsV314Test-1373522334 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:46:53 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-6b21f332-a15d-464c-8c49-b7d744a07790 tempest-GroupsV314Test-1373522334 None] Delete group completed successfully. Jul 08 18:46:53 devstack sudo[97825]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:53 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-64f3009d-07ba-4cf3-aacb-932132fd9b18 1G" returned: 0 in 0.758s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:53 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce5d898-e43c-4dea-80e9-e2ed54f40666]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:46:53 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-64f3009d-07ba-4cf3-aacb-932132fd9b18 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:53 devstack sudo[97833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-64f3009d-07ba-4cf3-aacb-932132fd9b18 Jul 08 18:46:53 devstack sudo[97833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:53 devstack sudo[97833]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:53 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-64f3009d-07ba-4cf3-aacb-932132fd9b18" returned: 0 in 0.793s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:53 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-64f3009d-07ba-4cf3-aacb-932132fd9b18 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:54 devstack sudo[97837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-64f3009d-07ba-4cf3-aacb-932132fd9b18 Jul 08 18:46:54 devstack sudo[97837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:54 devstack sudo[97837]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-64f3009d-07ba-4cf3-aacb-932132fd9b18" returned: 1 in 0.784s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-64f3009d-07ba-4cf3-aacb-932132fd9b18' failed. Not Retrying. {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:46:54 devstack cinder-volume[86873]: DEBUG cinder.volume.volume_utils [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] Downloaded image 9af8b46e-3f06-4165-9812-4f0470d72624 ((None, [{'url': 'file:///opt/stack/data/glance/images/9af8b46e-3f06-4165-9812-4f0470d72624', 'metadata': {}}])) to volume 64f3009d-07ba-4cf3-aacb-932132fd9b18 successfully. {{(pid=86873) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 18:46:54 devstack cinder-volume[86873]: DEBUG cinder.image.image_utils [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] Temporary image 9af8b46e-3f06-4165-9812-4f0470d72624 for user e367efa8acbb469090ec3d08f284912c is deleted. {{(pid=86873) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 18:46:54 devstack cinder-volume[86873]: DEBUG cinder.volume.volume_utils [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] Marking volume 64f3009d-07ba-4cf3-aacb-932132fd9b18 as bootable. {{(pid=86873) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 18:46:54 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] Copying metadata from image 9af8b46e-3f06-4165-9812-4f0470d72624 to 64f3009d-07ba-4cf3-aacb-932132fd9b18. {{(pid=86873) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 18:46:54 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] Creating volume glance metadata for volume 64f3009d-07ba-4cf3-aacb-932132fd9b18 backed by image 9af8b46e-3f06-4165-9812-4f0470d72624 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9af8b46e-3f06-4165-9812-4f0470d72624', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86873) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 18:46:54 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c73dcaf-a468-4512-8de3-a51ea3b12123) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64f3009d-07ba-4cf3-aacb-932132fd9b18', 'volume_size': 1, 'image_id': '9af8b46e-3f06-4165-9812-4f0470d72624', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9af8b46e-3f06-4165-9812-4f0470d72624', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '14269f30917742408b75240392484938', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9af8b46e-3f06-4165-9812-4f0470d72624', 'created_at': datetime.datetime(2026, 7, 8, 16, 25, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 25, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9af8b46e-3f06-4165-9812-4f0470d72624/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:54 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26569eef-25e7-4277-b643-ce83a451c80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:54 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] Volume volume-64f3009d-07ba-4cf3-aacb-932132fd9b18 (64f3009d-07ba-4cf3-aacb-932132fd9b18): created successfully Jul 08 18:46:54 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26569eef-25e7-4277-b643-ce83a451c80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:54 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] Flow 'volume_create_manager' (ddd68c3b-86c5-4e3c-8018-5cd3ab703cb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:46:54 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-5850a551-bd4d-43dd-b844-98d86153ac59 tempest-VolumesGetTest-918879318 None] Created volume successfully. Jul 08 18:46:55 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a82756f-4217-44f2-9db8-e266a4f89691 tempest-VolumesGetTest-918879318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:46:55 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6a82756f-4217-44f2-9db8-e266a4f89691 tempest-VolumesGetTest-918879318 None] Flow 'volume_create_manager' (23dc9a70-c032-4fd9-9761-3b9efabce46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:46:55 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6a82756f-4217-44f2-9db8-e266a4f89691 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53918b13-a468-40cf-9033-7b96feace383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:55 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6a82756f-4217-44f2-9db8-e266a4f89691 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53918b13-a468-40cf-9033-7b96feace383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:46:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1616798335',display_name='tempest-VolumesGetTest-Volume-2113880703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0bf4764-fa7b-4e89-8af2-ca17dcd3fb00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d63739f7006c405dbae689336b310415',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:46:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:46:56Z,use_quota=True,user_id='e367efa8acbb469090ec3d08f284912c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:55 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6a82756f-4217-44f2-9db8-e266a4f89691 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78347625-67be-4066-b96f-9c0f6d24aa1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:55 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6a82756f-4217-44f2-9db8-e266a4f89691 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78347625-67be-4066-b96f-9c0f6d24aa1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:55 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6a82756f-4217-44f2-9db8-e266a4f89691 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (767114f7-82de-4c7b-b461-59167c36f691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:55 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6a82756f-4217-44f2-9db8-e266a4f89691 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (767114f7-82de-4c7b-b461-59167c36f691) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0bf4764-fa7b-4e89-8af2-ca17dcd3fb00', 'volume_name': 'volume-c0bf4764-fa7b-4e89-8af2-ca17dcd3fb00', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:55 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6a82756f-4217-44f2-9db8-e266a4f89691 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0654126-f4a7-4636-a0bd-0cdbef826482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:55 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6a82756f-4217-44f2-9db8-e266a4f89691 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0654126-f4a7-4636-a0bd-0cdbef826482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:55 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6a82756f-4217-44f2-9db8-e266a4f89691 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a56853d8-abff-459e-9aa6-8979d16db696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:55 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-6a82756f-4217-44f2-9db8-e266a4f89691 tempest-VolumesGetTest-918879318 None] Volume c0bf4764-fa7b-4e89-8af2-ca17dcd3fb00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0bf4764-fa7b-4e89-8af2-ca17dcd3fb00', 'volume_size': 1} Jul 08 18:46:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6a82756f-4217-44f2-9db8-e266a4f89691 tempest-VolumesGetTest-918879318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:46:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6a82756f-4217-44f2-9db8-e266a4f89691 tempest-VolumesGetTest-918879318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:46:55 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-6a82756f-4217-44f2-9db8-e266a4f89691 tempest-VolumesGetTest-918879318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:46:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1616798335',display_name='tempest-VolumesGetTest-Volume-2113880703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0bf4764-fa7b-4e89-8af2-ca17dcd3fb00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d63739f7006c405dbae689336b310415',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:46:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:46:56Z,use_quota=True,user_id='e367efa8acbb469090ec3d08f284912c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:46:55 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-6a82756f-4217-44f2-9db8-e266a4f89691 tempest-VolumesGetTest-918879318 None] Creating volume c0bf4764-fa7b-4e89-8af2-ca17dcd3fb00 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:46:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6a82756f-4217-44f2-9db8-e266a4f89691 tempest-VolumesGetTest-918879318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:46:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6a82756f-4217-44f2-9db8-e266a4f89691 tempest-VolumesGetTest-918879318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:46:55 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-6a82756f-4217-44f2-9db8-e266a4f89691 tempest-VolumesGetTest-918879318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:46:55 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-6a82756f-4217-44f2-9db8-e266a4f89691 tempest-VolumesGetTest-918879318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:46:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6a82756f-4217-44f2-9db8-e266a4f89691 tempest-VolumesGetTest-918879318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:46:55 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-6a82756f-4217-44f2-9db8-e266a4f89691 tempest-VolumesGetTest-918879318 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:46:55 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-6a82756f-4217-44f2-9db8-e266a4f89691 tempest-VolumesGetTest-918879318 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:46:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6a82756f-4217-44f2-9db8-e266a4f89691 tempest-VolumesGetTest-918879318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c0bf4764-fa7b-4e89-8af2-ca17dcd3fb00 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:55 devstack sudo[97842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c0bf4764-fa7b-4e89-8af2-ca17dcd3fb00 1073741824 Jul 08 18:46:55 devstack sudo[97842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:56 devstack sudo[97842]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6a82756f-4217-44f2-9db8-e266a4f89691 tempest-VolumesGetTest-918879318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c0bf4764-fa7b-4e89-8af2-ca17dcd3fb00 1073741824" returned: 0 in 0.868s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6a82756f-4217-44f2-9db8-e266a4f89691 tempest-VolumesGetTest-918879318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c0bf4764-fa7b-4e89-8af2-ca17dcd3fb00 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:56 devstack sudo[97849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c0bf4764-fa7b-4e89-8af2-ca17dcd3fb00 Jul 08 18:46:56 devstack sudo[97849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:57 devstack sudo[97849]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6a82756f-4217-44f2-9db8-e266a4f89691 tempest-VolumesGetTest-918879318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c0bf4764-fa7b-4e89-8af2-ca17dcd3fb00" returned: 0 in 0.691s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:57 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-6a82756f-4217-44f2-9db8-e266a4f89691 tempest-VolumesGetTest-918879318 None] <== create_volume: return (1614ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:46:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6a82756f-4217-44f2-9db8-e266a4f89691 tempest-VolumesGetTest-918879318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.617s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:46:57 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6a82756f-4217-44f2-9db8-e266a4f89691 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a56853d8-abff-459e-9aa6-8979d16db696) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0bf4764-fa7b-4e89-8af2-ca17dcd3fb00', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:57 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6a82756f-4217-44f2-9db8-e266a4f89691 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acb8dfde-79e6-4fc7-b0f8-f59728e0baf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:57 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-6a82756f-4217-44f2-9db8-e266a4f89691 tempest-VolumesGetTest-918879318 None] Volume volume-c0bf4764-fa7b-4e89-8af2-ca17dcd3fb00 (c0bf4764-fa7b-4e89-8af2-ca17dcd3fb00): created successfully Jul 08 18:46:57 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6a82756f-4217-44f2-9db8-e266a4f89691 tempest-VolumesGetTest-918879318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acb8dfde-79e6-4fc7-b0f8-f59728e0baf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:57 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6a82756f-4217-44f2-9db8-e266a4f89691 tempest-VolumesGetTest-918879318 None] Flow 'volume_create_manager' (23dc9a70-c032-4fd9-9761-3b9efabce46b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:46:57 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-6a82756f-4217-44f2-9db8-e266a4f89691 tempest-VolumesGetTest-918879318 None] Created volume successfully. Jul 08 18:46:57 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-6064e339-68d8-4ca6-b99f-d7f78b782443 tempest-SnapshotsActionsTest-64857814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:46:57 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6064e339-68d8-4ca6-b99f-d7f78b782443 tempest-SnapshotsActionsTest-64857814 None] Flow 'volume_create_manager' (a8334737-78b4-4e2a-a2af-30f6ab5e1e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:46:57 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6064e339-68d8-4ca6-b99f-d7f78b782443 tempest-SnapshotsActionsTest-64857814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42b80f7d-653a-44b0-84d3-a4d10416b241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:57 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6064e339-68d8-4ca6-b99f-d7f78b782443 tempest-SnapshotsActionsTest-64857814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42b80f7d-653a-44b0-84d3-a4d10416b241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1185304803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfaf0e33-99f6-462d-87af-4614c1014611,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b92b9bb20f11497d84966b121be470ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:46:58Z,use_quota=True,user_id='b2baca32bc8b4b42adae4af297321c6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:57 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6064e339-68d8-4ca6-b99f-d7f78b782443 tempest-SnapshotsActionsTest-64857814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a12a52c-ee8d-437c-9006-3ebc5557e683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:57 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6064e339-68d8-4ca6-b99f-d7f78b782443 tempest-SnapshotsActionsTest-64857814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a12a52c-ee8d-437c-9006-3ebc5557e683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:57 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6064e339-68d8-4ca6-b99f-d7f78b782443 tempest-SnapshotsActionsTest-64857814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5424cc8-0323-4746-a42c-dca5517b38ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:57 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6064e339-68d8-4ca6-b99f-d7f78b782443 tempest-SnapshotsActionsTest-64857814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5424cc8-0323-4746-a42c-dca5517b38ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfaf0e33-99f6-462d-87af-4614c1014611', 'volume_name': 'volume-bfaf0e33-99f6-462d-87af-4614c1014611', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:57 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6064e339-68d8-4ca6-b99f-d7f78b782443 tempest-SnapshotsActionsTest-64857814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8516ef3e-1424-4eef-afbc-09f0162ee69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:57 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6064e339-68d8-4ca6-b99f-d7f78b782443 tempest-SnapshotsActionsTest-64857814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8516ef3e-1424-4eef-afbc-09f0162ee69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:57 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6064e339-68d8-4ca6-b99f-d7f78b782443 tempest-SnapshotsActionsTest-64857814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83df5a7d-2fc9-441c-9951-52efd957ee13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:57 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-6064e339-68d8-4ca6-b99f-d7f78b782443 tempest-SnapshotsActionsTest-64857814 None] Volume bfaf0e33-99f6-462d-87af-4614c1014611: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfaf0e33-99f6-462d-87af-4614c1014611', 'volume_size': 1} Jul 08 18:46:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6064e339-68d8-4ca6-b99f-d7f78b782443 tempest-SnapshotsActionsTest-64857814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:46:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6064e339-68d8-4ca6-b99f-d7f78b782443 tempest-SnapshotsActionsTest-64857814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:46:57 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-6064e339-68d8-4ca6-b99f-d7f78b782443 tempest-SnapshotsActionsTest-64857814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1185304803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfaf0e33-99f6-462d-87af-4614c1014611,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b92b9bb20f11497d84966b121be470ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:46:58Z,use_quota=True,user_id='b2baca32bc8b4b42adae4af297321c6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:46:57 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-6064e339-68d8-4ca6-b99f-d7f78b782443 tempest-SnapshotsActionsTest-64857814 None] Creating volume bfaf0e33-99f6-462d-87af-4614c1014611 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:46:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6064e339-68d8-4ca6-b99f-d7f78b782443 tempest-SnapshotsActionsTest-64857814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:46:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6064e339-68d8-4ca6-b99f-d7f78b782443 tempest-SnapshotsActionsTest-64857814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:46:57 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-6064e339-68d8-4ca6-b99f-d7f78b782443 tempest-SnapshotsActionsTest-64857814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:46:57 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-6064e339-68d8-4ca6-b99f-d7f78b782443 tempest-SnapshotsActionsTest-64857814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:46:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6064e339-68d8-4ca6-b99f-d7f78b782443 tempest-SnapshotsActionsTest-64857814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:46:57 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-6064e339-68d8-4ca6-b99f-d7f78b782443 tempest-SnapshotsActionsTest-64857814 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:46:57 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-6064e339-68d8-4ca6-b99f-d7f78b782443 tempest-SnapshotsActionsTest-64857814 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:46:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6064e339-68d8-4ca6-b99f-d7f78b782443 tempest-SnapshotsActionsTest-64857814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:58 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-f015fb26-5f2c-4d53-8207-1d719e9ec97a tempest-VolumesGetTest-918879318 None] Acquiring lock "cinder-c0bf4764-fa7b-4e89-8af2-ca17dcd3fb00-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:46:58 devstack sudo[97852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611 1073741824 Jul 08 18:46:58 devstack sudo[97852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:58 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-f015fb26-5f2c-4d53-8207-1d719e9ec97a tempest-VolumesGetTest-918879318 None] Lock "cinder-c0bf4764-fa7b-4e89-8af2-ca17dcd3fb00-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:46:58 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-f015fb26-5f2c-4d53-8207-1d719e9ec97a tempest-VolumesGetTest-918879318 None] Acquiring lock "cinder-quobyte-c0bf4764-fa7b-4e89-8af2-ca17dcd3fb00" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:46:58 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-f015fb26-5f2c-4d53-8207-1d719e9ec97a tempest-VolumesGetTest-918879318 None] Lock "cinder-quobyte-c0bf4764-fa7b-4e89-8af2-ca17dcd3fb00" acquired by "delete_volume" :: waited 0.014s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:46:58 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[647e8519-972b-44b7-b577-208ec7f5b939]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:46:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f015fb26-5f2c-4d53-8207-1d719e9ec97a tempest-VolumesGetTest-918879318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c0bf4764-fa7b-4e89-8af2-ca17dcd3fb00 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:58 devstack sudo[97854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c0bf4764-fa7b-4e89-8af2-ca17dcd3fb00 Jul 08 18:46:58 devstack sudo[97854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:58 devstack sudo[97852]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6064e339-68d8-4ca6-b99f-d7f78b782443 tempest-SnapshotsActionsTest-64857814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611 1073741824" returned: 0 in 0.832s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6064e339-68d8-4ca6-b99f-d7f78b782443 tempest-SnapshotsActionsTest-64857814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:58 devstack sudo[97862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611 Jul 08 18:46:58 devstack sudo[97862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:58 devstack sudo[97854]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f015fb26-5f2c-4d53-8207-1d719e9ec97a tempest-VolumesGetTest-918879318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c0bf4764-fa7b-4e89-8af2-ca17dcd3fb00" returned: 0 in 0.873s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f015fb26-5f2c-4d53-8207-1d719e9ec97a tempest-VolumesGetTest-918879318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c0bf4764-fa7b-4e89-8af2-ca17dcd3fb00 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:59 devstack sudo[97864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c0bf4764-fa7b-4e89-8af2-ca17dcd3fb00 Jul 08 18:46:59 devstack sudo[97864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:59 devstack sudo[97862]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6064e339-68d8-4ca6-b99f-d7f78b782443 tempest-SnapshotsActionsTest-64857814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611" returned: 0 in 0.643s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:59 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-6064e339-68d8-4ca6-b99f-d7f78b782443 tempest-SnapshotsActionsTest-64857814 None] <== create_volume: return (1518ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:46:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6064e339-68d8-4ca6-b99f-d7f78b782443 tempest-SnapshotsActionsTest-64857814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.522s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:46:59 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6064e339-68d8-4ca6-b99f-d7f78b782443 tempest-SnapshotsActionsTest-64857814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83df5a7d-2fc9-441c-9951-52efd957ee13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfaf0e33-99f6-462d-87af-4614c1014611', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:59 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6064e339-68d8-4ca6-b99f-d7f78b782443 tempest-SnapshotsActionsTest-64857814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5598f2b8-d518-464e-b090-698f1e83ba21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:59 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-6064e339-68d8-4ca6-b99f-d7f78b782443 tempest-SnapshotsActionsTest-64857814 None] Volume volume-bfaf0e33-99f6-462d-87af-4614c1014611 (bfaf0e33-99f6-462d-87af-4614c1014611): created successfully Jul 08 18:46:59 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6064e339-68d8-4ca6-b99f-d7f78b782443 tempest-SnapshotsActionsTest-64857814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5598f2b8-d518-464e-b090-698f1e83ba21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:59 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6064e339-68d8-4ca6-b99f-d7f78b782443 tempest-SnapshotsActionsTest-64857814 None] Flow 'volume_create_manager' (a8334737-78b4-4e2a-a2af-30f6ab5e1e18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:46:59 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-6064e339-68d8-4ca6-b99f-d7f78b782443 tempest-SnapshotsActionsTest-64857814 None] Created volume successfully. Jul 08 18:46:59 devstack sudo[97864]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f015fb26-5f2c-4d53-8207-1d719e9ec97a tempest-VolumesGetTest-918879318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c0bf4764-fa7b-4e89-8af2-ca17dcd3fb00" returned: 0 in 0.697s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:59 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-f015fb26-5f2c-4d53-8207-1d719e9ec97a tempest-VolumesGetTest-918879318 None] Lock "cinder-quobyte-c0bf4764-fa7b-4e89-8af2-ca17dcd3fb00" released by "delete_volume" :: held 1.618s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:46:59 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-f015fb26-5f2c-4d53-8207-1d719e9ec97a tempest-VolumesGetTest-918879318 None] Created reservations ['cb4d9b83-98c3-401b-bcb2-4b5fc3bc78a7', '5a049a65-a91f-470d-b5cd-b595032b9344', '06468ce0-f7d4-4aea-8694-c3932db0d68b', 'd0902f13-4869-4a65-94d1-e9a3880e288f'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:46:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f015fb26-5f2c-4d53-8207-1d719e9ec97a tempest-VolumesGetTest-918879318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:46:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f015fb26-5f2c-4d53-8207-1d719e9ec97a tempest-VolumesGetTest-918879318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:46:59 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-f015fb26-5f2c-4d53-8207-1d719e9ec97a tempest-VolumesGetTest-918879318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:46:59 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-f015fb26-5f2c-4d53-8207-1d719e9ec97a tempest-VolumesGetTest-918879318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:46:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f015fb26-5f2c-4d53-8207-1d719e9ec97a tempest-VolumesGetTest-918879318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:46:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f015fb26-5f2c-4d53-8207-1d719e9ec97a tempest-VolumesGetTest-918879318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:59 devstack sudo[97869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:46:59 devstack sudo[97869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-ef426206-ad50-419a-904e-5a07186ddd67 tempest-SnapshotsActionsTest-64857814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:47:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-ef426206-ad50-419a-904e-5a07186ddd67 tempest-SnapshotsActionsTest-64857814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:47:00 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-e1a13084-ed71-4635-b6a6-9bfccb32d116 tempest-VolumesGetTest-918879318 None] Acquiring lock "cinder-64f3009d-07ba-4cf3-aacb-932132fd9b18-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:47:00 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-ef426206-ad50-419a-904e-5a07186ddd67 tempest-SnapshotsActionsTest-64857814 None] Creating offline snapshot 94ce823e-78f0-456a-8a6d-ac2c9f11ed24 of volume bfaf0e33-99f6-462d-87af-4614c1014611 {{(pid=86873) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:47:00 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-e1a13084-ed71-4635-b6a6-9bfccb32d116 tempest-VolumesGetTest-918879318 None] Lock "cinder-64f3009d-07ba-4cf3-aacb-932132fd9b18-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:47:00 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0bce7a8-296a-42c8-81f0-242282b252ae]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:47:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ef426206-ad50-419a-904e-5a07186ddd67 tempest-SnapshotsActionsTest-64857814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:00 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-e1a13084-ed71-4635-b6a6-9bfccb32d116 tempest-VolumesGetTest-918879318 None] Acquiring lock "cinder-quobyte-64f3009d-07ba-4cf3-aacb-932132fd9b18" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:47:00 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-e1a13084-ed71-4635-b6a6-9bfccb32d116 tempest-VolumesGetTest-918879318 None] Lock "cinder-quobyte-64f3009d-07ba-4cf3-aacb-932132fd9b18" acquired by "delete_volume" :: waited 0.019s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:47:00 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9bf2fc-e8fd-4514-84e4-8d1e6470923f]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:47:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e1a13084-ed71-4635-b6a6-9bfccb32d116 tempest-VolumesGetTest-918879318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-64f3009d-07ba-4cf3-aacb-932132fd9b18 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:00 devstack sudo[97871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611 Jul 08 18:47:00 devstack sudo[97871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:00 devstack sudo[97869]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f015fb26-5f2c-4d53-8207-1d719e9ec97a tempest-VolumesGetTest-918879318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.745s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:00 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-f015fb26-5f2c-4d53-8207-1d719e9ec97a tempest-VolumesGetTest-918879318 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:47:00 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-f015fb26-5f2c-4d53-8207-1d719e9ec97a tempest-VolumesGetTest-918879318 None] Deleted volume successfully. Jul 08 18:47:00 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-f015fb26-5f2c-4d53-8207-1d719e9ec97a tempest-VolumesGetTest-918879318 None] Lock "cinder-c0bf4764-fa7b-4e89-8af2-ca17dcd3fb00-delete_volume" released by "delete_volume" :: held 2.564s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:47:00 devstack sudo[97873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-64f3009d-07ba-4cf3-aacb-932132fd9b18 Jul 08 18:47:00 devstack sudo[97873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:01 devstack sudo[97871]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ef426206-ad50-419a-904e-5a07186ddd67 tempest-SnapshotsActionsTest-64857814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611" returned: 0 in 0.828s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ef426206-ad50-419a-904e-5a07186ddd67 tempest-SnapshotsActionsTest-64857814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24 1G {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:01 devstack sudo[97881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24 1G Jul 08 18:47:01 devstack sudo[97881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:01 devstack sudo[97873]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e1a13084-ed71-4635-b6a6-9bfccb32d116 tempest-VolumesGetTest-918879318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-64f3009d-07ba-4cf3-aacb-932132fd9b18" returned: 0 in 0.792s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e1a13084-ed71-4635-b6a6-9bfccb32d116 tempest-VolumesGetTest-918879318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-64f3009d-07ba-4cf3-aacb-932132fd9b18 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:01 devstack sudo[97883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-64f3009d-07ba-4cf3-aacb-932132fd9b18 Jul 08 18:47:01 devstack sudo[97883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:02 devstack sudo[97881]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ef426206-ad50-419a-904e-5a07186ddd67 tempest-SnapshotsActionsTest-64857814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24 1G" returned: 0 in 0.856s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ef426206-ad50-419a-904e-5a07186ddd67 tempest-SnapshotsActionsTest-64857814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfaf0e33-99f6-462d-87af-4614c1014611 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:02 devstack sudo[97883]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e1a13084-ed71-4635-b6a6-9bfccb32d116 tempest-VolumesGetTest-918879318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-64f3009d-07ba-4cf3-aacb-932132fd9b18" returned: 1 in 0.793s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e1a13084-ed71-4635-b6a6-9bfccb32d116 tempest-VolumesGetTest-918879318 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-64f3009d-07ba-4cf3-aacb-932132fd9b18' failed. Not Retrying. {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:47:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e1a13084-ed71-4635-b6a6-9bfccb32d116 tempest-VolumesGetTest-918879318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-64f3009d-07ba-4cf3-aacb-932132fd9b18 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:02 devstack sudo[97927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfaf0e33-99f6-462d-87af-4614c1014611 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24 Jul 08 18:47:02 devstack sudo[97927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:02 devstack sudo[97928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-64f3009d-07ba-4cf3-aacb-932132fd9b18 Jul 08 18:47:02 devstack sudo[97928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:02 devstack sudo[97928]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e1a13084-ed71-4635-b6a6-9bfccb32d116 tempest-VolumesGetTest-918879318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-64f3009d-07ba-4cf3-aacb-932132fd9b18" returned: 0 in 0.678s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:02 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-e1a13084-ed71-4635-b6a6-9bfccb32d116 tempest-VolumesGetTest-918879318 None] Lock "cinder-quobyte-64f3009d-07ba-4cf3-aacb-932132fd9b18" released by "delete_volume" :: held 2.325s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:47:02 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-e1a13084-ed71-4635-b6a6-9bfccb32d116 tempest-VolumesGetTest-918879318 None] Created reservations ['5a8697e2-8783-43d5-b1b9-c91acdedf42c', 'ce81a7ca-b515-4669-a54b-bdddc378b2f9', 'c275ab01-3e68-4be7-b682-38c14247a1b5', '4296518c-311b-48dc-a0f1-de7671ab63d2'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:47:02 devstack sudo[97927]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ef426206-ad50-419a-904e-5a07186ddd67 tempest-SnapshotsActionsTest-64857814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfaf0e33-99f6-462d-87af-4614c1014611 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24" returned: 0 in 0.767s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:02 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-ef426206-ad50-419a-904e-5a07186ddd67 tempest-SnapshotsActionsTest-64857814 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24 is being set with open permissions: ugo+rw Jul 08 18:47:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ef426206-ad50-419a-904e-5a07186ddd67 tempest-SnapshotsActionsTest-64857814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:02 devstack sudo[97938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24 Jul 08 18:47:02 devstack sudo[97938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-e1a13084-ed71-4635-b6a6-9bfccb32d116 tempest-VolumesGetTest-918879318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:47:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-e1a13084-ed71-4635-b6a6-9bfccb32d116 tempest-VolumesGetTest-918879318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:47:02 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-e1a13084-ed71-4635-b6a6-9bfccb32d116 tempest-VolumesGetTest-918879318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:47:02 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-e1a13084-ed71-4635-b6a6-9bfccb32d116 tempest-VolumesGetTest-918879318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:47:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-e1a13084-ed71-4635-b6a6-9bfccb32d116 tempest-VolumesGetTest-918879318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:47:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e1a13084-ed71-4635-b6a6-9bfccb32d116 tempest-VolumesGetTest-918879318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:02 devstack sudo[97940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:47:02 devstack sudo[97940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:03 devstack sudo[97938]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ef426206-ad50-419a-904e-5a07186ddd67 tempest-SnapshotsActionsTest-64857814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24" returned: 0 in 0.723s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:03 devstack sudo[97940]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e1a13084-ed71-4635-b6a6-9bfccb32d116 tempest-VolumesGetTest-918879318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.658s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:03 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-e1a13084-ed71-4635-b6a6-9bfccb32d116 tempest-VolumesGetTest-918879318 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:47:03 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-e1a13084-ed71-4635-b6a6-9bfccb32d116 tempest-VolumesGetTest-918879318 None] Deleted volume successfully. Jul 08 18:47:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ef426206-ad50-419a-904e-5a07186ddd67 tempest-SnapshotsActionsTest-64857814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:03 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-e1a13084-ed71-4635-b6a6-9bfccb32d116 tempest-VolumesGetTest-918879318 None] Lock "cinder-64f3009d-07ba-4cf3-aacb-932132fd9b18-delete_volume" released by "delete_volume" :: held 3.256s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:47:03 devstack sudo[97944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.info Jul 08 18:47:03 devstack sudo[97944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:04 devstack sudo[97944]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ef426206-ad50-419a-904e-5a07186ddd67 tempest-SnapshotsActionsTest-64857814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.info" returned: 0 in 0.737s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:04 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-ef426206-ad50-419a-904e-5a07186ddd67 tempest-SnapshotsActionsTest-64857814 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.info is being set with open permissions: ugo+rw Jul 08 18:47:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ef426206-ad50-419a-904e-5a07186ddd67 tempest-SnapshotsActionsTest-64857814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:04 devstack sudo[97947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.info Jul 08 18:47:04 devstack sudo[97947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:05 devstack sudo[97947]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ef426206-ad50-419a-904e-5a07186ddd67 tempest-SnapshotsActionsTest-64857814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.info" returned: 0 in 0.708s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-ef426206-ad50-419a-904e-5a07186ddd67 tempest-SnapshotsActionsTest-64857814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.756s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:47:05 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-ef426206-ad50-419a-904e-5a07186ddd67 tempest-SnapshotsActionsTest-64857814 None] Create snapshot completed successfully Jul 08 18:47:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-a1c6eddc-f094-4574-ad93-ded59190c288 tempest-SnapshotsActionsTest-64857814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:47:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-a1c6eddc-f094-4574-ad93-ded59190c288 tempest-SnapshotsActionsTest-64857814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:47:06 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-a1c6eddc-f094-4574-ad93-ded59190c288 tempest-SnapshotsActionsTest-64857814 None] Creating offline snapshot b964b5d1-07df-4471-9b43-641770e27d05 of volume bfaf0e33-99f6-462d-87af-4614c1014611 {{(pid=86873) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:47:06 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0fef14b-18de-4677-9b8e-3604224baa09]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:47:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-a1c6eddc-f094-4574-ad93-ded59190c288 tempest-SnapshotsActionsTest-64857814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:06 devstack sudo[97950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24 Jul 08 18:47:06 devstack sudo[97950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:06 devstack sudo[97950]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-a1c6eddc-f094-4574-ad93-ded59190c288 tempest-SnapshotsActionsTest-64857814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24" returned: 0 in 0.801s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:06 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-a1c6eddc-f094-4574-ad93-ded59190c288 tempest-SnapshotsActionsTest-64857814 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bfaf0e33-99f6-462d-87af-4614c1014611(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:47:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-a1c6eddc-f094-4574-ad93-ded59190c288 tempest-SnapshotsActionsTest-64857814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.b964b5d1-07df-4471-9b43-641770e27d05 1G {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:06 devstack sudo[97956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.b964b5d1-07df-4471-9b43-641770e27d05 1G Jul 08 18:47:06 devstack sudo[97956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:07 devstack sudo[97956]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-a1c6eddc-f094-4574-ad93-ded59190c288 tempest-SnapshotsActionsTest-64857814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.b964b5d1-07df-4471-9b43-641770e27d05 1G" returned: 0 in 0.917s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-a1c6eddc-f094-4574-ad93-ded59190c288 tempest-SnapshotsActionsTest-64857814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.b964b5d1-07df-4471-9b43-641770e27d05 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:07 devstack sudo[97962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.b964b5d1-07df-4471-9b43-641770e27d05 Jul 08 18:47:07 devstack sudo[97962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:08 devstack sudo[97962]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-a1c6eddc-f094-4574-ad93-ded59190c288 tempest-SnapshotsActionsTest-64857814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.b964b5d1-07df-4471-9b43-641770e27d05" returned: 0 in 0.692s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:08 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-a1c6eddc-f094-4574-ad93-ded59190c288 tempest-SnapshotsActionsTest-64857814 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.b964b5d1-07df-4471-9b43-641770e27d05 is being set with open permissions: ugo+rw Jul 08 18:47:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-a1c6eddc-f094-4574-ad93-ded59190c288 tempest-SnapshotsActionsTest-64857814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.b964b5d1-07df-4471-9b43-641770e27d05 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:08 devstack sudo[97967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.b964b5d1-07df-4471-9b43-641770e27d05 Jul 08 18:47:08 devstack sudo[97967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:09 devstack sudo[97967]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-a1c6eddc-f094-4574-ad93-ded59190c288 tempest-SnapshotsActionsTest-64857814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.b964b5d1-07df-4471-9b43-641770e27d05" returned: 0 in 0.705s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-a1c6eddc-f094-4574-ad93-ded59190c288 tempest-SnapshotsActionsTest-64857814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.244s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:47:09 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-a1c6eddc-f094-4574-ad93-ded59190c288 tempest-SnapshotsActionsTest-64857814 None] Create snapshot completed successfully Jul 08 18:47:10 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6479af7b-bd0e-411d-9996-4a77adba703b tempest-SnapshotsActionsTest-2018009330 None] Acquiring lock "cinder-b964b5d1-07df-4471-9b43-641770e27d05-delete_snapshot" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:47:10 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6479af7b-bd0e-411d-9996-4a77adba703b tempest-SnapshotsActionsTest-2018009330 None] Lock "cinder-b964b5d1-07df-4471-9b43-641770e27d05-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:47:10 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6479af7b-bd0e-411d-9996-4a77adba703b tempest-SnapshotsActionsTest-2018009330 None] Acquiring lock "cinder-quobyte-bfaf0e33-99f6-462d-87af-4614c1014611" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:47:10 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6479af7b-bd0e-411d-9996-4a77adba703b tempest-SnapshotsActionsTest-2018009330 None] Lock "cinder-quobyte-bfaf0e33-99f6-462d-87af-4614c1014611" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:47:10 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6479af7b-bd0e-411d-9996-4a77adba703b tempest-SnapshotsActionsTest-2018009330 None] Acquiring lock "cinder-quobyte-b964b5d1-07df-4471-9b43-641770e27d05" by "_delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:47:10 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6479af7b-bd0e-411d-9996-4a77adba703b tempest-SnapshotsActionsTest-2018009330 None] Lock "cinder-quobyte-b964b5d1-07df-4471-9b43-641770e27d05" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:47:10 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-6479af7b-bd0e-411d-9996-4a77adba703b tempest-SnapshotsActionsTest-2018009330 None] Deleting offline snapshot b964b5d1-07df-4471-9b43-641770e27d05 of volume bfaf0e33-99f6-462d-87af-4614c1014611 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:47:10 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-6479af7b-bd0e-411d-9996-4a77adba703b tempest-SnapshotsActionsTest-2018009330 None] snapshot_file for this snap is: volume-bfaf0e33-99f6-462d-87af-4614c1014611.b964b5d1-07df-4471-9b43-641770e27d05 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:47:10 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3c771f-a11b-4674-8f56-be2a1d34d438]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:47:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6479af7b-bd0e-411d-9996-4a77adba703b tempest-SnapshotsActionsTest-2018009330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.b964b5d1-07df-4471-9b43-641770e27d05 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:10 devstack sudo[97970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.b964b5d1-07df-4471-9b43-641770e27d05 Jul 08 18:47:10 devstack sudo[97970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:11 devstack sudo[97970]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6479af7b-bd0e-411d-9996-4a77adba703b tempest-SnapshotsActionsTest-2018009330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.b964b5d1-07df-4471-9b43-641770e27d05" returned: 0 in 0.873s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:11 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-6479af7b-bd0e-411d-9996-4a77adba703b tempest-SnapshotsActionsTest-2018009330 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bfaf0e33-99f6-462d-87af-4614c1014611(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:47:11 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94ca97a-0916-4c27-bd38-bd9e30b2c162]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:47:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6479af7b-bd0e-411d-9996-4a77adba703b tempest-SnapshotsActionsTest-2018009330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:11 devstack sudo[97975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24 Jul 08 18:47:11 devstack sudo[97975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:12 devstack sudo[97975]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6479af7b-bd0e-411d-9996-4a77adba703b tempest-SnapshotsActionsTest-2018009330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24" returned: 0 in 0.795s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:12 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-6479af7b-bd0e-411d-9996-4a77adba703b tempest-SnapshotsActionsTest-2018009330 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bfaf0e33-99f6-462d-87af-4614c1014611(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:47:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6479af7b-bd0e-411d-9996-4a77adba703b tempest-SnapshotsActionsTest-2018009330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.b964b5d1-07df-4471-9b43-641770e27d05 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:12 devstack sudo[97981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.b964b5d1-07df-4471-9b43-641770e27d05 Jul 08 18:47:12 devstack sudo[97981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:13 devstack sudo[97981]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6479af7b-bd0e-411d-9996-4a77adba703b tempest-SnapshotsActionsTest-2018009330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.b964b5d1-07df-4471-9b43-641770e27d05" returned: 0 in 0.842s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6479af7b-bd0e-411d-9996-4a77adba703b tempest-SnapshotsActionsTest-2018009330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.b964b5d1-07df-4471-9b43-641770e27d05 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:13 devstack sudo[97987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.b964b5d1-07df-4471-9b43-641770e27d05 Jul 08 18:47:13 devstack sudo[97987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:13 devstack sudo[97987]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6479af7b-bd0e-411d-9996-4a77adba703b tempest-SnapshotsActionsTest-2018009330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.b964b5d1-07df-4471-9b43-641770e27d05" returned: 0 in 0.695s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:13 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6479af7b-bd0e-411d-9996-4a77adba703b tempest-SnapshotsActionsTest-2018009330 None] Lock "cinder-quobyte-b964b5d1-07df-4471-9b43-641770e27d05" released by "_delete_snapshot" :: held 3.329s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:47:13 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6479af7b-bd0e-411d-9996-4a77adba703b tempest-SnapshotsActionsTest-2018009330 None] Lock "cinder-quobyte-bfaf0e33-99f6-462d-87af-4614c1014611" released by "delete_snapshot" :: held 3.362s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:47:13 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-6479af7b-bd0e-411d-9996-4a77adba703b tempest-SnapshotsActionsTest-2018009330 None] Created reservations ['30f697f1-b66c-46a3-b2ff-5f4275c1fc77', 'e996e0ac-a612-4802-a184-55655e0d6662', '56f29ad6-6462-4565-b3e6-61e157cf843f', '76d54d4c-c1a0-4191-bae4-916368f81f3f'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:47:13 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-6479af7b-bd0e-411d-9996-4a77adba703b tempest-SnapshotsActionsTest-2018009330 None] Delete snapshot completed successfully. Jul 08 18:47:14 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6479af7b-bd0e-411d-9996-4a77adba703b tempest-SnapshotsActionsTest-2018009330 None] Lock "cinder-b964b5d1-07df-4471-9b43-641770e27d05-delete_snapshot" released by "delete_snapshot" :: held 3.516s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:47:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-81f34e08-0186-454d-b1b0-cd5673fbbb29 tempest-SnapshotsActionsTest-64857814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:47:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-81f34e08-0186-454d-b1b0-cd5673fbbb29 tempest-SnapshotsActionsTest-64857814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:47:15 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-81f34e08-0186-454d-b1b0-cd5673fbbb29 tempest-SnapshotsActionsTest-64857814 None] Creating offline snapshot 8cc0f095-0bd2-4a13-84ef-5cbbe6ed3914 of volume bfaf0e33-99f6-462d-87af-4614c1014611 {{(pid=86873) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:47:15 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f51c938-3f66-4847-9ca8-d484feb0d7bc]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:47:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-81f34e08-0186-454d-b1b0-cd5673fbbb29 tempest-SnapshotsActionsTest-64857814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:15 devstack sudo[97990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24 Jul 08 18:47:15 devstack sudo[97990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:15 devstack sudo[97990]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-81f34e08-0186-454d-b1b0-cd5673fbbb29 tempest-SnapshotsActionsTest-64857814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24" returned: 0 in 0.848s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:15 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-81f34e08-0186-454d-b1b0-cd5673fbbb29 tempest-SnapshotsActionsTest-64857814 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bfaf0e33-99f6-462d-87af-4614c1014611(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:47:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-81f34e08-0186-454d-b1b0-cd5673fbbb29 tempest-SnapshotsActionsTest-64857814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.8cc0f095-0bd2-4a13-84ef-5cbbe6ed3914 1G {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:15 devstack sudo[98001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.8cc0f095-0bd2-4a13-84ef-5cbbe6ed3914 1G Jul 08 18:47:15 devstack sudo[98001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:16 devstack sudo[98001]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-81f34e08-0186-454d-b1b0-cd5673fbbb29 tempest-SnapshotsActionsTest-64857814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.8cc0f095-0bd2-4a13-84ef-5cbbe6ed3914 1G" returned: 0 in 0.873s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-81f34e08-0186-454d-b1b0-cd5673fbbb29 tempest-SnapshotsActionsTest-64857814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.8cc0f095-0bd2-4a13-84ef-5cbbe6ed3914 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:16 devstack sudo[98007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.8cc0f095-0bd2-4a13-84ef-5cbbe6ed3914 Jul 08 18:47:16 devstack sudo[98007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:17 devstack sudo[98007]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-81f34e08-0186-454d-b1b0-cd5673fbbb29 tempest-SnapshotsActionsTest-64857814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.8cc0f095-0bd2-4a13-84ef-5cbbe6ed3914" returned: 0 in 0.776s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:17 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-81f34e08-0186-454d-b1b0-cd5673fbbb29 tempest-SnapshotsActionsTest-64857814 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.8cc0f095-0bd2-4a13-84ef-5cbbe6ed3914 is being set with open permissions: ugo+rw Jul 08 18:47:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-81f34e08-0186-454d-b1b0-cd5673fbbb29 tempest-SnapshotsActionsTest-64857814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.8cc0f095-0bd2-4a13-84ef-5cbbe6ed3914 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:17 devstack sudo[98014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.8cc0f095-0bd2-4a13-84ef-5cbbe6ed3914 Jul 08 18:47:17 devstack sudo[98014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:18 devstack sudo[98014]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-81f34e08-0186-454d-b1b0-cd5673fbbb29 tempest-SnapshotsActionsTest-64857814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.8cc0f095-0bd2-4a13-84ef-5cbbe6ed3914" returned: 0 in 0.725s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-81f34e08-0186-454d-b1b0-cd5673fbbb29 tempest-SnapshotsActionsTest-64857814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.342s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:47:18 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-81f34e08-0186-454d-b1b0-cd5673fbbb29 tempest-SnapshotsActionsTest-64857814 None] Create snapshot completed successfully Jul 08 18:47:19 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-2fd3737e-77aa-4cba-b012-ba694f146677 tempest-SnapshotsActionsTest-2018009330 None] Acquiring lock "cinder-8cc0f095-0bd2-4a13-84ef-5cbbe6ed3914-delete_snapshot" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:47:19 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-2fd3737e-77aa-4cba-b012-ba694f146677 tempest-SnapshotsActionsTest-2018009330 None] Lock "cinder-8cc0f095-0bd2-4a13-84ef-5cbbe6ed3914-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:47:19 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-2fd3737e-77aa-4cba-b012-ba694f146677 tempest-SnapshotsActionsTest-2018009330 None] Acquiring lock "cinder-quobyte-bfaf0e33-99f6-462d-87af-4614c1014611" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:47:19 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-2fd3737e-77aa-4cba-b012-ba694f146677 tempest-SnapshotsActionsTest-2018009330 None] Lock "cinder-quobyte-bfaf0e33-99f6-462d-87af-4614c1014611" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:47:19 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-2fd3737e-77aa-4cba-b012-ba694f146677 tempest-SnapshotsActionsTest-2018009330 None] Acquiring lock "cinder-quobyte-8cc0f095-0bd2-4a13-84ef-5cbbe6ed3914" by "_delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:47:19 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-2fd3737e-77aa-4cba-b012-ba694f146677 tempest-SnapshotsActionsTest-2018009330 None] Lock "cinder-quobyte-8cc0f095-0bd2-4a13-84ef-5cbbe6ed3914" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:47:19 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-2fd3737e-77aa-4cba-b012-ba694f146677 tempest-SnapshotsActionsTest-2018009330 None] Deleting offline snapshot 8cc0f095-0bd2-4a13-84ef-5cbbe6ed3914 of volume bfaf0e33-99f6-462d-87af-4614c1014611 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:47:19 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-2fd3737e-77aa-4cba-b012-ba694f146677 tempest-SnapshotsActionsTest-2018009330 None] snapshot_file for this snap is: volume-bfaf0e33-99f6-462d-87af-4614c1014611.8cc0f095-0bd2-4a13-84ef-5cbbe6ed3914 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:47:19 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a44041d-bfac-4dbc-9072-e5dbd0b4fc6e]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:47:19 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2fd3737e-77aa-4cba-b012-ba694f146677 tempest-SnapshotsActionsTest-2018009330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.8cc0f095-0bd2-4a13-84ef-5cbbe6ed3914 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:19 devstack sudo[98018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.8cc0f095-0bd2-4a13-84ef-5cbbe6ed3914 Jul 08 18:47:19 devstack sudo[98018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:20 devstack sudo[98018]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2fd3737e-77aa-4cba-b012-ba694f146677 tempest-SnapshotsActionsTest-2018009330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.8cc0f095-0bd2-4a13-84ef-5cbbe6ed3914" returned: 0 in 0.799s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:20 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-2fd3737e-77aa-4cba-b012-ba694f146677 tempest-SnapshotsActionsTest-2018009330 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bfaf0e33-99f6-462d-87af-4614c1014611(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:47:20 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed41a5f-cc97-41af-93eb-1d17c7dc26b9]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:47:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2fd3737e-77aa-4cba-b012-ba694f146677 tempest-SnapshotsActionsTest-2018009330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:20 devstack sudo[98023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24 Jul 08 18:47:20 devstack sudo[98023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:21 devstack sudo[98023]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2fd3737e-77aa-4cba-b012-ba694f146677 tempest-SnapshotsActionsTest-2018009330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24" returned: 0 in 0.798s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:21 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-2fd3737e-77aa-4cba-b012-ba694f146677 tempest-SnapshotsActionsTest-2018009330 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bfaf0e33-99f6-462d-87af-4614c1014611(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:47:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2fd3737e-77aa-4cba-b012-ba694f146677 tempest-SnapshotsActionsTest-2018009330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.8cc0f095-0bd2-4a13-84ef-5cbbe6ed3914 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:21 devstack sudo[98028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.8cc0f095-0bd2-4a13-84ef-5cbbe6ed3914 Jul 08 18:47:21 devstack sudo[98028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:22 devstack sudo[98028]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2fd3737e-77aa-4cba-b012-ba694f146677 tempest-SnapshotsActionsTest-2018009330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.8cc0f095-0bd2-4a13-84ef-5cbbe6ed3914" returned: 0 in 0.965s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2fd3737e-77aa-4cba-b012-ba694f146677 tempest-SnapshotsActionsTest-2018009330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.8cc0f095-0bd2-4a13-84ef-5cbbe6ed3914 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:22 devstack sudo[98034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.8cc0f095-0bd2-4a13-84ef-5cbbe6ed3914 Jul 08 18:47:22 devstack sudo[98034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:22 devstack sudo[98034]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2fd3737e-77aa-4cba-b012-ba694f146677 tempest-SnapshotsActionsTest-2018009330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.8cc0f095-0bd2-4a13-84ef-5cbbe6ed3914" returned: 0 in 0.677s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:22 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-2fd3737e-77aa-4cba-b012-ba694f146677 tempest-SnapshotsActionsTest-2018009330 None] Lock "cinder-quobyte-8cc0f095-0bd2-4a13-84ef-5cbbe6ed3914" released by "_delete_snapshot" :: held 3.351s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:47:22 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-2fd3737e-77aa-4cba-b012-ba694f146677 tempest-SnapshotsActionsTest-2018009330 None] Lock "cinder-quobyte-bfaf0e33-99f6-462d-87af-4614c1014611" released by "delete_snapshot" :: held 3.378s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:47:22 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-2fd3737e-77aa-4cba-b012-ba694f146677 tempest-SnapshotsActionsTest-2018009330 None] Created reservations ['98445319-033d-43e2-9dbc-31bec10c809d', '10dc61ee-421d-4ced-9f75-46ef9b716eb7', '7fad8bf6-2e55-466d-8244-c182ec695d45', 'c2cd6389-0ac5-41f9-93dd-ba4c69b9fcfb'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:47:22 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-2fd3737e-77aa-4cba-b012-ba694f146677 tempest-SnapshotsActionsTest-2018009330 None] Delete snapshot completed successfully. Jul 08 18:47:22 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-2fd3737e-77aa-4cba-b012-ba694f146677 tempest-SnapshotsActionsTest-2018009330 None] Lock "cinder-8cc0f095-0bd2-4a13-84ef-5cbbe6ed3914-delete_snapshot" released by "delete_snapshot" :: held 3.544s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:47:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3b27c222-0869-4a4a-b30d-56bef2bd2da5 tempest-SnapshotsActionsTest-64857814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:47:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3b27c222-0869-4a4a-b30d-56bef2bd2da5 tempest-SnapshotsActionsTest-64857814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:47:23 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-3b27c222-0869-4a4a-b30d-56bef2bd2da5 tempest-SnapshotsActionsTest-64857814 None] Creating offline snapshot 034ded9e-cc5e-43bc-a443-e40322f9889a of volume bfaf0e33-99f6-462d-87af-4614c1014611 {{(pid=86873) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:47:23 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a6a8ab-af76-4d05-9065-eb8d2c2d9054]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:47:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3b27c222-0869-4a4a-b30d-56bef2bd2da5 tempest-SnapshotsActionsTest-64857814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:24 devstack sudo[98038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24 Jul 08 18:47:24 devstack sudo[98038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:24 devstack sudo[98038]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3b27c222-0869-4a4a-b30d-56bef2bd2da5 tempest-SnapshotsActionsTest-64857814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24" returned: 0 in 0.823s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:24 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-3b27c222-0869-4a4a-b30d-56bef2bd2da5 tempest-SnapshotsActionsTest-64857814 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bfaf0e33-99f6-462d-87af-4614c1014611(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:47:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3b27c222-0869-4a4a-b30d-56bef2bd2da5 tempest-SnapshotsActionsTest-64857814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.034ded9e-cc5e-43bc-a443-e40322f9889a 1G {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:24 devstack sudo[98043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.034ded9e-cc5e-43bc-a443-e40322f9889a 1G Jul 08 18:47:24 devstack sudo[98043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:25 devstack sudo[98043]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3b27c222-0869-4a4a-b30d-56bef2bd2da5 tempest-SnapshotsActionsTest-64857814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.034ded9e-cc5e-43bc-a443-e40322f9889a 1G" returned: 0 in 0.879s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3b27c222-0869-4a4a-b30d-56bef2bd2da5 tempest-SnapshotsActionsTest-64857814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.034ded9e-cc5e-43bc-a443-e40322f9889a {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:25 devstack sudo[98049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.034ded9e-cc5e-43bc-a443-e40322f9889a Jul 08 18:47:25 devstack sudo[98049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:26 devstack sudo[98049]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3b27c222-0869-4a4a-b30d-56bef2bd2da5 tempest-SnapshotsActionsTest-64857814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.034ded9e-cc5e-43bc-a443-e40322f9889a" returned: 0 in 0.716s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:26 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-3b27c222-0869-4a4a-b30d-56bef2bd2da5 tempest-SnapshotsActionsTest-64857814 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.034ded9e-cc5e-43bc-a443-e40322f9889a is being set with open permissions: ugo+rw Jul 08 18:47:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3b27c222-0869-4a4a-b30d-56bef2bd2da5 tempest-SnapshotsActionsTest-64857814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.034ded9e-cc5e-43bc-a443-e40322f9889a {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:26 devstack sudo[98054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.034ded9e-cc5e-43bc-a443-e40322f9889a Jul 08 18:47:26 devstack sudo[98054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:27 devstack sudo[98054]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3b27c222-0869-4a4a-b30d-56bef2bd2da5 tempest-SnapshotsActionsTest-64857814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.034ded9e-cc5e-43bc-a443-e40322f9889a" returned: 0 in 0.664s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3b27c222-0869-4a4a-b30d-56bef2bd2da5 tempest-SnapshotsActionsTest-64857814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.203s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:47:27 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-3b27c222-0869-4a4a-b30d-56bef2bd2da5 tempest-SnapshotsActionsTest-64857814 None] Create snapshot completed successfully Jul 08 18:47:28 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ab670cff-6bdd-4efe-a468-057bde3656a5 tempest-SnapshotsActionsTest-2018009330 None] Acquiring lock "cinder-034ded9e-cc5e-43bc-a443-e40322f9889a-delete_snapshot" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:47:28 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ab670cff-6bdd-4efe-a468-057bde3656a5 tempest-SnapshotsActionsTest-2018009330 None] Lock "cinder-034ded9e-cc5e-43bc-a443-e40322f9889a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:47:28 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ab670cff-6bdd-4efe-a468-057bde3656a5 tempest-SnapshotsActionsTest-2018009330 None] Acquiring lock "cinder-quobyte-bfaf0e33-99f6-462d-87af-4614c1014611" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:47:28 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ab670cff-6bdd-4efe-a468-057bde3656a5 tempest-SnapshotsActionsTest-2018009330 None] Lock "cinder-quobyte-bfaf0e33-99f6-462d-87af-4614c1014611" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:47:28 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ab670cff-6bdd-4efe-a468-057bde3656a5 tempest-SnapshotsActionsTest-2018009330 None] Acquiring lock "cinder-quobyte-034ded9e-cc5e-43bc-a443-e40322f9889a" by "_delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:47:28 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ab670cff-6bdd-4efe-a468-057bde3656a5 tempest-SnapshotsActionsTest-2018009330 None] Lock "cinder-quobyte-034ded9e-cc5e-43bc-a443-e40322f9889a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:47:28 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-ab670cff-6bdd-4efe-a468-057bde3656a5 tempest-SnapshotsActionsTest-2018009330 None] Deleting offline snapshot 034ded9e-cc5e-43bc-a443-e40322f9889a of volume bfaf0e33-99f6-462d-87af-4614c1014611 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:47:28 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-ab670cff-6bdd-4efe-a468-057bde3656a5 tempest-SnapshotsActionsTest-2018009330 None] snapshot_file for this snap is: volume-bfaf0e33-99f6-462d-87af-4614c1014611.034ded9e-cc5e-43bc-a443-e40322f9889a {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:47:28 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef75c417-dc72-4903-ae5f-2cdef5bc99dd]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:47:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ab670cff-6bdd-4efe-a468-057bde3656a5 tempest-SnapshotsActionsTest-2018009330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.034ded9e-cc5e-43bc-a443-e40322f9889a {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:28 devstack sudo[98057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.034ded9e-cc5e-43bc-a443-e40322f9889a Jul 08 18:47:28 devstack sudo[98057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:29 devstack sudo[98057]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ab670cff-6bdd-4efe-a468-057bde3656a5 tempest-SnapshotsActionsTest-2018009330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.034ded9e-cc5e-43bc-a443-e40322f9889a" returned: 0 in 0.772s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:29 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-ab670cff-6bdd-4efe-a468-057bde3656a5 tempest-SnapshotsActionsTest-2018009330 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bfaf0e33-99f6-462d-87af-4614c1014611(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:47:29 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b47c3b-c3af-446c-9f46-da48b9152f34]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:47:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ab670cff-6bdd-4efe-a468-057bde3656a5 tempest-SnapshotsActionsTest-2018009330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:29 devstack sudo[98062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24 Jul 08 18:47:29 devstack sudo[98062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:29 devstack sudo[98062]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ab670cff-6bdd-4efe-a468-057bde3656a5 tempest-SnapshotsActionsTest-2018009330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24" returned: 0 in 0.827s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:29 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-ab670cff-6bdd-4efe-a468-057bde3656a5 tempest-SnapshotsActionsTest-2018009330 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bfaf0e33-99f6-462d-87af-4614c1014611(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:47:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ab670cff-6bdd-4efe-a468-057bde3656a5 tempest-SnapshotsActionsTest-2018009330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.034ded9e-cc5e-43bc-a443-e40322f9889a {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:30 devstack sudo[98067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.034ded9e-cc5e-43bc-a443-e40322f9889a Jul 08 18:47:30 devstack sudo[98067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:30 devstack sudo[98067]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ab670cff-6bdd-4efe-a468-057bde3656a5 tempest-SnapshotsActionsTest-2018009330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.034ded9e-cc5e-43bc-a443-e40322f9889a" returned: 0 in 0.863s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ab670cff-6bdd-4efe-a468-057bde3656a5 tempest-SnapshotsActionsTest-2018009330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.034ded9e-cc5e-43bc-a443-e40322f9889a {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:30 devstack sudo[98072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.034ded9e-cc5e-43bc-a443-e40322f9889a Jul 08 18:47:30 devstack sudo[98072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:31 devstack sudo[98072]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ab670cff-6bdd-4efe-a468-057bde3656a5 tempest-SnapshotsActionsTest-2018009330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.034ded9e-cc5e-43bc-a443-e40322f9889a" returned: 0 in 0.706s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:31 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ab670cff-6bdd-4efe-a468-057bde3656a5 tempest-SnapshotsActionsTest-2018009330 None] Lock "cinder-quobyte-034ded9e-cc5e-43bc-a443-e40322f9889a" released by "_delete_snapshot" :: held 3.259s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:47:31 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ab670cff-6bdd-4efe-a468-057bde3656a5 tempest-SnapshotsActionsTest-2018009330 None] Lock "cinder-quobyte-bfaf0e33-99f6-462d-87af-4614c1014611" released by "delete_snapshot" :: held 3.282s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:47:31 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-ab670cff-6bdd-4efe-a468-057bde3656a5 tempest-SnapshotsActionsTest-2018009330 None] Created reservations ['f9472b17-03dc-4b30-b68a-dd9d0bbb11cc', '91f87177-eeb5-4ed9-8549-fe0f59c65332', '373fb5db-86e2-4aff-bb08-7c7d1949ef94', '23130b92-5ff9-476d-b509-fa674c703198'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:47:31 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-ab670cff-6bdd-4efe-a468-057bde3656a5 tempest-SnapshotsActionsTest-2018009330 None] Delete snapshot completed successfully. Jul 08 18:47:31 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ab670cff-6bdd-4efe-a468-057bde3656a5 tempest-SnapshotsActionsTest-2018009330 None] Lock "cinder-034ded9e-cc5e-43bc-a443-e40322f9889a-delete_snapshot" released by "delete_snapshot" :: held 3.443s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:47:31 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-35b47ed4-8148-4d88-a953-c3425173d00d tempest-TestInstancesWithCinderVolumes-1161949889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:47:31 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-35b47ed4-8148-4d88-a953-c3425173d00d tempest-TestInstancesWithCinderVolumes-1161949889 None] Flow 'volume_create_manager' (a833b43e-c146-4d40-b5e2-4b7d697c6c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:47:31 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-35b47ed4-8148-4d88-a953-c3425173d00d tempest-TestInstancesWithCinderVolumes-1161949889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (423759ed-2836-41d0-9cd3-12103833d4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:47:31 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-35b47ed4-8148-4d88-a953-c3425173d00d tempest-TestInstancesWithCinderVolumes-1161949889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (423759ed-2836-41d0-9cd3-12103833d4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:47:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1559352861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d69060b7-e4e2-43eb-a837-f3111628cc86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c66e6113631416eadb5e0ad63515bad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:47:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:47:32Z,use_quota=True,user_id='775ba66ca6f4438daeb5c2466f8cf569',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(074ba3b6-f56c-4f0d-b4ef-790339dd7d23),volume_type_id=074ba3b6-f56c-4f0d-b4ef-790339dd7d23)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:47:31 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-35b47ed4-8148-4d88-a953-c3425173d00d tempest-TestInstancesWithCinderVolumes-1161949889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65299cf2-d126-48bf-92e4-dec274cd90ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:47:31 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-35b47ed4-8148-4d88-a953-c3425173d00d tempest-TestInstancesWithCinderVolumes-1161949889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65299cf2-d126-48bf-92e4-dec274cd90ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:47:31 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-35b47ed4-8148-4d88-a953-c3425173d00d tempest-TestInstancesWithCinderVolumes-1161949889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55376629-9c31-4ccb-8b28-8a09d76d1acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:47:31 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-35b47ed4-8148-4d88-a953-c3425173d00d tempest-TestInstancesWithCinderVolumes-1161949889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55376629-9c31-4ccb-8b28-8a09d76d1acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd69060b7-e4e2-43eb-a837-f3111628cc86', 'volume_name': 'volume-d69060b7-e4e2-43eb-a837-f3111628cc86', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:47:31 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-35b47ed4-8148-4d88-a953-c3425173d00d tempest-TestInstancesWithCinderVolumes-1161949889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1055b0e-5552-48be-9899-a64e9777f843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:47:31 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-35b47ed4-8148-4d88-a953-c3425173d00d tempest-TestInstancesWithCinderVolumes-1161949889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1055b0e-5552-48be-9899-a64e9777f843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:47:31 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-35b47ed4-8148-4d88-a953-c3425173d00d tempest-TestInstancesWithCinderVolumes-1161949889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b98428cb-5691-44bd-8cca-e180bea433fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:47:31 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-35b47ed4-8148-4d88-a953-c3425173d00d tempest-TestInstancesWithCinderVolumes-1161949889 None] Volume d69060b7-e4e2-43eb-a837-f3111628cc86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d69060b7-e4e2-43eb-a837-f3111628cc86', 'volume_size': 1} Jul 08 18:47:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-35b47ed4-8148-4d88-a953-c3425173d00d tempest-TestInstancesWithCinderVolumes-1161949889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:47:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-35b47ed4-8148-4d88-a953-c3425173d00d tempest-TestInstancesWithCinderVolumes-1161949889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:47:31 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-35b47ed4-8148-4d88-a953-c3425173d00d tempest-TestInstancesWithCinderVolumes-1161949889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:47:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1559352861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d69060b7-e4e2-43eb-a837-f3111628cc86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c66e6113631416eadb5e0ad63515bad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:47:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:47:32Z,use_quota=True,user_id='775ba66ca6f4438daeb5c2466f8cf569',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(074ba3b6-f56c-4f0d-b4ef-790339dd7d23),volume_type_id=074ba3b6-f56c-4f0d-b4ef-790339dd7d23)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:47:31 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-35b47ed4-8148-4d88-a953-c3425173d00d tempest-TestInstancesWithCinderVolumes-1161949889 None] Creating volume d69060b7-e4e2-43eb-a837-f3111628cc86 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:47:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-35b47ed4-8148-4d88-a953-c3425173d00d tempest-TestInstancesWithCinderVolumes-1161949889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:47:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-35b47ed4-8148-4d88-a953-c3425173d00d tempest-TestInstancesWithCinderVolumes-1161949889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:47:31 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-35b47ed4-8148-4d88-a953-c3425173d00d tempest-TestInstancesWithCinderVolumes-1161949889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:47:31 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-35b47ed4-8148-4d88-a953-c3425173d00d tempest-TestInstancesWithCinderVolumes-1161949889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:47:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-35b47ed4-8148-4d88-a953-c3425173d00d tempest-TestInstancesWithCinderVolumes-1161949889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:47:31 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-35b47ed4-8148-4d88-a953-c3425173d00d tempest-TestInstancesWithCinderVolumes-1161949889 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:47:31 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-35b47ed4-8148-4d88-a953-c3425173d00d tempest-TestInstancesWithCinderVolumes-1161949889 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:47:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-35b47ed4-8148-4d88-a953-c3425173d00d tempest-TestInstancesWithCinderVolumes-1161949889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d69060b7-e4e2-43eb-a837-f3111628cc86 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:31 devstack sudo[98075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d69060b7-e4e2-43eb-a837-f3111628cc86 1073741824 Jul 08 18:47:31 devstack sudo[98075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:32 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-f462a183-dfdb-42f2-acc1-b26466f6ffd0 tempest-TestInstancesWithCinderVolumes-1161949889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:47:32 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f462a183-dfdb-42f2-acc1-b26466f6ffd0 tempest-TestInstancesWithCinderVolumes-1161949889 None] Flow 'volume_create_manager' (a738d295-0727-4640-81d3-e2ef2d20a698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:47:32 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f462a183-dfdb-42f2-acc1-b26466f6ffd0 tempest-TestInstancesWithCinderVolumes-1161949889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a4649b3-e4ca-43b8-afff-eb83fc57c8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:47:32 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f462a183-dfdb-42f2-acc1-b26466f6ffd0 tempest-TestInstancesWithCinderVolumes-1161949889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a4649b3-e4ca-43b8-afff-eb83fc57c8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:47:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1829468829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1940386e-ca1a-45ea-a5ab-56db44ed54a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c66e6113631416eadb5e0ad63515bad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:47:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:47:32Z,use_quota=True,user_id='775ba66ca6f4438daeb5c2466f8cf569',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994b6777-7463-447d-84ea-dd9dd55e7f01),volume_type_id=994b6777-7463-447d-84ea-dd9dd55e7f01)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:47:32 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f462a183-dfdb-42f2-acc1-b26466f6ffd0 tempest-TestInstancesWithCinderVolumes-1161949889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d583344-c198-4629-b087-750c029745e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:47:32 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f462a183-dfdb-42f2-acc1-b26466f6ffd0 tempest-TestInstancesWithCinderVolumes-1161949889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d583344-c198-4629-b087-750c029745e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:47:32 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f462a183-dfdb-42f2-acc1-b26466f6ffd0 tempest-TestInstancesWithCinderVolumes-1161949889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06f4b544-f79a-4533-956f-a46e1d110f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:47:32 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f462a183-dfdb-42f2-acc1-b26466f6ffd0 tempest-TestInstancesWithCinderVolumes-1161949889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06f4b544-f79a-4533-956f-a46e1d110f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1940386e-ca1a-45ea-a5ab-56db44ed54a5', 'volume_name': 'volume-1940386e-ca1a-45ea-a5ab-56db44ed54a5', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:47:32 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f462a183-dfdb-42f2-acc1-b26466f6ffd0 tempest-TestInstancesWithCinderVolumes-1161949889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58ad151a-20a8-4d3f-a351-d2d895787823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:47:32 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f462a183-dfdb-42f2-acc1-b26466f6ffd0 tempest-TestInstancesWithCinderVolumes-1161949889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58ad151a-20a8-4d3f-a351-d2d895787823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:47:32 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f462a183-dfdb-42f2-acc1-b26466f6ffd0 tempest-TestInstancesWithCinderVolumes-1161949889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2441553f-16df-418c-8473-c7fbdd1cfcf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:47:32 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-f462a183-dfdb-42f2-acc1-b26466f6ffd0 tempest-TestInstancesWithCinderVolumes-1161949889 None] Volume 1940386e-ca1a-45ea-a5ab-56db44ed54a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1940386e-ca1a-45ea-a5ab-56db44ed54a5', 'volume_size': 1} Jul 08 18:47:32 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f462a183-dfdb-42f2-acc1-b26466f6ffd0 tempest-TestInstancesWithCinderVolumes-1161949889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:47:32 devstack sudo[98075]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:32 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-35b47ed4-8148-4d88-a953-c3425173d00d tempest-TestInstancesWithCinderVolumes-1161949889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d69060b7-e4e2-43eb-a837-f3111628cc86 1073741824" returned: 0 in 0.973s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:33 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:47:33 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] Flow 'volume_create_manager' (0175da11-f8f3-405a-93b6-8bc8633d71e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:47:33 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (351d6b29-729d-4d9a-8dfc-af1c209ddf35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:47:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1eb771c3-e215-4b9e-b127-25d5fbe777e8 tempest-SnapshotsActionsTest-64857814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:47:33 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (351d6b29-729d-4d9a-8dfc-af1c209ddf35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:47:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-725346645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f30777a-4d9c-4ac0-bbc1-cfdeca050453,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c66e6113631416eadb5e0ad63515bad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:47:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:47:33Z,use_quota=True,user_id='775ba66ca6f4438daeb5c2466f8cf569',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2df613b1-67db-46f3-bade-1c87d9ae9657),volume_type_id=2df613b1-67db-46f3-bade-1c87d9ae9657)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:47:33 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (197da32e-60c2-4325-80db-21bccc0236a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:47:33 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (197da32e-60c2-4325-80db-21bccc0236a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:47:33 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (390d90fb-a38f-4072-a1ca-11c232d1201c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:47:33 devstack cinder-volume[86873]: DEBUG cinder.image.glance [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] Creating Keystone auth plugin from conf {{(pid=86873) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 18:47:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-35b47ed4-8148-4d88-a953-c3425173d00d tempest-TestInstancesWithCinderVolumes-1161949889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d69060b7-e4e2-43eb-a837-f3111628cc86 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:33 devstack sudo[98084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d69060b7-e4e2-43eb-a837-f3111628cc86 Jul 08 18:47:33 devstack sudo[98084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:33 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (390d90fb-a38f-4072-a1ca-11c232d1201c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4f30777a-4d9c-4ac0-bbc1-cfdeca050453', 'volume_name': 'volume-4f30777a-4d9c-4ac0-bbc1-cfdeca050453', 'volume_size': 1, 'image_id': '1971813a-f2a0-4e5d-8ea5-e3ec389e1466', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1971813a-f2a0-4e5d-8ea5-e3ec389e1466', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--411215184', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1c66e6113631416eadb5e0ad63515bad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1971813a-f2a0-4e5d-8ea5-e3ec389e1466', 'created_at': datetime.datetime(2026, 7, 8, 16, 47, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 47, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1971813a-f2a0-4e5d-8ea5-e3ec389e1466/file', 'properties': {}}, 'image_service': }' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:47:33 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dcf797d-18ac-4e24-8ed3-e74936e6be27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:47:33 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dcf797d-18ac-4e24-8ed3-e74936e6be27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:47:33 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31142cae-603c-4929-9d4b-89fd25617401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:47:33 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] Volume 4f30777a-4d9c-4ac0-bbc1-cfdeca050453: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4f30777a-4d9c-4ac0-bbc1-cfdeca050453', 'volume_size': 1, 'image_id': '1971813a-f2a0-4e5d-8ea5-e3ec389e1466', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1971813a-f2a0-4e5d-8ea5-e3ec389e1466', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--411215184', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1c66e6113631416eadb5e0ad63515bad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1971813a-f2a0-4e5d-8ea5-e3ec389e1466', 'created_at': datetime.datetime(2026, 7, 8, 16, 47, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 47, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1971813a-f2a0-4e5d-8ea5-e3ec389e1466/file', 'properties': {}}, 'image_service': } Jul 08 18:47:33 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] Trying to clone 4f30777a-4d9c-4ac0-bbc1-cfdeca050453 from image 1971813a-f2a0-4e5d-8ea5-e3ec389e1466 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1971813a-f2a0-4e5d-8ea5-e3ec389e1466', 'metadata': {}}]). {{(pid=86873) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 18:47:33 devstack sudo[98084]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-35b47ed4-8148-4d88-a953-c3425173d00d tempest-TestInstancesWithCinderVolumes-1161949889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d69060b7-e4e2-43eb-a837-f3111628cc86" returned: 0 in 0.769s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:33 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-35b47ed4-8148-4d88-a953-c3425173d00d tempest-TestInstancesWithCinderVolumes-1161949889 None] <== create_volume: return (1927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:47:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-35b47ed4-8148-4d88-a953-c3425173d00d tempest-TestInstancesWithCinderVolumes-1161949889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.930s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:47:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f462a183-dfdb-42f2-acc1-b26466f6ffd0 tempest-TestInstancesWithCinderVolumes-1161949889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.549s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:47:33 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-f462a183-dfdb-42f2-acc1-b26466f6ffd0 tempest-TestInstancesWithCinderVolumes-1161949889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:47:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1829468829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1940386e-ca1a-45ea-a5ab-56db44ed54a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c66e6113631416eadb5e0ad63515bad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:47:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:47:32Z,use_quota=True,user_id='775ba66ca6f4438daeb5c2466f8cf569',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994b6777-7463-447d-84ea-dd9dd55e7f01),volume_type_id=994b6777-7463-447d-84ea-dd9dd55e7f01)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:47:33 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-f462a183-dfdb-42f2-acc1-b26466f6ffd0 tempest-TestInstancesWithCinderVolumes-1161949889 None] Creating volume 1940386e-ca1a-45ea-a5ab-56db44ed54a5 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:47:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f462a183-dfdb-42f2-acc1-b26466f6ffd0 tempest-TestInstancesWithCinderVolumes-1161949889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:47:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f462a183-dfdb-42f2-acc1-b26466f6ffd0 tempest-TestInstancesWithCinderVolumes-1161949889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:47:33 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-f462a183-dfdb-42f2-acc1-b26466f6ffd0 tempest-TestInstancesWithCinderVolumes-1161949889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:47:33 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-f462a183-dfdb-42f2-acc1-b26466f6ffd0 tempest-TestInstancesWithCinderVolumes-1161949889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:47:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f462a183-dfdb-42f2-acc1-b26466f6ffd0 tempest-TestInstancesWithCinderVolumes-1161949889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:47:33 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-f462a183-dfdb-42f2-acc1-b26466f6ffd0 tempest-TestInstancesWithCinderVolumes-1161949889 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:47:33 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-f462a183-dfdb-42f2-acc1-b26466f6ffd0 tempest-TestInstancesWithCinderVolumes-1161949889 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:47:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f462a183-dfdb-42f2-acc1-b26466f6ffd0 tempest-TestInstancesWithCinderVolumes-1161949889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-1940386e-ca1a-45ea-a5ab-56db44ed54a5 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:33 devstack sudo[98087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-1940386e-ca1a-45ea-a5ab-56db44ed54a5 1073741824 Jul 08 18:47:33 devstack sudo[98087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:33 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-35b47ed4-8148-4d88-a953-c3425173d00d tempest-TestInstancesWithCinderVolumes-1161949889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b98428cb-5691-44bd-8cca-e180bea433fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d69060b7-e4e2-43eb-a837-f3111628cc86', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:47:33 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-35b47ed4-8148-4d88-a953-c3425173d00d tempest-TestInstancesWithCinderVolumes-1161949889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ce0d9b0-ad3c-4021-b793-963593111383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:47:33 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-35b47ed4-8148-4d88-a953-c3425173d00d tempest-TestInstancesWithCinderVolumes-1161949889 None] Volume volume-d69060b7-e4e2-43eb-a837-f3111628cc86 (d69060b7-e4e2-43eb-a837-f3111628cc86): created successfully Jul 08 18:47:33 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-35b47ed4-8148-4d88-a953-c3425173d00d tempest-TestInstancesWithCinderVolumes-1161949889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ce0d9b0-ad3c-4021-b793-963593111383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:47:33 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-35b47ed4-8148-4d88-a953-c3425173d00d tempest-TestInstancesWithCinderVolumes-1161949889 None] Flow 'volume_create_manager' (a833b43e-c146-4d40-b5e2-4b7d697c6c01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:47:33 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-35b47ed4-8148-4d88-a953-c3425173d00d tempest-TestInstancesWithCinderVolumes-1161949889 None] Created volume successfully. Jul 08 18:47:34 devstack sudo[98087]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f462a183-dfdb-42f2-acc1-b26466f6ffd0 tempest-TestInstancesWithCinderVolumes-1161949889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-1940386e-ca1a-45ea-a5ab-56db44ed54a5 1073741824" returned: 0 in 0.844s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f462a183-dfdb-42f2-acc1-b26466f6ffd0 tempest-TestInstancesWithCinderVolumes-1161949889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-1940386e-ca1a-45ea-a5ab-56db44ed54a5 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:34 devstack sudo[98093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-1940386e-ca1a-45ea-a5ab-56db44ed54a5 Jul 08 18:47:34 devstack sudo[98093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:35 devstack sudo[98093]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f462a183-dfdb-42f2-acc1-b26466f6ffd0 tempest-TestInstancesWithCinderVolumes-1161949889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-1940386e-ca1a-45ea-a5ab-56db44ed54a5" returned: 0 in 0.649s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:35 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-f462a183-dfdb-42f2-acc1-b26466f6ffd0 tempest-TestInstancesWithCinderVolumes-1161949889 None] <== create_volume: return (1539ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:47:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f462a183-dfdb-42f2-acc1-b26466f6ffd0 tempest-TestInstancesWithCinderVolumes-1161949889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.542s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:47:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1eb771c3-e215-4b9e-b127-25d5fbe777e8 tempest-SnapshotsActionsTest-64857814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.363s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:47:35 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f462a183-dfdb-42f2-acc1-b26466f6ffd0 tempest-TestInstancesWithCinderVolumes-1161949889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2441553f-16df-418c-8473-c7fbdd1cfcf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1940386e-ca1a-45ea-a5ab-56db44ed54a5', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:47:35 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f462a183-dfdb-42f2-acc1-b26466f6ffd0 tempest-TestInstancesWithCinderVolumes-1161949889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8014a91c-f010-4022-8197-3ea275cf8a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:47:35 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-1eb771c3-e215-4b9e-b127-25d5fbe777e8 tempest-SnapshotsActionsTest-64857814 None] Creating offline snapshot 633948f6-f250-40e6-83b6-fb9091e339e8 of volume bfaf0e33-99f6-462d-87af-4614c1014611 {{(pid=86873) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:47:35 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-f462a183-dfdb-42f2-acc1-b26466f6ffd0 tempest-TestInstancesWithCinderVolumes-1161949889 None] Volume volume-1940386e-ca1a-45ea-a5ab-56db44ed54a5 (1940386e-ca1a-45ea-a5ab-56db44ed54a5): created successfully Jul 08 18:47:35 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f462a183-dfdb-42f2-acc1-b26466f6ffd0 tempest-TestInstancesWithCinderVolumes-1161949889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8014a91c-f010-4022-8197-3ea275cf8a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:47:35 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f462a183-dfdb-42f2-acc1-b26466f6ffd0 tempest-TestInstancesWithCinderVolumes-1161949889 None] Flow 'volume_create_manager' (a738d295-0727-4640-81d3-e2ef2d20a698) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:47:35 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd0c6b9-0f47-44b2-95ec-f9f32198227d]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:47:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1eb771c3-e215-4b9e-b127-25d5fbe777e8 tempest-SnapshotsActionsTest-64857814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:35 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-f462a183-dfdb-42f2-acc1-b26466f6ffd0 tempest-TestInstancesWithCinderVolumes-1161949889 None] Created volume successfully. Jul 08 18:47:35 devstack sudo[98096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24 Jul 08 18:47:35 devstack sudo[98096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:36 devstack sudo[98096]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1eb771c3-e215-4b9e-b127-25d5fbe777e8 tempest-SnapshotsActionsTest-64857814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24" returned: 0 in 0.763s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:36 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-1eb771c3-e215-4b9e-b127-25d5fbe777e8 tempest-SnapshotsActionsTest-64857814 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bfaf0e33-99f6-462d-87af-4614c1014611(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:47:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1eb771c3-e215-4b9e-b127-25d5fbe777e8 tempest-SnapshotsActionsTest-64857814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.633948f6-f250-40e6-83b6-fb9091e339e8 1G {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:36 devstack sudo[98101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.633948f6-f250-40e6-83b6-fb9091e339e8 1G Jul 08 18:47:36 devstack sudo[98101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:36 devstack cinder-volume[86873]: DEBUG cinder.image.image_utils [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1971813a-f2a0-4e5d-8ea5-e3ec389e1466_k39ih255devstack@QuobyteHD, size 20.69 MB, duration 3.25 sec {{(pid=86873) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 18:47:36 devstack cinder-volume[86873]: INFO cinder.image.image_utils [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] Image download 20.69 MB at 6.37 MB/s Jul 08 18:47:36 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[8adbea5d-9b8b-46e3-9c58-449c369db9c1]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:47:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1971813a-f2a0-4e5d-8ea5-e3ec389e1466_k39ih255devstack@QuobyteHD {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:36 devstack sudo[98103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1971813a-f2a0-4e5d-8ea5-e3ec389e1466_k39ih255devstack@QuobyteHD Jul 08 18:47:36 devstack sudo[98103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:37 devstack sudo[98101]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1eb771c3-e215-4b9e-b127-25d5fbe777e8 tempest-SnapshotsActionsTest-64857814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.633948f6-f250-40e6-83b6-fb9091e339e8 1G" returned: 0 in 0.838s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1eb771c3-e215-4b9e-b127-25d5fbe777e8 tempest-SnapshotsActionsTest-64857814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.633948f6-f250-40e6-83b6-fb9091e339e8 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:37 devstack sudo[98108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.633948f6-f250-40e6-83b6-fb9091e339e8 Jul 08 18:47:37 devstack sudo[98108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:37 devstack sudo[98103]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1971813a-f2a0-4e5d-8ea5-e3ec389e1466_k39ih255devstack@QuobyteHD" returned: 0 in 0.736s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:37 devstack cinder-volume[86873]: DEBUG cinder.image.image_utils [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] Temporary image 1971813a-f2a0-4e5d-8ea5-e3ec389e1466 is fetched for user 775ba66ca6f4438daeb5c2466f8cf569. {{(pid=86873) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 18:47:37 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba2c668-771b-45c6-958b-531900ba10a4]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:47:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1971813a-f2a0-4e5d-8ea5-e3ec389e1466_k39ih255devstack@QuobyteHD {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:37 devstack sudo[98113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1971813a-f2a0-4e5d-8ea5-e3ec389e1466_k39ih255devstack@QuobyteHD Jul 08 18:47:37 devstack sudo[98113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:37 devstack sudo[98108]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1eb771c3-e215-4b9e-b127-25d5fbe777e8 tempest-SnapshotsActionsTest-64857814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.633948f6-f250-40e6-83b6-fb9091e339e8" returned: 0 in 0.710s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:37 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-1eb771c3-e215-4b9e-b127-25d5fbe777e8 tempest-SnapshotsActionsTest-64857814 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.633948f6-f250-40e6-83b6-fb9091e339e8 is being set with open permissions: ugo+rw Jul 08 18:47:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1eb771c3-e215-4b9e-b127-25d5fbe777e8 tempest-SnapshotsActionsTest-64857814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.633948f6-f250-40e6-83b6-fb9091e339e8 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:37 devstack sudo[98118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.633948f6-f250-40e6-83b6-fb9091e339e8 Jul 08 18:47:37 devstack sudo[98118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:38 devstack sudo[98113]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:38 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1971813a-f2a0-4e5d-8ea5-e3ec389e1466_k39ih255devstack@QuobyteHD" returned: 0 in 0.753s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:38 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:47:38 devstack sudo[98118]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:38 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1eb771c3-e215-4b9e-b127-25d5fbe777e8 tempest-SnapshotsActionsTest-64857814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.633948f6-f250-40e6-83b6-fb9091e339e8" returned: 0 in 0.644s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:38 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1eb771c3-e215-4b9e-b127-25d5fbe777e8 tempest-SnapshotsActionsTest-64857814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.071s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:47:38 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.306s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:47:38 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:47:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-725346645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f30777a-4d9c-4ac0-bbc1-cfdeca050453,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c66e6113631416eadb5e0ad63515bad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:47:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:47:33Z,use_quota=True,user_id='775ba66ca6f4438daeb5c2466f8cf569',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2df613b1-67db-46f3-bade-1c87d9ae9657),volume_type_id=2df613b1-67db-46f3-bade-1c87d9ae9657)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:47:38 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] Creating volume 4f30777a-4d9c-4ac0-bbc1-cfdeca050453 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:47:38 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:47:38 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:47:38 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:47:38 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:47:38 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:47:38 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:47:38 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:47:38 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4f30777a-4d9c-4ac0-bbc1-cfdeca050453 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:38 devstack sudo[98124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4f30777a-4d9c-4ac0-bbc1-cfdeca050453 1073741824 Jul 08 18:47:38 devstack sudo[98124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:38 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-1eb771c3-e215-4b9e-b127-25d5fbe777e8 tempest-SnapshotsActionsTest-64857814 None] Create snapshot completed successfully Jul 08 18:47:39 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-75f6e054-c76a-41a5-bee3-d01a37a65360 tempest-SnapshotsActionsTest-2018009330 None] Acquiring lock "cinder-633948f6-f250-40e6-83b6-fb9091e339e8-delete_snapshot" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:47:39 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-75f6e054-c76a-41a5-bee3-d01a37a65360 tempest-SnapshotsActionsTest-2018009330 None] Lock "cinder-633948f6-f250-40e6-83b6-fb9091e339e8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:47:39 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-75f6e054-c76a-41a5-bee3-d01a37a65360 tempest-SnapshotsActionsTest-2018009330 None] Acquiring lock "cinder-quobyte-bfaf0e33-99f6-462d-87af-4614c1014611" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:47:39 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-75f6e054-c76a-41a5-bee3-d01a37a65360 tempest-SnapshotsActionsTest-2018009330 None] Lock "cinder-quobyte-bfaf0e33-99f6-462d-87af-4614c1014611" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:47:39 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-75f6e054-c76a-41a5-bee3-d01a37a65360 tempest-SnapshotsActionsTest-2018009330 None] Acquiring lock "cinder-quobyte-633948f6-f250-40e6-83b6-fb9091e339e8" by "_delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:47:39 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-75f6e054-c76a-41a5-bee3-d01a37a65360 tempest-SnapshotsActionsTest-2018009330 None] Lock "cinder-quobyte-633948f6-f250-40e6-83b6-fb9091e339e8" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:47:39 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-75f6e054-c76a-41a5-bee3-d01a37a65360 tempest-SnapshotsActionsTest-2018009330 None] Deleting offline snapshot 633948f6-f250-40e6-83b6-fb9091e339e8 of volume bfaf0e33-99f6-462d-87af-4614c1014611 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:47:39 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-75f6e054-c76a-41a5-bee3-d01a37a65360 tempest-SnapshotsActionsTest-2018009330 None] snapshot_file for this snap is: volume-bfaf0e33-99f6-462d-87af-4614c1014611.633948f6-f250-40e6-83b6-fb9091e339e8 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:47:39 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[510ea25e-2ddd-4736-b603-4c8e80333f85]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:47:39 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-75f6e054-c76a-41a5-bee3-d01a37a65360 tempest-SnapshotsActionsTest-2018009330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.633948f6-f250-40e6-83b6-fb9091e339e8 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:39 devstack sudo[98124]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:39 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4f30777a-4d9c-4ac0-bbc1-cfdeca050453 1073741824" returned: 0 in 0.866s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:39 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4f30777a-4d9c-4ac0-bbc1-cfdeca050453 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:39 devstack sudo[98131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4f30777a-4d9c-4ac0-bbc1-cfdeca050453 Jul 08 18:47:39 devstack sudo[98131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:39 devstack sudo[98130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.633948f6-f250-40e6-83b6-fb9091e339e8 Jul 08 18:47:39 devstack sudo[98130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:40 devstack sudo[98131]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4f30777a-4d9c-4ac0-bbc1-cfdeca050453" returned: 0 in 0.665s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:40 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] <== create_volume: return (1572ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:47:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.575s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:47:40 devstack cinder-volume[86873]: DEBUG cinder.volume.volume_utils [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] Attempting download of 1971813a-f2a0-4e5d-8ea5-e3ec389e1466 ((None, [{'url': 'file:///opt/stack/data/glance/images/1971813a-f2a0-4e5d-8ea5-e3ec389e1466', 'metadata': {}}])) to volume 4f30777a-4d9c-4ac0-bbc1-cfdeca050453. {{(pid=86873) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 18:47:40 devstack sudo[98130]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-75f6e054-c76a-41a5-bee3-d01a37a65360 tempest-SnapshotsActionsTest-2018009330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.633948f6-f250-40e6-83b6-fb9091e339e8" returned: 0 in 0.772s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:40 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-75f6e054-c76a-41a5-bee3-d01a37a65360 tempest-SnapshotsActionsTest-2018009330 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bfaf0e33-99f6-462d-87af-4614c1014611(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:47:40 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[212460e9-1d47-40f4-9cc0-6d730ae40bda]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:47:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-75f6e054-c76a-41a5-bee3-d01a37a65360 tempest-SnapshotsActionsTest-2018009330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:40 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd20c3e8-7b64-42e2-b6c3-5e626b3ed397]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:47:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1971813a-f2a0-4e5d-8ea5-e3ec389e1466_g8zctgwm {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:40 devstack sudo[98138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24 Jul 08 18:47:40 devstack sudo[98138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:40 devstack sudo[98139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1971813a-f2a0-4e5d-8ea5-e3ec389e1466_g8zctgwm Jul 08 18:47:40 devstack sudo[98139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:40 devstack sudo[98139]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1971813a-f2a0-4e5d-8ea5-e3ec389e1466_g8zctgwm" returned: 0 in 0.766s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1971813a-f2a0-4e5d-8ea5-e3ec389e1466_g8zctgwm {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:40 devstack sudo[98138]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-75f6e054-c76a-41a5-bee3-d01a37a65360 tempest-SnapshotsActionsTest-2018009330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24" returned: 0 in 0.846s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:40 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-75f6e054-c76a-41a5-bee3-d01a37a65360 tempest-SnapshotsActionsTest-2018009330 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bfaf0e33-99f6-462d-87af-4614c1014611(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:47:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-75f6e054-c76a-41a5-bee3-d01a37a65360 tempest-SnapshotsActionsTest-2018009330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.633948f6-f250-40e6-83b6-fb9091e339e8 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:41 devstack sudo[98148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.633948f6-f250-40e6-83b6-fb9091e339e8 Jul 08 18:47:41 devstack sudo[98148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:41 devstack sudo[98147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1971813a-f2a0-4e5d-8ea5-e3ec389e1466_g8zctgwm Jul 08 18:47:41 devstack sudo[98147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:41 devstack sudo[98147]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1971813a-f2a0-4e5d-8ea5-e3ec389e1466_g8zctgwm" returned: 1 in 0.781s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1971813a-f2a0-4e5d-8ea5-e3ec389e1466_g8zctgwm' failed. Not Retrying. {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:47:41 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6b0c25-a9c5-4771-b8ca-7967577cd33b]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:47:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1971813a-f2a0-4e5d-8ea5-e3ec389e1466_k39ih255devstack@QuobyteHD {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:41 devstack sudo[98148]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-75f6e054-c76a-41a5-bee3-d01a37a65360 tempest-SnapshotsActionsTest-2018009330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.633948f6-f250-40e6-83b6-fb9091e339e8" returned: 0 in 0.800s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-75f6e054-c76a-41a5-bee3-d01a37a65360 tempest-SnapshotsActionsTest-2018009330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.633948f6-f250-40e6-83b6-fb9091e339e8 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:41 devstack sudo[98157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.633948f6-f250-40e6-83b6-fb9091e339e8 Jul 08 18:47:41 devstack sudo[98156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1971813a-f2a0-4e5d-8ea5-e3ec389e1466_k39ih255devstack@QuobyteHD Jul 08 18:47:41 devstack sudo[98157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:41 devstack sudo[98156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:42 devstack sudo[98157]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-75f6e054-c76a-41a5-bee3-d01a37a65360 tempest-SnapshotsActionsTest-2018009330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.633948f6-f250-40e6-83b6-fb9091e339e8" returned: 0 in 0.646s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:42 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-75f6e054-c76a-41a5-bee3-d01a37a65360 tempest-SnapshotsActionsTest-2018009330 None] Lock "cinder-quobyte-633948f6-f250-40e6-83b6-fb9091e339e8" released by "_delete_snapshot" :: held 3.168s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:47:42 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-75f6e054-c76a-41a5-bee3-d01a37a65360 tempest-SnapshotsActionsTest-2018009330 None] Lock "cinder-quobyte-bfaf0e33-99f6-462d-87af-4614c1014611" released by "delete_snapshot" :: held 3.199s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:47:42 devstack sudo[98156]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1971813a-f2a0-4e5d-8ea5-e3ec389e1466_k39ih255devstack@QuobyteHD" returned: 0 in 0.817s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:42 devstack cinder-volume[86873]: DEBUG cinder.image.image_utils [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] 1971813a-f2a0-4e5d-8ea5-e3ec389e1466 was qcow2, converting to raw {{(pid=86873) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 18:47:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1971813a-f2a0-4e5d-8ea5-e3ec389e1466_k39ih255devstack@QuobyteHD /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4f30777a-4d9c-4ac0-bbc1-cfdeca050453 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:42 devstack sudo[98165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1971813a-f2a0-4e5d-8ea5-e3ec389e1466_k39ih255devstack@QuobyteHD /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4f30777a-4d9c-4ac0-bbc1-cfdeca050453 Jul 08 18:47:42 devstack sudo[98165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:42 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-75f6e054-c76a-41a5-bee3-d01a37a65360 tempest-SnapshotsActionsTest-2018009330 None] Created reservations ['9ea4b09c-6bde-463f-920a-5f4b1e530009', 'ce35ced3-d9e5-4c87-9256-f829abe7d988', '6c3f413a-6f7e-4044-91e9-357c466f8d7d', '525bee6c-c443-49e0-859c-d8e57727194a'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:47:42 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-75f6e054-c76a-41a5-bee3-d01a37a65360 tempest-SnapshotsActionsTest-2018009330 None] Delete snapshot completed successfully. Jul 08 18:47:42 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-75f6e054-c76a-41a5-bee3-d01a37a65360 tempest-SnapshotsActionsTest-2018009330 None] Lock "cinder-633948f6-f250-40e6-83b6-fb9091e339e8-delete_snapshot" released by "delete_snapshot" :: held 3.398s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:47:43 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-3b8dabd8-61da-4538-952e-d4b0994dc78a tempest-SnapshotsActionsTest-64857814 None] Acquiring lock "cinder-94ce823e-78f0-456a-8a6d-ac2c9f11ed24-delete_snapshot" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:47:43 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-3b8dabd8-61da-4538-952e-d4b0994dc78a tempest-SnapshotsActionsTest-64857814 None] Lock "cinder-94ce823e-78f0-456a-8a6d-ac2c9f11ed24-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:47:43 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-3b8dabd8-61da-4538-952e-d4b0994dc78a tempest-SnapshotsActionsTest-64857814 None] Acquiring lock "cinder-quobyte-bfaf0e33-99f6-462d-87af-4614c1014611" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:47:43 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-3b8dabd8-61da-4538-952e-d4b0994dc78a tempest-SnapshotsActionsTest-64857814 None] Lock "cinder-quobyte-bfaf0e33-99f6-462d-87af-4614c1014611" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:47:43 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-3b8dabd8-61da-4538-952e-d4b0994dc78a tempest-SnapshotsActionsTest-64857814 None] Acquiring lock "cinder-quobyte-94ce823e-78f0-456a-8a6d-ac2c9f11ed24" by "_delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:47:44 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-3b8dabd8-61da-4538-952e-d4b0994dc78a tempest-SnapshotsActionsTest-64857814 None] Lock "cinder-quobyte-94ce823e-78f0-456a-8a6d-ac2c9f11ed24" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:47:44 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-3b8dabd8-61da-4538-952e-d4b0994dc78a tempest-SnapshotsActionsTest-64857814 None] Deleting offline snapshot 94ce823e-78f0-456a-8a6d-ac2c9f11ed24 of volume bfaf0e33-99f6-462d-87af-4614c1014611 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:47:44 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-3b8dabd8-61da-4538-952e-d4b0994dc78a tempest-SnapshotsActionsTest-64857814 None] snapshot_file for this snap is: volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:47:44 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[237ca851-e316-4011-ba02-6656b6d98fd7]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:47:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3b8dabd8-61da-4538-952e-d4b0994dc78a tempest-SnapshotsActionsTest-64857814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:44 devstack sudo[98175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24 Jul 08 18:47:44 devstack sudo[98175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:44 devstack sudo[98165]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1971813a-f2a0-4e5d-8ea5-e3ec389e1466_k39ih255devstack@QuobyteHD /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4f30777a-4d9c-4ac0-bbc1-cfdeca050453" returned: 0 in 2.038s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:44 devstack cinder-volume[86873]: DEBUG cinder.image.image_utils [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1971813a-f2a0-4e5d-8ea5-e3ec389e1466_k39ih255devstack@QuobyteHD, size 112.00 MB, duration 2.04 sec, destination /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4f30777a-4d9c-4ac0-bbc1-cfdeca050453 {{(pid=86873) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:47:44 devstack cinder-volume[86873]: INFO cinder.image.image_utils [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] Converted 112.00 MB image at 54.92 MB/s Jul 08 18:47:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4f30777a-4d9c-4ac0-bbc1-cfdeca050453 1G {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:44 devstack sudo[98177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4f30777a-4d9c-4ac0-bbc1-cfdeca050453 1G Jul 08 18:47:44 devstack sudo[98177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:44 devstack sudo[98175]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3b8dabd8-61da-4538-952e-d4b0994dc78a tempest-SnapshotsActionsTest-64857814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24" returned: 0 in 0.835s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:44 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-3b8dabd8-61da-4538-952e-d4b0994dc78a tempest-SnapshotsActionsTest-64857814 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bfaf0e33-99f6-462d-87af-4614c1014611(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:47:44 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[038ef064-8b2c-4abf-8f1a-7ce6ffa87184]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:47:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3b8dabd8-61da-4538-952e-d4b0994dc78a tempest-SnapshotsActionsTest-64857814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:45 devstack sudo[98182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611 Jul 08 18:47:45 devstack sudo[98182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:45 devstack sudo[98177]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4f30777a-4d9c-4ac0-bbc1-cfdeca050453 1G" returned: 0 in 0.707s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:45 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[25288e11-0a31-4c9d-9819-cea829fb2c40]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:47:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4f30777a-4d9c-4ac0-bbc1-cfdeca050453 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:45 devstack sudo[98187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4f30777a-4d9c-4ac0-bbc1-cfdeca050453 Jul 08 18:47:45 devstack sudo[98187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:45 devstack sudo[98182]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3b8dabd8-61da-4538-952e-d4b0994dc78a tempest-SnapshotsActionsTest-64857814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611" returned: 0 in 0.804s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3b8dabd8-61da-4538-952e-d4b0994dc78a tempest-SnapshotsActionsTest-64857814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:45 devstack sudo[98192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24 Jul 08 18:47:45 devstack sudo[98192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:46 devstack sudo[98187]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4f30777a-4d9c-4ac0-bbc1-cfdeca050453" returned: 0 in 0.773s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4f30777a-4d9c-4ac0-bbc1-cfdeca050453 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:46 devstack sudo[98196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4f30777a-4d9c-4ac0-bbc1-cfdeca050453 Jul 08 18:47:46 devstack sudo[98196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:46 devstack sudo[98192]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3b8dabd8-61da-4538-952e-d4b0994dc78a tempest-SnapshotsActionsTest-64857814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24" returned: 0 in 0.785s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3b8dabd8-61da-4538-952e-d4b0994dc78a tempest-SnapshotsActionsTest-64857814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:46 devstack sudo[98201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24 Jul 08 18:47:46 devstack sudo[98201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:46 devstack sudo[98196]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4f30777a-4d9c-4ac0-bbc1-cfdeca050453" returned: 1 in 0.746s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4f30777a-4d9c-4ac0-bbc1-cfdeca050453' failed. Not Retrying. {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:47:46 devstack cinder-volume[86873]: DEBUG cinder.volume.volume_utils [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] Downloaded image 1971813a-f2a0-4e5d-8ea5-e3ec389e1466 ((None, [{'url': 'file:///opt/stack/data/glance/images/1971813a-f2a0-4e5d-8ea5-e3ec389e1466', 'metadata': {}}])) to volume 4f30777a-4d9c-4ac0-bbc1-cfdeca050453 successfully. {{(pid=86873) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 18:47:46 devstack cinder-volume[86873]: DEBUG cinder.image.image_utils [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] Temporary image 1971813a-f2a0-4e5d-8ea5-e3ec389e1466 for user 775ba66ca6f4438daeb5c2466f8cf569 is deleted. {{(pid=86873) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 18:47:46 devstack cinder-volume[86873]: DEBUG cinder.volume.volume_utils [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] Marking volume 4f30777a-4d9c-4ac0-bbc1-cfdeca050453 as bootable. {{(pid=86873) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 18:47:46 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] Copying metadata from image 1971813a-f2a0-4e5d-8ea5-e3ec389e1466 to 4f30777a-4d9c-4ac0-bbc1-cfdeca050453. {{(pid=86873) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 18:47:46 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] Creating volume glance metadata for volume 4f30777a-4d9c-4ac0-bbc1-cfdeca050453 backed by image 1971813a-f2a0-4e5d-8ea5-e3ec389e1466 with: {'image_id': '1971813a-f2a0-4e5d-8ea5-e3ec389e1466', 'image_name': 'tempest-scenario-img--411215184', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86873) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 18:47:46 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31142cae-603c-4929-9d4b-89fd25617401) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f30777a-4d9c-4ac0-bbc1-cfdeca050453', 'volume_size': 1, 'image_id': '1971813a-f2a0-4e5d-8ea5-e3ec389e1466', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1971813a-f2a0-4e5d-8ea5-e3ec389e1466', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--411215184', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1c66e6113631416eadb5e0ad63515bad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1971813a-f2a0-4e5d-8ea5-e3ec389e1466', 'created_at': datetime.datetime(2026, 7, 8, 16, 47, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 47, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1971813a-f2a0-4e5d-8ea5-e3ec389e1466/file', 'properties': {}}, 'image_service': }' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:47:46 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3177b958-a028-4d3d-925c-cfa2c673ac97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:47:46 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] Volume volume-4f30777a-4d9c-4ac0-bbc1-cfdeca050453 (4f30777a-4d9c-4ac0-bbc1-cfdeca050453): created successfully Jul 08 18:47:46 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3177b958-a028-4d3d-925c-cfa2c673ac97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:47:46 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] Flow 'volume_create_manager' (0175da11-f8f3-405a-93b6-8bc8633d71e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:47:46 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-63ca3280-2f02-47a6-b6e4-493eada31753 tempest-TestInstancesWithCinderVolumes-1161949889 None] Created volume successfully. Jul 08 18:47:47 devstack sudo[98201]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3b8dabd8-61da-4538-952e-d4b0994dc78a tempest-SnapshotsActionsTest-64857814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611.94ce823e-78f0-456a-8a6d-ac2c9f11ed24" returned: 0 in 0.741s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:47 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-3b8dabd8-61da-4538-952e-d4b0994dc78a tempest-SnapshotsActionsTest-64857814 None] Lock "cinder-quobyte-94ce823e-78f0-456a-8a6d-ac2c9f11ed24" released by "_delete_snapshot" :: held 3.277s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:47:47 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-3b8dabd8-61da-4538-952e-d4b0994dc78a tempest-SnapshotsActionsTest-64857814 None] Lock "cinder-quobyte-bfaf0e33-99f6-462d-87af-4614c1014611" released by "delete_snapshot" :: held 3.303s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:47:47 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:SELECT=85,cinder:INSERT=34,cinder:UPDATE=94,cinder:DELETE=6 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:47:47 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:SELECT=86,cinder:UPDATE=76,cinder:INSERT=29,cinder:DELETE=7 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:47:47 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-3b8dabd8-61da-4538-952e-d4b0994dc78a tempest-SnapshotsActionsTest-64857814 None] Created reservations ['8d852643-ed87-498a-9fd7-dad6b753d358', '3deacc59-cd90-460f-af46-c3ee23285e2a', '17248340-f180-45d6-b7a0-d698f110ffc0', '21c361b0-9353-4ae8-acb0-e20750824e63'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:47:47 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-3b8dabd8-61da-4538-952e-d4b0994dc78a tempest-SnapshotsActionsTest-64857814 None] Delete snapshot completed successfully. Jul 08 18:47:47 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-3b8dabd8-61da-4538-952e-d4b0994dc78a tempest-SnapshotsActionsTest-64857814 None] Lock "cinder-94ce823e-78f0-456a-8a6d-ac2c9f11ed24-delete_snapshot" released by "delete_snapshot" :: held 3.453s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:47:48 devstack cinder-volume[86873]: DEBUG oslo_service.periodic_task [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86873) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:47:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:47:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:47:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:47:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:47:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:47:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:48 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-7700e3d9-ad74-48bd-a354-6bf331675fbd tempest-SnapshotsActionsTest-64857814 None] Acquiring lock "cinder-bfaf0e33-99f6-462d-87af-4614c1014611-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:47:48 devstack sudo[98207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:47:48 devstack sudo[98207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:48 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-7700e3d9-ad74-48bd-a354-6bf331675fbd tempest-SnapshotsActionsTest-64857814 None] Lock "cinder-bfaf0e33-99f6-462d-87af-4614c1014611-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:47:48 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-7700e3d9-ad74-48bd-a354-6bf331675fbd tempest-SnapshotsActionsTest-64857814 None] Acquiring lock "cinder-quobyte-bfaf0e33-99f6-462d-87af-4614c1014611" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:47:48 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-7700e3d9-ad74-48bd-a354-6bf331675fbd tempest-SnapshotsActionsTest-64857814 None] Lock "cinder-quobyte-bfaf0e33-99f6-462d-87af-4614c1014611" acquired by "delete_volume" :: waited 0.016s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:47:48 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[2115cb9a-79e5-4c9e-ac19-afbe24b910bc]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:47:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-7700e3d9-ad74-48bd-a354-6bf331675fbd tempest-SnapshotsActionsTest-64857814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:48 devstack sudo[98209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611 Jul 08 18:47:48 devstack sudo[98209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:48 devstack sudo[98207]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.750s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:48 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:47:48 devstack cinder-volume[86873]: DEBUG oslo_service.periodic_task [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running periodic task VolumeManager._thread_info {{(pid=86873) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:47:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] thread count: 29 {{(pid=86873) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:47:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] thread info: [<_MainThread(MainThread, started 138577734545536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86873) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:47:49 devstack sudo[98209]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-7700e3d9-ad74-48bd-a354-6bf331675fbd tempest-SnapshotsActionsTest-64857814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611" returned: 0 in 0.884s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-7700e3d9-ad74-48bd-a354-6bf331675fbd tempest-SnapshotsActionsTest-64857814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:49 devstack sudo[98218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611 Jul 08 18:47:49 devstack sudo[98218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:49 devstack sudo[98218]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-7700e3d9-ad74-48bd-a354-6bf331675fbd tempest-SnapshotsActionsTest-64857814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-bfaf0e33-99f6-462d-87af-4614c1014611" returned: 0 in 0.687s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:49 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-7700e3d9-ad74-48bd-a354-6bf331675fbd tempest-SnapshotsActionsTest-64857814 None] Lock "cinder-quobyte-bfaf0e33-99f6-462d-87af-4614c1014611" released by "delete_volume" :: held 1.642s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:47:50 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-7700e3d9-ad74-48bd-a354-6bf331675fbd tempest-SnapshotsActionsTest-64857814 None] Created reservations ['918f36b1-3924-48b3-b883-36c7f139ca71', '37ce7b1b-ce51-441c-a2b0-07392ccc32b5', '9e919d8b-f912-4830-a6b6-82b0376b295e', 'e38dc4f2-0c1c-4335-9ab7-5b6dcb415dd4'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:47:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-7700e3d9-ad74-48bd-a354-6bf331675fbd tempest-SnapshotsActionsTest-64857814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:47:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-7700e3d9-ad74-48bd-a354-6bf331675fbd tempest-SnapshotsActionsTest-64857814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:47:50 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-7700e3d9-ad74-48bd-a354-6bf331675fbd tempest-SnapshotsActionsTest-64857814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:47:50 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-7700e3d9-ad74-48bd-a354-6bf331675fbd tempest-SnapshotsActionsTest-64857814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:47:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-7700e3d9-ad74-48bd-a354-6bf331675fbd tempest-SnapshotsActionsTest-64857814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:47:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-7700e3d9-ad74-48bd-a354-6bf331675fbd tempest-SnapshotsActionsTest-64857814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:50 devstack sudo[98221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:47:50 devstack sudo[98221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:50 devstack sudo[98221]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-7700e3d9-ad74-48bd-a354-6bf331675fbd tempest-SnapshotsActionsTest-64857814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.685s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:50 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-7700e3d9-ad74-48bd-a354-6bf331675fbd tempest-SnapshotsActionsTest-64857814 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:47:50 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-7700e3d9-ad74-48bd-a354-6bf331675fbd tempest-SnapshotsActionsTest-64857814 None] Deleted volume successfully. Jul 08 18:47:50 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-7700e3d9-ad74-48bd-a354-6bf331675fbd tempest-SnapshotsActionsTest-64857814 None] Lock "cinder-bfaf0e33-99f6-462d-87af-4614c1014611-delete_volume" released by "delete_volume" :: held 2.583s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:47:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-fa2eded2-cf9f-4167-abd0-46b9e4c27a1b req-cc421286-0981-45cb-a66f-14c995331764 tempest-TestInstancesWithCinderVolumes-1161949889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:47:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-fa2eded2-cf9f-4167-abd0-46b9e4c27a1b req-cc421286-0981-45cb-a66f-14c995331764 tempest-TestInstancesWithCinderVolumes-1161949889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:47:55 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[0050e568-d415-4a3e-a023-b5ce9bc37d12]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:47:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-fa2eded2-cf9f-4167-abd0-46b9e4c27a1b req-cc421286-0981-45cb-a66f-14c995331764 tempest-TestInstancesWithCinderVolumes-1161949889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4f30777a-4d9c-4ac0-bbc1-cfdeca050453 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:55 devstack sudo[98233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4f30777a-4d9c-4ac0-bbc1-cfdeca050453 Jul 08 18:47:55 devstack sudo[98233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:56 devstack sudo[98233]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-fa2eded2-cf9f-4167-abd0-46b9e4c27a1b req-cc421286-0981-45cb-a66f-14c995331764 tempest-TestInstancesWithCinderVolumes-1161949889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4f30777a-4d9c-4ac0-bbc1-cfdeca050453" returned: 0 in 0.902s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-fa2eded2-cf9f-4167-abd0-46b9e4c27a1b req-cc421286-0981-45cb-a66f-14c995331764 tempest-TestInstancesWithCinderVolumes-1161949889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4f30777a-4d9c-4ac0-bbc1-cfdeca050453 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:56 devstack sudo[98238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4f30777a-4d9c-4ac0-bbc1-cfdeca050453 Jul 08 18:47:56 devstack sudo[98238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:57 devstack sudo[98238]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-fa2eded2-cf9f-4167-abd0-46b9e4c27a1b req-cc421286-0981-45cb-a66f-14c995331764 tempest-TestInstancesWithCinderVolumes-1161949889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4f30777a-4d9c-4ac0-bbc1-cfdeca050453" returned: 1 in 0.815s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-fa2eded2-cf9f-4167-abd0-46b9e4c27a1b req-cc421286-0981-45cb-a66f-14c995331764 tempest-TestInstancesWithCinderVolumes-1161949889 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4f30777a-4d9c-4ac0-bbc1-cfdeca050453' failed. Not Retrying. {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:47:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-fa2eded2-cf9f-4167-abd0-46b9e4c27a1b req-cc421286-0981-45cb-a66f-14c995331764 tempest-TestInstancesWithCinderVolumes-1161949889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.762s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:47:57 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-fa2eded2-cf9f-4167-abd0-46b9e4c27a1b req-cc421286-0981-45cb-a66f-14c995331764 tempest-TestInstancesWithCinderVolumes-1161949889 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2', 'name': 'volume-4f30777a-4d9c-4ac0-bbc1-cfdeca050453', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3887962c-f000-48a7-8730-b441c7d64ef2', 'enforce_multipath': True} {{(pid=86873) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 18:47:57 devstack cinder-volume[86873]: INFO cinder.volume.manager [req-fa2eded2-cf9f-4167-abd0-46b9e4c27a1b req-cc421286-0981-45cb-a66f-14c995331764 tempest-TestInstancesWithCinderVolumes-1161949889 None] attachment_update completed successfully. Jul 08 18:48:01 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-be320ba7-2937-4b30-8dd7-6b60abe7679b tempest-VolumesServicesTestJSON-128869496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:48:01 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-be320ba7-2937-4b30-8dd7-6b60abe7679b tempest-VolumesServicesTestJSON-128869496 None] Flow 'volume_create_manager' (7d598b76-125b-47e3-90b8-2ae9acc5c2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:48:01 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-be320ba7-2937-4b30-8dd7-6b60abe7679b tempest-VolumesServicesTestJSON-128869496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cde0fe3-55a3-4df6-b0a5-8f709d9b27b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:01 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-be320ba7-2937-4b30-8dd7-6b60abe7679b tempest-VolumesServicesTestJSON-128869496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cde0fe3-55a3-4df6-b0a5-8f709d9b27b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:48:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1550203637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b861fd2f-4266-4de6-a154-fbca2c65c899,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3deef1af2d4246d9a4c92cbf6ee4f666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:48:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:48:02Z,use_quota=True,user_id='cdfb7e82517d47f39601968d57ba4f27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:01 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-be320ba7-2937-4b30-8dd7-6b60abe7679b tempest-VolumesServicesTestJSON-128869496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3985697a-082b-4072-a66b-333ea53652a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:01 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-be320ba7-2937-4b30-8dd7-6b60abe7679b tempest-VolumesServicesTestJSON-128869496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3985697a-082b-4072-a66b-333ea53652a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:01 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-be320ba7-2937-4b30-8dd7-6b60abe7679b tempest-VolumesServicesTestJSON-128869496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f8a454a-8a65-46f1-9435-45e3085a2f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:01 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-be320ba7-2937-4b30-8dd7-6b60abe7679b tempest-VolumesServicesTestJSON-128869496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f8a454a-8a65-46f1-9435-45e3085a2f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b861fd2f-4266-4de6-a154-fbca2c65c899', 'volume_name': 'volume-b861fd2f-4266-4de6-a154-fbca2c65c899', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:01 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-be320ba7-2937-4b30-8dd7-6b60abe7679b tempest-VolumesServicesTestJSON-128869496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fde5d9dc-e4e0-4303-8af1-650bf93dcd6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:01 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-be320ba7-2937-4b30-8dd7-6b60abe7679b tempest-VolumesServicesTestJSON-128869496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fde5d9dc-e4e0-4303-8af1-650bf93dcd6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:01 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-be320ba7-2937-4b30-8dd7-6b60abe7679b tempest-VolumesServicesTestJSON-128869496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dcc0d48-2bcd-405c-8ab8-c7602779bc7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:01 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-be320ba7-2937-4b30-8dd7-6b60abe7679b tempest-VolumesServicesTestJSON-128869496 None] Volume b861fd2f-4266-4de6-a154-fbca2c65c899: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b861fd2f-4266-4de6-a154-fbca2c65c899', 'volume_size': 1} Jul 08 18:48:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-be320ba7-2937-4b30-8dd7-6b60abe7679b tempest-VolumesServicesTestJSON-128869496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:48:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-be320ba7-2937-4b30-8dd7-6b60abe7679b tempest-VolumesServicesTestJSON-128869496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:48:01 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-be320ba7-2937-4b30-8dd7-6b60abe7679b tempest-VolumesServicesTestJSON-128869496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:48:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1550203637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b861fd2f-4266-4de6-a154-fbca2c65c899,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3deef1af2d4246d9a4c92cbf6ee4f666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:48:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:48:02Z,use_quota=True,user_id='cdfb7e82517d47f39601968d57ba4f27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:48:01 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-be320ba7-2937-4b30-8dd7-6b60abe7679b tempest-VolumesServicesTestJSON-128869496 None] Creating volume b861fd2f-4266-4de6-a154-fbca2c65c899 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:48:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-be320ba7-2937-4b30-8dd7-6b60abe7679b tempest-VolumesServicesTestJSON-128869496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:48:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-be320ba7-2937-4b30-8dd7-6b60abe7679b tempest-VolumesServicesTestJSON-128869496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:48:01 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-be320ba7-2937-4b30-8dd7-6b60abe7679b tempest-VolumesServicesTestJSON-128869496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:48:01 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-be320ba7-2937-4b30-8dd7-6b60abe7679b tempest-VolumesServicesTestJSON-128869496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:48:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-be320ba7-2937-4b30-8dd7-6b60abe7679b tempest-VolumesServicesTestJSON-128869496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:48:01 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-be320ba7-2937-4b30-8dd7-6b60abe7679b tempest-VolumesServicesTestJSON-128869496 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:48:01 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-be320ba7-2937-4b30-8dd7-6b60abe7679b tempest-VolumesServicesTestJSON-128869496 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:48:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-be320ba7-2937-4b30-8dd7-6b60abe7679b tempest-VolumesServicesTestJSON-128869496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b861fd2f-4266-4de6-a154-fbca2c65c899 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:01 devstack sudo[98357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b861fd2f-4266-4de6-a154-fbca2c65c899 1073741824 Jul 08 18:48:01 devstack sudo[98357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:02 devstack sudo[98357]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-be320ba7-2937-4b30-8dd7-6b60abe7679b tempest-VolumesServicesTestJSON-128869496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b861fd2f-4266-4de6-a154-fbca2c65c899 1073741824" returned: 0 in 0.859s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-be320ba7-2937-4b30-8dd7-6b60abe7679b tempest-VolumesServicesTestJSON-128869496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b861fd2f-4266-4de6-a154-fbca2c65c899 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:02 devstack sudo[98732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b861fd2f-4266-4de6-a154-fbca2c65c899 Jul 08 18:48:02 devstack sudo[98732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:03 devstack sudo[98732]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-be320ba7-2937-4b30-8dd7-6b60abe7679b tempest-VolumesServicesTestJSON-128869496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b861fd2f-4266-4de6-a154-fbca2c65c899" returned: 0 in 0.693s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:03 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-be320ba7-2937-4b30-8dd7-6b60abe7679b tempest-VolumesServicesTestJSON-128869496 None] <== create_volume: return (1599ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:48:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-be320ba7-2937-4b30-8dd7-6b60abe7679b tempest-VolumesServicesTestJSON-128869496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.602s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:48:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-be320ba7-2937-4b30-8dd7-6b60abe7679b tempest-VolumesServicesTestJSON-128869496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dcc0d48-2bcd-405c-8ab8-c7602779bc7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b861fd2f-4266-4de6-a154-fbca2c65c899', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-be320ba7-2937-4b30-8dd7-6b60abe7679b tempest-VolumesServicesTestJSON-128869496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edc12326-622f-4a89-9248-bfd4d71e8318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:03 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-be320ba7-2937-4b30-8dd7-6b60abe7679b tempest-VolumesServicesTestJSON-128869496 None] Volume volume-b861fd2f-4266-4de6-a154-fbca2c65c899 (b861fd2f-4266-4de6-a154-fbca2c65c899): created successfully Jul 08 18:48:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-be320ba7-2937-4b30-8dd7-6b60abe7679b tempest-VolumesServicesTestJSON-128869496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edc12326-622f-4a89-9248-bfd4d71e8318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-be320ba7-2937-4b30-8dd7-6b60abe7679b tempest-VolumesServicesTestJSON-128869496 None] Flow 'volume_create_manager' (7d598b76-125b-47e3-90b8-2ae9acc5c2ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:48:03 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-be320ba7-2937-4b30-8dd7-6b60abe7679b tempest-VolumesServicesTestJSON-128869496 None] Created volume successfully. Jul 08 18:48:03 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-09a83883-8852-4a65-821f-05ce297dfefb tempest-VolumesServicesTestJSON-128869496 None] Acquiring lock "cinder-b861fd2f-4266-4de6-a154-fbca2c65c899-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:48:03 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-09a83883-8852-4a65-821f-05ce297dfefb tempest-VolumesServicesTestJSON-128869496 None] Lock "cinder-b861fd2f-4266-4de6-a154-fbca2c65c899-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:48:03 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-09a83883-8852-4a65-821f-05ce297dfefb tempest-VolumesServicesTestJSON-128869496 None] Acquiring lock "cinder-quobyte-b861fd2f-4266-4de6-a154-fbca2c65c899" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:48:03 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-09a83883-8852-4a65-821f-05ce297dfefb tempest-VolumesServicesTestJSON-128869496 None] Lock "cinder-quobyte-b861fd2f-4266-4de6-a154-fbca2c65c899" acquired by "delete_volume" :: waited 0.032s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:48:04 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[1990e11a-a8a3-43a4-84f6-620b0eb213fa]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:48:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-09a83883-8852-4a65-821f-05ce297dfefb tempest-VolumesServicesTestJSON-128869496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b861fd2f-4266-4de6-a154-fbca2c65c899 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:04 devstack sudo[98737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b861fd2f-4266-4de6-a154-fbca2c65c899 Jul 08 18:48:04 devstack sudo[98737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:04 devstack sudo[98737]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-09a83883-8852-4a65-821f-05ce297dfefb tempest-VolumesServicesTestJSON-128869496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b861fd2f-4266-4de6-a154-fbca2c65c899" returned: 0 in 0.840s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-09a83883-8852-4a65-821f-05ce297dfefb tempest-VolumesServicesTestJSON-128869496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b861fd2f-4266-4de6-a154-fbca2c65c899 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:04 devstack sudo[98742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b861fd2f-4266-4de6-a154-fbca2c65c899 Jul 08 18:48:04 devstack sudo[98742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:05 devstack sudo[98742]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-09a83883-8852-4a65-821f-05ce297dfefb tempest-VolumesServicesTestJSON-128869496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b861fd2f-4266-4de6-a154-fbca2c65c899" returned: 0 in 0.744s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:05 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-09a83883-8852-4a65-821f-05ce297dfefb tempest-VolumesServicesTestJSON-128869496 None] Lock "cinder-quobyte-b861fd2f-4266-4de6-a154-fbca2c65c899" released by "delete_volume" :: held 1.666s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:48:05 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-09a83883-8852-4a65-821f-05ce297dfefb tempest-VolumesServicesTestJSON-128869496 None] Created reservations ['4ec98d83-c364-4dc8-8f6b-e19a6afec1ef', '6bf370c1-07cd-4a4c-bf42-668c8f856925', 'e1f4ae50-3d4f-4b08-9958-56a7c53be8ef', 'b4eaa7f8-8f41-4dd3-9869-a13ad25e07f6'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:48:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-09a83883-8852-4a65-821f-05ce297dfefb tempest-VolumesServicesTestJSON-128869496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:48:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-09a83883-8852-4a65-821f-05ce297dfefb tempest-VolumesServicesTestJSON-128869496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:48:05 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-09a83883-8852-4a65-821f-05ce297dfefb tempest-VolumesServicesTestJSON-128869496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:48:05 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-09a83883-8852-4a65-821f-05ce297dfefb tempest-VolumesServicesTestJSON-128869496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:48:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-09a83883-8852-4a65-821f-05ce297dfefb tempest-VolumesServicesTestJSON-128869496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:48:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-09a83883-8852-4a65-821f-05ce297dfefb tempest-VolumesServicesTestJSON-128869496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:05 devstack sudo[98745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:48:05 devstack sudo[98745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:06 devstack sudo[98745]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-09a83883-8852-4a65-821f-05ce297dfefb tempest-VolumesServicesTestJSON-128869496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.906s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:06 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-09a83883-8852-4a65-821f-05ce297dfefb tempest-VolumesServicesTestJSON-128869496 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:48:06 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-09a83883-8852-4a65-821f-05ce297dfefb tempest-VolumesServicesTestJSON-128869496 None] Deleted volume successfully. Jul 08 18:48:06 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-09a83883-8852-4a65-821f-05ce297dfefb tempest-VolumesServicesTestJSON-128869496 None] Lock "cinder-b861fd2f-4266-4de6-a154-fbca2c65c899-delete_volume" released by "delete_volume" :: held 2.866s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:48:15 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:INSERT=8,cinder:UPDATE=26,cinder:SELECT=21,cinder:DELETE=2 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:48:16 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:SELECT=17,cinder:UPDATE=26,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:48:24 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea7f235a-6a11-429d-98ba-0be7f2c520db tempest-SnapshotMetadataTestJSON-1633208474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:48:24 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ea7f235a-6a11-429d-98ba-0be7f2c520db tempest-SnapshotMetadataTestJSON-1633208474 None] Flow 'volume_create_manager' (5c518602-97fb-439f-9cb0-79c4c7f6dba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:48:24 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ea7f235a-6a11-429d-98ba-0be7f2c520db tempest-SnapshotMetadataTestJSON-1633208474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09cb4c98-9eca-4763-b9bd-6a45dbba1764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:24 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ea7f235a-6a11-429d-98ba-0be7f2c520db tempest-SnapshotMetadataTestJSON-1633208474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09cb4c98-9eca-4763-b9bd-6a45dbba1764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:48:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-787620423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36897856-61f3-413f-ba25-7c19b98de70c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f295be266bc6479eabe7b41e343b2947',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:48:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:48:25Z,use_quota=True,user_id='e87f9bd1d7b443d59e3d4415025f6320',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:24 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ea7f235a-6a11-429d-98ba-0be7f2c520db tempest-SnapshotMetadataTestJSON-1633208474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c5a138e-1603-43f4-8e70-8b69e0e16752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:24 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ea7f235a-6a11-429d-98ba-0be7f2c520db tempest-SnapshotMetadataTestJSON-1633208474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c5a138e-1603-43f4-8e70-8b69e0e16752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:24 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ea7f235a-6a11-429d-98ba-0be7f2c520db tempest-SnapshotMetadataTestJSON-1633208474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d1f05d0-c067-4f82-b141-60f93ef17f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:24 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ea7f235a-6a11-429d-98ba-0be7f2c520db tempest-SnapshotMetadataTestJSON-1633208474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d1f05d0-c067-4f82-b141-60f93ef17f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36897856-61f3-413f-ba25-7c19b98de70c', 'volume_name': 'volume-36897856-61f3-413f-ba25-7c19b98de70c', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:24 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ea7f235a-6a11-429d-98ba-0be7f2c520db tempest-SnapshotMetadataTestJSON-1633208474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f1cba17-cda3-48c1-a1a2-28b727706b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:24 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ea7f235a-6a11-429d-98ba-0be7f2c520db tempest-SnapshotMetadataTestJSON-1633208474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f1cba17-cda3-48c1-a1a2-28b727706b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:24 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ea7f235a-6a11-429d-98ba-0be7f2c520db tempest-SnapshotMetadataTestJSON-1633208474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da484952-ccef-4a3e-b4fa-6eea585ac785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:24 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-ea7f235a-6a11-429d-98ba-0be7f2c520db tempest-SnapshotMetadataTestJSON-1633208474 None] Volume 36897856-61f3-413f-ba25-7c19b98de70c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36897856-61f3-413f-ba25-7c19b98de70c', 'volume_size': 1} Jul 08 18:48:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-ea7f235a-6a11-429d-98ba-0be7f2c520db tempest-SnapshotMetadataTestJSON-1633208474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:48:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-ea7f235a-6a11-429d-98ba-0be7f2c520db tempest-SnapshotMetadataTestJSON-1633208474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:48:24 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-ea7f235a-6a11-429d-98ba-0be7f2c520db tempest-SnapshotMetadataTestJSON-1633208474 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:48:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-787620423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36897856-61f3-413f-ba25-7c19b98de70c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f295be266bc6479eabe7b41e343b2947',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:48:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:48:25Z,use_quota=True,user_id='e87f9bd1d7b443d59e3d4415025f6320',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:48:24 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-ea7f235a-6a11-429d-98ba-0be7f2c520db tempest-SnapshotMetadataTestJSON-1633208474 None] Creating volume 36897856-61f3-413f-ba25-7c19b98de70c {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:48:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-ea7f235a-6a11-429d-98ba-0be7f2c520db tempest-SnapshotMetadataTestJSON-1633208474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:48:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-ea7f235a-6a11-429d-98ba-0be7f2c520db tempest-SnapshotMetadataTestJSON-1633208474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:48:24 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-ea7f235a-6a11-429d-98ba-0be7f2c520db tempest-SnapshotMetadataTestJSON-1633208474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:48:24 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-ea7f235a-6a11-429d-98ba-0be7f2c520db tempest-SnapshotMetadataTestJSON-1633208474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:48:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-ea7f235a-6a11-429d-98ba-0be7f2c520db tempest-SnapshotMetadataTestJSON-1633208474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:48:24 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-ea7f235a-6a11-429d-98ba-0be7f2c520db tempest-SnapshotMetadataTestJSON-1633208474 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:48:24 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-ea7f235a-6a11-429d-98ba-0be7f2c520db tempest-SnapshotMetadataTestJSON-1633208474 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:48:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ea7f235a-6a11-429d-98ba-0be7f2c520db tempest-SnapshotMetadataTestJSON-1633208474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-36897856-61f3-413f-ba25-7c19b98de70c 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:25 devstack sudo[98848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-36897856-61f3-413f-ba25-7c19b98de70c 1073741824 Jul 08 18:48:25 devstack sudo[98848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:25 devstack sudo[98848]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ea7f235a-6a11-429d-98ba-0be7f2c520db tempest-SnapshotMetadataTestJSON-1633208474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-36897856-61f3-413f-ba25-7c19b98de70c 1073741824" returned: 0 in 0.881s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ea7f235a-6a11-429d-98ba-0be7f2c520db tempest-SnapshotMetadataTestJSON-1633208474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-36897856-61f3-413f-ba25-7c19b98de70c {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:25 devstack sudo[98854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-36897856-61f3-413f-ba25-7c19b98de70c Jul 08 18:48:25 devstack sudo[98854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:26 devstack sudo[98854]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ea7f235a-6a11-429d-98ba-0be7f2c520db tempest-SnapshotMetadataTestJSON-1633208474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-36897856-61f3-413f-ba25-7c19b98de70c" returned: 0 in 0.683s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:26 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-ea7f235a-6a11-429d-98ba-0be7f2c520db tempest-SnapshotMetadataTestJSON-1633208474 None] <== create_volume: return (1608ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:48:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-ea7f235a-6a11-429d-98ba-0be7f2c520db tempest-SnapshotMetadataTestJSON-1633208474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.611s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:48:26 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ea7f235a-6a11-429d-98ba-0be7f2c520db tempest-SnapshotMetadataTestJSON-1633208474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da484952-ccef-4a3e-b4fa-6eea585ac785) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36897856-61f3-413f-ba25-7c19b98de70c', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:26 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ea7f235a-6a11-429d-98ba-0be7f2c520db tempest-SnapshotMetadataTestJSON-1633208474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fd294c7-bc1d-4a7d-a29a-66364fba6448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:26 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-ea7f235a-6a11-429d-98ba-0be7f2c520db tempest-SnapshotMetadataTestJSON-1633208474 None] Volume volume-36897856-61f3-413f-ba25-7c19b98de70c (36897856-61f3-413f-ba25-7c19b98de70c): created successfully Jul 08 18:48:26 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ea7f235a-6a11-429d-98ba-0be7f2c520db tempest-SnapshotMetadataTestJSON-1633208474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fd294c7-bc1d-4a7d-a29a-66364fba6448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:26 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ea7f235a-6a11-429d-98ba-0be7f2c520db tempest-SnapshotMetadataTestJSON-1633208474 None] Flow 'volume_create_manager' (5c518602-97fb-439f-9cb0-79c4c7f6dba2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:48:26 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-ea7f235a-6a11-429d-98ba-0be7f2c520db tempest-SnapshotMetadataTestJSON-1633208474 None] Created volume successfully. Jul 08 18:48:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-933b0c42-14cb-46e3-8f4a-06565d7643d8 tempest-SnapshotMetadataTestJSON-1633208474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:48:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-933b0c42-14cb-46e3-8f4a-06565d7643d8 tempest-SnapshotMetadataTestJSON-1633208474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:48:27 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-933b0c42-14cb-46e3-8f4a-06565d7643d8 tempest-SnapshotMetadataTestJSON-1633208474 None] Creating offline snapshot d95afccb-3c28-487c-b521-5b0ea61e7264 of volume 36897856-61f3-413f-ba25-7c19b98de70c {{(pid=86873) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:48:27 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f04655d-c02a-41f3-b08c-8951cb73bb29]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:48:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-933b0c42-14cb-46e3-8f4a-06565d7643d8 tempest-SnapshotMetadataTestJSON-1633208474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-36897856-61f3-413f-ba25-7c19b98de70c {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:27 devstack sudo[98857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-36897856-61f3-413f-ba25-7c19b98de70c Jul 08 18:48:27 devstack sudo[98857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:28 devstack sudo[98857]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-933b0c42-14cb-46e3-8f4a-06565d7643d8 tempest-SnapshotMetadataTestJSON-1633208474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-36897856-61f3-413f-ba25-7c19b98de70c" returned: 0 in 0.826s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-933b0c42-14cb-46e3-8f4a-06565d7643d8 tempest-SnapshotMetadataTestJSON-1633208474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-36897856-61f3-413f-ba25-7c19b98de70c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-36897856-61f3-413f-ba25-7c19b98de70c.d95afccb-3c28-487c-b521-5b0ea61e7264 1G {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:28 devstack sudo[98862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-36897856-61f3-413f-ba25-7c19b98de70c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-36897856-61f3-413f-ba25-7c19b98de70c.d95afccb-3c28-487c-b521-5b0ea61e7264 1G Jul 08 18:48:28 devstack sudo[98862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:28 devstack sudo[98862]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-933b0c42-14cb-46e3-8f4a-06565d7643d8 tempest-SnapshotMetadataTestJSON-1633208474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-36897856-61f3-413f-ba25-7c19b98de70c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-36897856-61f3-413f-ba25-7c19b98de70c.d95afccb-3c28-487c-b521-5b0ea61e7264 1G" returned: 0 in 0.827s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-933b0c42-14cb-46e3-8f4a-06565d7643d8 tempest-SnapshotMetadataTestJSON-1633208474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36897856-61f3-413f-ba25-7c19b98de70c -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-36897856-61f3-413f-ba25-7c19b98de70c.d95afccb-3c28-487c-b521-5b0ea61e7264 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:28 devstack sudo[98868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36897856-61f3-413f-ba25-7c19b98de70c -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-36897856-61f3-413f-ba25-7c19b98de70c.d95afccb-3c28-487c-b521-5b0ea61e7264 Jul 08 18:48:28 devstack sudo[98868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:29 devstack sudo[98868]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-933b0c42-14cb-46e3-8f4a-06565d7643d8 tempest-SnapshotMetadataTestJSON-1633208474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36897856-61f3-413f-ba25-7c19b98de70c -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-36897856-61f3-413f-ba25-7c19b98de70c.d95afccb-3c28-487c-b521-5b0ea61e7264" returned: 0 in 0.707s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:29 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-933b0c42-14cb-46e3-8f4a-06565d7643d8 tempest-SnapshotMetadataTestJSON-1633208474 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-36897856-61f3-413f-ba25-7c19b98de70c.d95afccb-3c28-487c-b521-5b0ea61e7264 is being set with open permissions: ugo+rw Jul 08 18:48:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-933b0c42-14cb-46e3-8f4a-06565d7643d8 tempest-SnapshotMetadataTestJSON-1633208474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-36897856-61f3-413f-ba25-7c19b98de70c.d95afccb-3c28-487c-b521-5b0ea61e7264 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:29 devstack sudo[98873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-36897856-61f3-413f-ba25-7c19b98de70c.d95afccb-3c28-487c-b521-5b0ea61e7264 Jul 08 18:48:29 devstack sudo[98873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:30 devstack sudo[98873]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-933b0c42-14cb-46e3-8f4a-06565d7643d8 tempest-SnapshotMetadataTestJSON-1633208474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-36897856-61f3-413f-ba25-7c19b98de70c.d95afccb-3c28-487c-b521-5b0ea61e7264" returned: 0 in 0.634s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-933b0c42-14cb-46e3-8f4a-06565d7643d8 tempest-SnapshotMetadataTestJSON-1633208474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-36897856-61f3-413f-ba25-7c19b98de70c.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:30 devstack sudo[98876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-36897856-61f3-413f-ba25-7c19b98de70c.info Jul 08 18:48:30 devstack sudo[98876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:30 devstack sudo[98876]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-933b0c42-14cb-46e3-8f4a-06565d7643d8 tempest-SnapshotMetadataTestJSON-1633208474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-36897856-61f3-413f-ba25-7c19b98de70c.info" returned: 0 in 0.653s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:30 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-933b0c42-14cb-46e3-8f4a-06565d7643d8 tempest-SnapshotMetadataTestJSON-1633208474 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-36897856-61f3-413f-ba25-7c19b98de70c.info is being set with open permissions: ugo+rw Jul 08 18:48:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-933b0c42-14cb-46e3-8f4a-06565d7643d8 tempest-SnapshotMetadataTestJSON-1633208474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-36897856-61f3-413f-ba25-7c19b98de70c.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:30 devstack sudo[98879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-36897856-61f3-413f-ba25-7c19b98de70c.info Jul 08 18:48:30 devstack sudo[98879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:31 devstack sudo[98879]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-933b0c42-14cb-46e3-8f4a-06565d7643d8 tempest-SnapshotMetadataTestJSON-1633208474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-36897856-61f3-413f-ba25-7c19b98de70c.info" returned: 0 in 0.657s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-933b0c42-14cb-46e3-8f4a-06565d7643d8 tempest-SnapshotMetadataTestJSON-1633208474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.403s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:48:31 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-933b0c42-14cb-46e3-8f4a-06565d7643d8 tempest-SnapshotMetadataTestJSON-1633208474 None] Create snapshot completed successfully Jul 08 18:48:33 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9899d6b8-6ab0-473d-9373-9525f378e7c9 tempest-SnapshotMetadataTestJSON-1633208474 None] Acquiring lock "cinder-d95afccb-3c28-487c-b521-5b0ea61e7264-delete_snapshot" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:48:33 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9899d6b8-6ab0-473d-9373-9525f378e7c9 tempest-SnapshotMetadataTestJSON-1633208474 None] Lock "cinder-d95afccb-3c28-487c-b521-5b0ea61e7264-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:48:33 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9899d6b8-6ab0-473d-9373-9525f378e7c9 tempest-SnapshotMetadataTestJSON-1633208474 None] Acquiring lock "cinder-quobyte-36897856-61f3-413f-ba25-7c19b98de70c" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:48:33 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9899d6b8-6ab0-473d-9373-9525f378e7c9 tempest-SnapshotMetadataTestJSON-1633208474 None] Lock "cinder-quobyte-36897856-61f3-413f-ba25-7c19b98de70c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:48:33 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9899d6b8-6ab0-473d-9373-9525f378e7c9 tempest-SnapshotMetadataTestJSON-1633208474 None] Acquiring lock "cinder-quobyte-d95afccb-3c28-487c-b521-5b0ea61e7264" by "_delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:48:33 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9899d6b8-6ab0-473d-9373-9525f378e7c9 tempest-SnapshotMetadataTestJSON-1633208474 None] Lock "cinder-quobyte-d95afccb-3c28-487c-b521-5b0ea61e7264" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:48:33 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-9899d6b8-6ab0-473d-9373-9525f378e7c9 tempest-SnapshotMetadataTestJSON-1633208474 None] Deleting offline snapshot d95afccb-3c28-487c-b521-5b0ea61e7264 of volume 36897856-61f3-413f-ba25-7c19b98de70c {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:48:33 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-9899d6b8-6ab0-473d-9373-9525f378e7c9 tempest-SnapshotMetadataTestJSON-1633208474 None] snapshot_file for this snap is: volume-36897856-61f3-413f-ba25-7c19b98de70c.d95afccb-3c28-487c-b521-5b0ea61e7264 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:48:33 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9f960b-4762-4a6d-9e95-2f0a38d4c82f]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:48:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9899d6b8-6ab0-473d-9373-9525f378e7c9 tempest-SnapshotMetadataTestJSON-1633208474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-36897856-61f3-413f-ba25-7c19b98de70c.d95afccb-3c28-487c-b521-5b0ea61e7264 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:33 devstack sudo[98890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-36897856-61f3-413f-ba25-7c19b98de70c.d95afccb-3c28-487c-b521-5b0ea61e7264 Jul 08 18:48:33 devstack sudo[98890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:33 devstack sudo[98890]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9899d6b8-6ab0-473d-9373-9525f378e7c9 tempest-SnapshotMetadataTestJSON-1633208474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-36897856-61f3-413f-ba25-7c19b98de70c.d95afccb-3c28-487c-b521-5b0ea61e7264" returned: 0 in 0.810s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:33 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-9899d6b8-6ab0-473d-9373-9525f378e7c9 tempest-SnapshotMetadataTestJSON-1633208474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36897856-61f3-413f-ba25-7c19b98de70c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:48:33 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d33635-2067-4773-9b6c-84543e3eb37a]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:48:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9899d6b8-6ab0-473d-9373-9525f378e7c9 tempest-SnapshotMetadataTestJSON-1633208474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-36897856-61f3-413f-ba25-7c19b98de70c {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:34 devstack sudo[98895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-36897856-61f3-413f-ba25-7c19b98de70c Jul 08 18:48:34 devstack sudo[98895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:34 devstack sudo[98895]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9899d6b8-6ab0-473d-9373-9525f378e7c9 tempest-SnapshotMetadataTestJSON-1633208474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-36897856-61f3-413f-ba25-7c19b98de70c" returned: 0 in 0.801s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9899d6b8-6ab0-473d-9373-9525f378e7c9 tempest-SnapshotMetadataTestJSON-1633208474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-36897856-61f3-413f-ba25-7c19b98de70c.d95afccb-3c28-487c-b521-5b0ea61e7264 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:34 devstack sudo[98900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-36897856-61f3-413f-ba25-7c19b98de70c.d95afccb-3c28-487c-b521-5b0ea61e7264 Jul 08 18:48:34 devstack sudo[98900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-f2570c19-4b85-4e4b-a91e-5ae2a8d8d59b req-09822284-6a64-430a-82cd-f5561df0d82a tempest-TestInstancesWithCinderVolumes-1161949889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:48:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-f2570c19-4b85-4e4b-a91e-5ae2a8d8d59b req-09822284-6a64-430a-82cd-f5561df0d82a tempest-TestInstancesWithCinderVolumes-1161949889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:48:35 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[052099e1-51cb-4c9f-b575-123ebc3d953d]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:48:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-f2570c19-4b85-4e4b-a91e-5ae2a8d8d59b req-09822284-6a64-430a-82cd-f5561df0d82a tempest-TestInstancesWithCinderVolumes-1161949889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d69060b7-e4e2-43eb-a837-f3111628cc86 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:35 devstack sudo[98910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d69060b7-e4e2-43eb-a837-f3111628cc86 Jul 08 18:48:35 devstack sudo[98910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:35 devstack sudo[98900]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9899d6b8-6ab0-473d-9373-9525f378e7c9 tempest-SnapshotMetadataTestJSON-1633208474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-36897856-61f3-413f-ba25-7c19b98de70c.d95afccb-3c28-487c-b521-5b0ea61e7264" returned: 0 in 0.773s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9899d6b8-6ab0-473d-9373-9525f378e7c9 tempest-SnapshotMetadataTestJSON-1633208474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-36897856-61f3-413f-ba25-7c19b98de70c.d95afccb-3c28-487c-b521-5b0ea61e7264 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:35 devstack sudo[98915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-36897856-61f3-413f-ba25-7c19b98de70c.d95afccb-3c28-487c-b521-5b0ea61e7264 Jul 08 18:48:35 devstack sudo[98915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:36 devstack sudo[98910]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-f2570c19-4b85-4e4b-a91e-5ae2a8d8d59b req-09822284-6a64-430a-82cd-f5561df0d82a tempest-TestInstancesWithCinderVolumes-1161949889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d69060b7-e4e2-43eb-a837-f3111628cc86" returned: 0 in 0.836s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-f2570c19-4b85-4e4b-a91e-5ae2a8d8d59b req-09822284-6a64-430a-82cd-f5561df0d82a tempest-TestInstancesWithCinderVolumes-1161949889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.863s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:48:36 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-f2570c19-4b85-4e4b-a91e-5ae2a8d8d59b req-09822284-6a64-430a-82cd-f5561df0d82a tempest-TestInstancesWithCinderVolumes-1161949889 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2', 'name': 'volume-d69060b7-e4e2-43eb-a837-f3111628cc86', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2bd2e20e-1f4d-4afe-b3e3-c1d0a40a6f83', 'enforce_multipath': True} {{(pid=86873) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 18:48:36 devstack cinder-volume[86873]: INFO cinder.volume.manager [req-f2570c19-4b85-4e4b-a91e-5ae2a8d8d59b req-09822284-6a64-430a-82cd-f5561df0d82a tempest-TestInstancesWithCinderVolumes-1161949889 None] attachment_update completed successfully. Jul 08 18:48:36 devstack sudo[98915]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9899d6b8-6ab0-473d-9373-9525f378e7c9 tempest-SnapshotMetadataTestJSON-1633208474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-36897856-61f3-413f-ba25-7c19b98de70c.d95afccb-3c28-487c-b521-5b0ea61e7264" returned: 0 in 0.685s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:36 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9899d6b8-6ab0-473d-9373-9525f378e7c9 tempest-SnapshotMetadataTestJSON-1633208474 None] Lock "cinder-quobyte-d95afccb-3c28-487c-b521-5b0ea61e7264" released by "_delete_snapshot" :: held 3.187s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:48:36 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9899d6b8-6ab0-473d-9373-9525f378e7c9 tempest-SnapshotMetadataTestJSON-1633208474 None] Lock "cinder-quobyte-36897856-61f3-413f-ba25-7c19b98de70c" released by "delete_snapshot" :: held 3.218s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:48:36 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-9899d6b8-6ab0-473d-9373-9525f378e7c9 tempest-SnapshotMetadataTestJSON-1633208474 None] Created reservations ['a9a606f2-5b87-4b89-a29b-0a4ccebeae04', '83d25731-5754-4324-9887-fb76d1a8f13f', 'e9866a0c-935d-4003-9d24-c2e9946bcc33', '9e3dad64-44e7-4e6b-96f2-bfd08064a7f8'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:48:36 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-9899d6b8-6ab0-473d-9373-9525f378e7c9 tempest-SnapshotMetadataTestJSON-1633208474 None] Delete snapshot completed successfully. Jul 08 18:48:36 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9899d6b8-6ab0-473d-9373-9525f378e7c9 tempest-SnapshotMetadataTestJSON-1633208474 None] Lock "cinder-d95afccb-3c28-487c-b521-5b0ea61e7264-delete_snapshot" released by "delete_snapshot" :: held 3.364s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:48:37 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ce735a8a-f556-4afd-8c7c-083a942ac6f0 tempest-SnapshotMetadataTestJSON-1633208474 None] Acquiring lock "cinder-36897856-61f3-413f-ba25-7c19b98de70c-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:48:37 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ce735a8a-f556-4afd-8c7c-083a942ac6f0 tempest-SnapshotMetadataTestJSON-1633208474 None] Lock "cinder-36897856-61f3-413f-ba25-7c19b98de70c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:48:37 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ce735a8a-f556-4afd-8c7c-083a942ac6f0 tempest-SnapshotMetadataTestJSON-1633208474 None] Acquiring lock "cinder-quobyte-36897856-61f3-413f-ba25-7c19b98de70c" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:48:37 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ce735a8a-f556-4afd-8c7c-083a942ac6f0 tempest-SnapshotMetadataTestJSON-1633208474 None] Lock "cinder-quobyte-36897856-61f3-413f-ba25-7c19b98de70c" acquired by "delete_volume" :: waited 0.014s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:48:37 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf99a324-24b0-4ad9-b3cb-11d9a563466d]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:48:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ce735a8a-f556-4afd-8c7c-083a942ac6f0 tempest-SnapshotMetadataTestJSON-1633208474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-36897856-61f3-413f-ba25-7c19b98de70c {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:37 devstack sudo[98923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-36897856-61f3-413f-ba25-7c19b98de70c Jul 08 18:48:37 devstack sudo[98923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:38 devstack sudo[98923]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:38 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ce735a8a-f556-4afd-8c7c-083a942ac6f0 tempest-SnapshotMetadataTestJSON-1633208474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-36897856-61f3-413f-ba25-7c19b98de70c" returned: 0 in 0.802s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:38 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ce735a8a-f556-4afd-8c7c-083a942ac6f0 tempest-SnapshotMetadataTestJSON-1633208474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-36897856-61f3-413f-ba25-7c19b98de70c {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:38 devstack sudo[98928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-36897856-61f3-413f-ba25-7c19b98de70c Jul 08 18:48:38 devstack sudo[98928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:38 devstack sudo[98928]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:38 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ce735a8a-f556-4afd-8c7c-083a942ac6f0 tempest-SnapshotMetadataTestJSON-1633208474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-36897856-61f3-413f-ba25-7c19b98de70c" returned: 0 in 0.688s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:38 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ce735a8a-f556-4afd-8c7c-083a942ac6f0 tempest-SnapshotMetadataTestJSON-1633208474 None] Lock "cinder-quobyte-36897856-61f3-413f-ba25-7c19b98de70c" released by "delete_volume" :: held 1.551s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:48:38 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-ce735a8a-f556-4afd-8c7c-083a942ac6f0 tempest-SnapshotMetadataTestJSON-1633208474 None] Created reservations ['1da0a9ff-5266-45dc-87fa-79d9cd11a543', 'c696176e-5e5a-4ed5-a826-630bdc1f0cfb', '18a5b599-0b4a-4db7-87c7-d6cd45c4d7b8', '1a3207a4-14c7-4aac-bdbe-cb5a460d4df0'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:48:39 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-ce735a8a-f556-4afd-8c7c-083a942ac6f0 tempest-SnapshotMetadataTestJSON-1633208474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:48:39 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-ce735a8a-f556-4afd-8c7c-083a942ac6f0 tempest-SnapshotMetadataTestJSON-1633208474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:48:39 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-ce735a8a-f556-4afd-8c7c-083a942ac6f0 tempest-SnapshotMetadataTestJSON-1633208474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:48:39 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-ce735a8a-f556-4afd-8c7c-083a942ac6f0 tempest-SnapshotMetadataTestJSON-1633208474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:48:39 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-ce735a8a-f556-4afd-8c7c-083a942ac6f0 tempest-SnapshotMetadataTestJSON-1633208474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:48:39 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ce735a8a-f556-4afd-8c7c-083a942ac6f0 tempest-SnapshotMetadataTestJSON-1633208474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:39 devstack sudo[98931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:48:39 devstack sudo[98931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:39 devstack sudo[98931]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:39 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ce735a8a-f556-4afd-8c7c-083a942ac6f0 tempest-SnapshotMetadataTestJSON-1633208474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.722s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:39 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-ce735a8a-f556-4afd-8c7c-083a942ac6f0 tempest-SnapshotMetadataTestJSON-1633208474 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:48:39 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-ce735a8a-f556-4afd-8c7c-083a942ac6f0 tempest-SnapshotMetadataTestJSON-1633208474 None] Deleted volume successfully. Jul 08 18:48:39 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ce735a8a-f556-4afd-8c7c-083a942ac6f0 tempest-SnapshotMetadataTestJSON-1633208474 None] Lock "cinder-36897856-61f3-413f-ba25-7c19b98de70c-delete_volume" released by "delete_volume" :: held 2.526s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:48:42 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bc9d4d4-046a-4783-91f3-638fe4c5bb57 tempest-VolumesDeleteCascade-559030606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:48:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5bc9d4d4-046a-4783-91f3-638fe4c5bb57 tempest-VolumesDeleteCascade-559030606 None] Flow 'volume_create_manager' (308acea2-06ea-4b34-9f82-221da25add6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:48:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5bc9d4d4-046a-4783-91f3-638fe4c5bb57 tempest-VolumesDeleteCascade-559030606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b94a089-9751-4877-912a-1641d8892e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5bc9d4d4-046a-4783-91f3-638fe4c5bb57 tempest-VolumesDeleteCascade-559030606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b94a089-9751-4877-912a-1641d8892e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:48:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-666663202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19085411-7634-42a4-a4a0-be31922d6feb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c4976a626d5458f9cb129e6536c6dd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:48:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:48:42Z,use_quota=True,user_id='e664c6c374094c50beb16234e908c339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5bc9d4d4-046a-4783-91f3-638fe4c5bb57 tempest-VolumesDeleteCascade-559030606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baa156df-e7b4-4dbd-ac0c-649d944d1399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5bc9d4d4-046a-4783-91f3-638fe4c5bb57 tempest-VolumesDeleteCascade-559030606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baa156df-e7b4-4dbd-ac0c-649d944d1399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5bc9d4d4-046a-4783-91f3-638fe4c5bb57 tempest-VolumesDeleteCascade-559030606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4983b0e2-dd19-4137-b5cb-d0b47c1c16b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5bc9d4d4-046a-4783-91f3-638fe4c5bb57 tempest-VolumesDeleteCascade-559030606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4983b0e2-dd19-4137-b5cb-d0b47c1c16b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19085411-7634-42a4-a4a0-be31922d6feb', 'volume_name': 'volume-19085411-7634-42a4-a4a0-be31922d6feb', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5bc9d4d4-046a-4783-91f3-638fe4c5bb57 tempest-VolumesDeleteCascade-559030606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c26ac23b-eb79-445a-94d3-d54c6a826065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5bc9d4d4-046a-4783-91f3-638fe4c5bb57 tempest-VolumesDeleteCascade-559030606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c26ac23b-eb79-445a-94d3-d54c6a826065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5bc9d4d4-046a-4783-91f3-638fe4c5bb57 tempest-VolumesDeleteCascade-559030606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcdc0697-d672-488e-b57b-963874f97cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:42 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-5bc9d4d4-046a-4783-91f3-638fe4c5bb57 tempest-VolumesDeleteCascade-559030606 None] Volume 19085411-7634-42a4-a4a0-be31922d6feb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19085411-7634-42a4-a4a0-be31922d6feb', 'volume_size': 1} Jul 08 18:48:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5bc9d4d4-046a-4783-91f3-638fe4c5bb57 tempest-VolumesDeleteCascade-559030606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:48:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5bc9d4d4-046a-4783-91f3-638fe4c5bb57 tempest-VolumesDeleteCascade-559030606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:48:42 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-5bc9d4d4-046a-4783-91f3-638fe4c5bb57 tempest-VolumesDeleteCascade-559030606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:48:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-666663202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19085411-7634-42a4-a4a0-be31922d6feb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c4976a626d5458f9cb129e6536c6dd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:48:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:48:42Z,use_quota=True,user_id='e664c6c374094c50beb16234e908c339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:48:42 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-5bc9d4d4-046a-4783-91f3-638fe4c5bb57 tempest-VolumesDeleteCascade-559030606 None] Creating volume 19085411-7634-42a4-a4a0-be31922d6feb {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:48:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5bc9d4d4-046a-4783-91f3-638fe4c5bb57 tempest-VolumesDeleteCascade-559030606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:48:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5bc9d4d4-046a-4783-91f3-638fe4c5bb57 tempest-VolumesDeleteCascade-559030606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:48:42 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-5bc9d4d4-046a-4783-91f3-638fe4c5bb57 tempest-VolumesDeleteCascade-559030606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:48:42 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-5bc9d4d4-046a-4783-91f3-638fe4c5bb57 tempest-VolumesDeleteCascade-559030606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:48:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5bc9d4d4-046a-4783-91f3-638fe4c5bb57 tempest-VolumesDeleteCascade-559030606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:48:42 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-5bc9d4d4-046a-4783-91f3-638fe4c5bb57 tempest-VolumesDeleteCascade-559030606 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:48:42 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-5bc9d4d4-046a-4783-91f3-638fe4c5bb57 tempest-VolumesDeleteCascade-559030606 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:48:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5bc9d4d4-046a-4783-91f3-638fe4c5bb57 tempest-VolumesDeleteCascade-559030606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:42 devstack sudo[98945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb 1073741824 Jul 08 18:48:42 devstack sudo[98945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:43 devstack sudo[98945]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5bc9d4d4-046a-4783-91f3-638fe4c5bb57 tempest-VolumesDeleteCascade-559030606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb 1073741824" returned: 0 in 0.871s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5bc9d4d4-046a-4783-91f3-638fe4c5bb57 tempest-VolumesDeleteCascade-559030606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:43 devstack sudo[98951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb Jul 08 18:48:43 devstack sudo[98951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-7e042548-958f-42b2-ada0-126fad0829e5 req-384e373a-d434-42fb-87fa-2fffa29eafe4 tempest-TestInstancesWithCinderVolumes-1161949889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:48:44 devstack sudo[98951]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5bc9d4d4-046a-4783-91f3-638fe4c5bb57 tempest-VolumesDeleteCascade-559030606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb" returned: 0 in 0.647s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:44 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-5bc9d4d4-046a-4783-91f3-638fe4c5bb57 tempest-VolumesDeleteCascade-559030606 None] <== create_volume: return (1556ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:48:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5bc9d4d4-046a-4783-91f3-638fe4c5bb57 tempest-VolumesDeleteCascade-559030606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.558s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:48:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-7e042548-958f-42b2-ada0-126fad0829e5 req-384e373a-d434-42fb-87fa-2fffa29eafe4 tempest-TestInstancesWithCinderVolumes-1161949889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.197s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:48:44 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5bc9d4d4-046a-4783-91f3-638fe4c5bb57 tempest-VolumesDeleteCascade-559030606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcdc0697-d672-488e-b57b-963874f97cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19085411-7634-42a4-a4a0-be31922d6feb', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:44 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5bc9d4d4-046a-4783-91f3-638fe4c5bb57 tempest-VolumesDeleteCascade-559030606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ba1945a-e4f5-4e35-86d3-c17d32b57556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:44 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d017554-47da-48cc-840b-6f2466c76610]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:48:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-7e042548-958f-42b2-ada0-126fad0829e5 req-384e373a-d434-42fb-87fa-2fffa29eafe4 tempest-TestInstancesWithCinderVolumes-1161949889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-1940386e-ca1a-45ea-a5ab-56db44ed54a5 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:44 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-5bc9d4d4-046a-4783-91f3-638fe4c5bb57 tempest-VolumesDeleteCascade-559030606 None] Volume volume-19085411-7634-42a4-a4a0-be31922d6feb (19085411-7634-42a4-a4a0-be31922d6feb): created successfully Jul 08 18:48:44 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5bc9d4d4-046a-4783-91f3-638fe4c5bb57 tempest-VolumesDeleteCascade-559030606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ba1945a-e4f5-4e35-86d3-c17d32b57556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:44 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5bc9d4d4-046a-4783-91f3-638fe4c5bb57 tempest-VolumesDeleteCascade-559030606 None] Flow 'volume_create_manager' (308acea2-06ea-4b34-9f82-221da25add6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:48:44 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-5bc9d4d4-046a-4783-91f3-638fe4c5bb57 tempest-VolumesDeleteCascade-559030606 None] Created volume successfully. Jul 08 18:48:44 devstack sudo[98962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-1940386e-ca1a-45ea-a5ab-56db44ed54a5 Jul 08 18:48:44 devstack sudo[98962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3b187fa1-d634-4b97-94c8-e8faa722e7ef tempest-VolumesDeleteCascade-559030606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:48:44 devstack sudo[98962]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-7e042548-958f-42b2-ada0-126fad0829e5 req-384e373a-d434-42fb-87fa-2fffa29eafe4 tempest-TestInstancesWithCinderVolumes-1161949889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-1940386e-ca1a-45ea-a5ab-56db44ed54a5" returned: 0 in 0.773s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-7e042548-958f-42b2-ada0-126fad0829e5 req-384e373a-d434-42fb-87fa-2fffa29eafe4 tempest-TestInstancesWithCinderVolumes-1161949889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.795s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:48:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3b187fa1-d634-4b97-94c8-e8faa722e7ef tempest-VolumesDeleteCascade-559030606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.187s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:48:44 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-3b187fa1-d634-4b97-94c8-e8faa722e7ef tempest-VolumesDeleteCascade-559030606 None] Creating offline snapshot 88f7c7d5-3df0-4bee-9a9f-88012f6f252d of volume 19085411-7634-42a4-a4a0-be31922d6feb {{(pid=86873) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:48:45 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f43fae-285a-4101-8da7-61f8249e1ab4]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:48:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3b187fa1-d634-4b97-94c8-e8faa722e7ef tempest-VolumesDeleteCascade-559030606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:45 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-7e042548-958f-42b2-ada0-126fad0829e5 req-384e373a-d434-42fb-87fa-2fffa29eafe4 tempest-TestInstancesWithCinderVolumes-1161949889 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2', 'name': 'volume-1940386e-ca1a-45ea-a5ab-56db44ed54a5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '48ee2171-85d4-4fc5-96c5-7fa6cb953b18', 'enforce_multipath': True} {{(pid=86873) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 18:48:45 devstack cinder-volume[86873]: INFO cinder.volume.manager [req-7e042548-958f-42b2-ada0-126fad0829e5 req-384e373a-d434-42fb-87fa-2fffa29eafe4 tempest-TestInstancesWithCinderVolumes-1161949889 None] attachment_update completed successfully. Jul 08 18:48:45 devstack sudo[98967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb Jul 08 18:48:45 devstack sudo[98967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:45 devstack sudo[98967]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3b187fa1-d634-4b97-94c8-e8faa722e7ef tempest-VolumesDeleteCascade-559030606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb" returned: 0 in 0.768s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3b187fa1-d634-4b97-94c8-e8faa722e7ef tempest-VolumesDeleteCascade-559030606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb.88f7c7d5-3df0-4bee-9a9f-88012f6f252d 1G {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:45 devstack sudo[98972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb.88f7c7d5-3df0-4bee-9a9f-88012f6f252d 1G Jul 08 18:48:45 devstack sudo[98972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:46 devstack sudo[98972]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3b187fa1-d634-4b97-94c8-e8faa722e7ef tempest-VolumesDeleteCascade-559030606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb.88f7c7d5-3df0-4bee-9a9f-88012f6f252d 1G" returned: 0 in 0.851s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3b187fa1-d634-4b97-94c8-e8faa722e7ef tempest-VolumesDeleteCascade-559030606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19085411-7634-42a4-a4a0-be31922d6feb -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb.88f7c7d5-3df0-4bee-9a9f-88012f6f252d {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:46 devstack sudo[98980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19085411-7634-42a4-a4a0-be31922d6feb -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb.88f7c7d5-3df0-4bee-9a9f-88012f6f252d Jul 08 18:48:46 devstack sudo[98980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:47 devstack sudo[98980]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3b187fa1-d634-4b97-94c8-e8faa722e7ef tempest-VolumesDeleteCascade-559030606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19085411-7634-42a4-a4a0-be31922d6feb -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb.88f7c7d5-3df0-4bee-9a9f-88012f6f252d" returned: 0 in 0.676s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:47 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-3b187fa1-d634-4b97-94c8-e8faa722e7ef tempest-VolumesDeleteCascade-559030606 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb.88f7c7d5-3df0-4bee-9a9f-88012f6f252d is being set with open permissions: ugo+rw Jul 08 18:48:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3b187fa1-d634-4b97-94c8-e8faa722e7ef tempest-VolumesDeleteCascade-559030606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb.88f7c7d5-3df0-4bee-9a9f-88012f6f252d {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:47 devstack sudo[98985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb.88f7c7d5-3df0-4bee-9a9f-88012f6f252d Jul 08 18:48:47 devstack sudo[98985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:47 devstack sudo[98985]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3b187fa1-d634-4b97-94c8-e8faa722e7ef tempest-VolumesDeleteCascade-559030606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb.88f7c7d5-3df0-4bee-9a9f-88012f6f252d" returned: 0 in 0.645s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3b187fa1-d634-4b97-94c8-e8faa722e7ef tempest-VolumesDeleteCascade-559030606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:48 devstack sudo[98988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb.info Jul 08 18:48:48 devstack sudo[98988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:48 devstack cinder-volume[86873]: DEBUG oslo_service.periodic_task [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86873) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:48:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:48:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:48:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:48:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:48:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:48:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:48 devstack sudo[98990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:48:48 devstack sudo[98990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:48 devstack sudo[98988]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3b187fa1-d634-4b97-94c8-e8faa722e7ef tempest-VolumesDeleteCascade-559030606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb.info" returned: 0 in 0.659s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:48 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-3b187fa1-d634-4b97-94c8-e8faa722e7ef tempest-VolumesDeleteCascade-559030606 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb.info is being set with open permissions: ugo+rw Jul 08 18:48:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3b187fa1-d634-4b97-94c8-e8faa722e7ef tempest-VolumesDeleteCascade-559030606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:48 devstack sudo[98993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb.info Jul 08 18:48:48 devstack sudo[98993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:48 devstack sudo[98990]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.678s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:48 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:48:48 devstack cinder-volume[86873]: DEBUG oslo_service.periodic_task [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running periodic task VolumeManager._thread_info {{(pid=86873) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:48:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] thread count: 29 {{(pid=86873) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:48:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] thread info: [<_MainThread(MainThread, started 138577734545536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86873) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:48:49 devstack sudo[98993]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3b187fa1-d634-4b97-94c8-e8faa722e7ef tempest-VolumesDeleteCascade-559030606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb.info" returned: 0 in 0.646s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3b187fa1-d634-4b97-94c8-e8faa722e7ef tempest-VolumesDeleteCascade-559030606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.334s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:48:49 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-3b187fa1-d634-4b97-94c8-e8faa722e7ef tempest-VolumesDeleteCascade-559030606 None] Create snapshot completed successfully Jul 08 18:48:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-15d77371-a452-44ff-bb1a-31c242b7df7c tempest-VolumesDeleteCascade-559030606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:48:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-15d77371-a452-44ff-bb1a-31c242b7df7c tempest-VolumesDeleteCascade-559030606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:48:50 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-15d77371-a452-44ff-bb1a-31c242b7df7c tempest-VolumesDeleteCascade-559030606 None] Creating offline snapshot bf394e91-a0ca-4cfb-90c8-ea6eaa1c6796 of volume 19085411-7634-42a4-a4a0-be31922d6feb {{(pid=86873) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:48:50 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a6efa8-dc8f-4a1f-86ae-ec2b8a47d87b]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:48:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-15d77371-a452-44ff-bb1a-31c242b7df7c tempest-VolumesDeleteCascade-559030606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb.88f7c7d5-3df0-4bee-9a9f-88012f6f252d {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:50 devstack sudo[99005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb.88f7c7d5-3df0-4bee-9a9f-88012f6f252d Jul 08 18:48:50 devstack sudo[99005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:51 devstack sudo[99005]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-15d77371-a452-44ff-bb1a-31c242b7df7c tempest-VolumesDeleteCascade-559030606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb.88f7c7d5-3df0-4bee-9a9f-88012f6f252d" returned: 0 in 0.826s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:51 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-15d77371-a452-44ff-bb1a-31c242b7df7c tempest-VolumesDeleteCascade-559030606 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19085411-7634-42a4-a4a0-be31922d6feb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:48:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-15d77371-a452-44ff-bb1a-31c242b7df7c tempest-VolumesDeleteCascade-559030606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb.88f7c7d5-3df0-4bee-9a9f-88012f6f252d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb.bf394e91-a0ca-4cfb-90c8-ea6eaa1c6796 1G {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:51 devstack sudo[99011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb.88f7c7d5-3df0-4bee-9a9f-88012f6f252d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb.bf394e91-a0ca-4cfb-90c8-ea6eaa1c6796 1G Jul 08 18:48:51 devstack sudo[99011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:51 devstack sudo[99011]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-15d77371-a452-44ff-bb1a-31c242b7df7c tempest-VolumesDeleteCascade-559030606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb.88f7c7d5-3df0-4bee-9a9f-88012f6f252d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb.bf394e91-a0ca-4cfb-90c8-ea6eaa1c6796 1G" returned: 0 in 0.897s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-15d77371-a452-44ff-bb1a-31c242b7df7c tempest-VolumesDeleteCascade-559030606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19085411-7634-42a4-a4a0-be31922d6feb.88f7c7d5-3df0-4bee-9a9f-88012f6f252d -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb.bf394e91-a0ca-4cfb-90c8-ea6eaa1c6796 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:51 devstack sudo[99022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19085411-7634-42a4-a4a0-be31922d6feb.88f7c7d5-3df0-4bee-9a9f-88012f6f252d -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb.bf394e91-a0ca-4cfb-90c8-ea6eaa1c6796 Jul 08 18:48:51 devstack sudo[99022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:52 devstack sudo[99022]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-15d77371-a452-44ff-bb1a-31c242b7df7c tempest-VolumesDeleteCascade-559030606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19085411-7634-42a4-a4a0-be31922d6feb.88f7c7d5-3df0-4bee-9a9f-88012f6f252d -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb.bf394e91-a0ca-4cfb-90c8-ea6eaa1c6796" returned: 0 in 0.709s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:52 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-15d77371-a452-44ff-bb1a-31c242b7df7c tempest-VolumesDeleteCascade-559030606 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb.bf394e91-a0ca-4cfb-90c8-ea6eaa1c6796 is being set with open permissions: ugo+rw Jul 08 18:48:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-15d77371-a452-44ff-bb1a-31c242b7df7c tempest-VolumesDeleteCascade-559030606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb.bf394e91-a0ca-4cfb-90c8-ea6eaa1c6796 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:52 devstack sudo[99042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb.bf394e91-a0ca-4cfb-90c8-ea6eaa1c6796 Jul 08 18:48:52 devstack sudo[99042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:53 devstack sudo[99042]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:53 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-15d77371-a452-44ff-bb1a-31c242b7df7c tempest-VolumesDeleteCascade-559030606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb.bf394e91-a0ca-4cfb-90c8-ea6eaa1c6796" returned: 0 in 0.699s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:53 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-15d77371-a452-44ff-bb1a-31c242b7df7c tempest-VolumesDeleteCascade-559030606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.229s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:48:53 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-15d77371-a452-44ff-bb1a-31c242b7df7c tempest-VolumesDeleteCascade-559030606 None] Create snapshot completed successfully Jul 08 18:48:54 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] Acquiring lock "cinder-19085411-7634-42a4-a4a0-be31922d6feb-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:48:54 devstack cinder-volume[86873]: INFO cinder.volume.manager [req-bf700542-f844-44b3-aa88-4999cab2e345 req-762b70c7-857e-4c73-bd5a-98dbf1cf3a3c tempest-TestInstancesWithCinderVolumes-1161949889 None] Terminate volume connection completed successfully. Jul 08 18:48:54 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-bf700542-f844-44b3-aa88-4999cab2e345 req-762b70c7-857e-4c73-bd5a-98dbf1cf3a3c tempest-TestInstancesWithCinderVolumes-1161949889 None] Deleting attachment 2bd2e20e-1f4d-4afe-b3e3-c1d0a40a6f83. {{(pid=86873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 18:48:54 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] Lock "cinder-19085411-7634-42a4-a4a0-be31922d6feb-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:48:54 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] Performing cascade delete. {{(pid=86873) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 08 18:48:54 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] Acquiring lock "cinder-88f7c7d5-3df0-4bee-9a9f-88012f6f252d-delete_snapshot" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:48:54 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] Lock "cinder-88f7c7d5-3df0-4bee-9a9f-88012f6f252d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:48:54 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] Acquiring lock "cinder-quobyte-19085411-7634-42a4-a4a0-be31922d6feb" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:48:54 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] Lock "cinder-quobyte-19085411-7634-42a4-a4a0-be31922d6feb" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:48:54 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] Acquiring lock "cinder-quobyte-88f7c7d5-3df0-4bee-9a9f-88012f6f252d" by "_delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:48:54 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] Lock "cinder-quobyte-88f7c7d5-3df0-4bee-9a9f-88012f6f252d" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:48:54 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] Deleting offline snapshot 88f7c7d5-3df0-4bee-9a9f-88012f6f252d of volume 19085411-7634-42a4-a4a0-be31922d6feb {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:48:54 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] snapshot_file for this snap is: volume-19085411-7634-42a4-a4a0-be31922d6feb.88f7c7d5-3df0-4bee-9a9f-88012f6f252d {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:48:54 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[6433bdc7-7a39-4c58-87ec-599a823fe478]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:48:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb.88f7c7d5-3df0-4bee-9a9f-88012f6f252d {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:54 devstack sudo[99049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb.88f7c7d5-3df0-4bee-9a9f-88012f6f252d Jul 08 18:48:54 devstack sudo[99049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:55 devstack sudo[99049]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb.88f7c7d5-3df0-4bee-9a9f-88012f6f252d" returned: 0 in 0.780s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:55 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19085411-7634-42a4-a4a0-be31922d6feb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:48:55 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[55bb75c3-3525-46d8-ad7e-193b51feba4f]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:48:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:55 devstack sudo[99054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb Jul 08 18:48:55 devstack sudo[99054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:56 devstack sudo[99054]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb" returned: 0 in 0.758s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:56 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[9185efd9-b430-4eaf-8bee-359c55da14d6]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:48:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb.bf394e91-a0ca-4cfb-90c8-ea6eaa1c6796 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:56 devstack sudo[99059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb.bf394e91-a0ca-4cfb-90c8-ea6eaa1c6796 Jul 08 18:48:56 devstack sudo[99059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:56 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-5e9676ee-4bed-4d20-937d-cb8e2ad129a9 tempest-TestInstancesWithCinderVolumes-1161949889 None] Acquiring lock "cinder-d69060b7-e4e2-43eb-a837-f3111628cc86-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:48:56 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-5e9676ee-4bed-4d20-937d-cb8e2ad129a9 tempest-TestInstancesWithCinderVolumes-1161949889 None] Lock "cinder-d69060b7-e4e2-43eb-a837-f3111628cc86-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:48:56 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-5e9676ee-4bed-4d20-937d-cb8e2ad129a9 tempest-TestInstancesWithCinderVolumes-1161949889 None] Acquiring lock "cinder-quobyte-d69060b7-e4e2-43eb-a837-f3111628cc86" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:48:56 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-5e9676ee-4bed-4d20-937d-cb8e2ad129a9 tempest-TestInstancesWithCinderVolumes-1161949889 None] Lock "cinder-quobyte-d69060b7-e4e2-43eb-a837-f3111628cc86" acquired by "delete_volume" :: waited 0.015s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:48:56 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd5b5ea-cd8c-419f-99d0-bc051db1777d]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:48:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5e9676ee-4bed-4d20-937d-cb8e2ad129a9 tempest-TestInstancesWithCinderVolumes-1161949889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d69060b7-e4e2-43eb-a837-f3111628cc86 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:56 devstack sudo[99063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d69060b7-e4e2-43eb-a837-f3111628cc86 Jul 08 18:48:56 devstack sudo[99063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:57 devstack sudo[99059]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb.bf394e91-a0ca-4cfb-90c8-ea6eaa1c6796" returned: 0 in 0.879s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:57 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19085411-7634-42a4-a4a0-be31922d6feb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:48:57 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1114e3-165e-478c-83de-8454c2a54152]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:48:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb.88f7c7d5-3df0-4bee-9a9f-88012f6f252d {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:57 devstack sudo[99070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb.88f7c7d5-3df0-4bee-9a9f-88012f6f252d Jul 08 18:48:57 devstack sudo[99070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:57 devstack sudo[99063]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5e9676ee-4bed-4d20-937d-cb8e2ad129a9 tempest-TestInstancesWithCinderVolumes-1161949889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d69060b7-e4e2-43eb-a837-f3111628cc86" returned: 0 in 0.845s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5e9676ee-4bed-4d20-937d-cb8e2ad129a9 tempest-TestInstancesWithCinderVolumes-1161949889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d69060b7-e4e2-43eb-a837-f3111628cc86 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:57 devstack sudo[99075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d69060b7-e4e2-43eb-a837-f3111628cc86 Jul 08 18:48:57 devstack sudo[99075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:57 devstack sudo[99070]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb.88f7c7d5-3df0-4bee-9a9f-88012f6f252d" returned: 0 in 0.813s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:57 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19085411-7634-42a4-a4a0-be31922d6feb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:48:57 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7825601-6549-4934-8407-db78df0e58f4]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:48:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:58 devstack sudo[99080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb Jul 08 18:48:58 devstack sudo[99080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:58 devstack sudo[99075]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5e9676ee-4bed-4d20-937d-cb8e2ad129a9 tempest-TestInstancesWithCinderVolumes-1161949889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d69060b7-e4e2-43eb-a837-f3111628cc86" returned: 0 in 0.778s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:58 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-5e9676ee-4bed-4d20-937d-cb8e2ad129a9 tempest-TestInstancesWithCinderVolumes-1161949889 None] Lock "cinder-quobyte-d69060b7-e4e2-43eb-a837-f3111628cc86" released by "delete_volume" :: held 1.675s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:48:58 devstack cinder-volume[86873]: WARNING cinder.quota [None req-5e9676ee-4bed-4d20-937d-cb8e2ad129a9 tempest-TestInstancesWithCinderVolumes-1161949889 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1765459250-1270589805 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1765459250-1270589805, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:48:58 devstack cinder-volume[86873]: WARNING cinder.quota [None req-5e9676ee-4bed-4d20-937d-cb8e2ad129a9 tempest-TestInstancesWithCinderVolumes-1161949889 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1765459250-1270589805 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1765459250-1270589805, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:48:58 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-5e9676ee-4bed-4d20-937d-cb8e2ad129a9 tempest-TestInstancesWithCinderVolumes-1161949889 None] Created reservations ['80a2e344-4689-4217-811c-220da79ef225', 'ff2a2549-ab15-4e78-989f-0a26bc705b83', '971351f3-e7c5-4095-8744-ed0717e291d3', '01b79200-904e-4117-9282-c1609f7ed010'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:48:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5e9676ee-4bed-4d20-937d-cb8e2ad129a9 tempest-TestInstancesWithCinderVolumes-1161949889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:48:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5e9676ee-4bed-4d20-937d-cb8e2ad129a9 tempest-TestInstancesWithCinderVolumes-1161949889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:48:58 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-5e9676ee-4bed-4d20-937d-cb8e2ad129a9 tempest-TestInstancesWithCinderVolumes-1161949889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:48:58 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-5e9676ee-4bed-4d20-937d-cb8e2ad129a9 tempest-TestInstancesWithCinderVolumes-1161949889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:48:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5e9676ee-4bed-4d20-937d-cb8e2ad129a9 tempest-TestInstancesWithCinderVolumes-1161949889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:48:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5e9676ee-4bed-4d20-937d-cb8e2ad129a9 tempest-TestInstancesWithCinderVolumes-1161949889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:58 devstack sudo[99084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:48:58 devstack sudo[99084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:58 devstack sudo[99080]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb" returned: 0 in 0.828s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb.88f7c7d5-3df0-4bee-9a9f-88012f6f252d {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:58 devstack sudo[99095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb.88f7c7d5-3df0-4bee-9a9f-88012f6f252d Jul 08 18:48:58 devstack sudo[99095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:59 devstack sudo[99084]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5e9676ee-4bed-4d20-937d-cb8e2ad129a9 tempest-TestInstancesWithCinderVolumes-1161949889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.701s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:59 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-5e9676ee-4bed-4d20-937d-cb8e2ad129a9 tempest-TestInstancesWithCinderVolumes-1161949889 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:48:59 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-5e9676ee-4bed-4d20-937d-cb8e2ad129a9 tempest-TestInstancesWithCinderVolumes-1161949889 None] Deleted volume successfully. Jul 08 18:48:59 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-5e9676ee-4bed-4d20-937d-cb8e2ad129a9 tempest-TestInstancesWithCinderVolumes-1161949889 None] Lock "cinder-d69060b7-e4e2-43eb-a837-f3111628cc86-delete_volume" released by "delete_volume" :: held 2.635s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:48:59 devstack sudo[99095]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb.88f7c7d5-3df0-4bee-9a9f-88012f6f252d" returned: 0 in 0.805s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb.88f7c7d5-3df0-4bee-9a9f-88012f6f252d {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:59 devstack sudo[99117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb.88f7c7d5-3df0-4bee-9a9f-88012f6f252d Jul 08 18:48:59 devstack sudo[99117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:00 devstack sudo[99117]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb.88f7c7d5-3df0-4bee-9a9f-88012f6f252d" returned: 0 in 0.648s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19085411-7634-42a4-a4a0-be31922d6feb /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb.bf394e91-a0ca-4cfb-90c8-ea6eaa1c6796 -F qcow2 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:00 devstack sudo[99121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19085411-7634-42a4-a4a0-be31922d6feb /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb.bf394e91-a0ca-4cfb-90c8-ea6eaa1c6796 -F qcow2 Jul 08 18:49:00 devstack sudo[99121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:00 devstack sudo[99121]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19085411-7634-42a4-a4a0-be31922d6feb /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb.bf394e91-a0ca-4cfb-90c8-ea6eaa1c6796 -F qcow2" returned: 0 in 0.683s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:00 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] Lock "cinder-quobyte-88f7c7d5-3df0-4bee-9a9f-88012f6f252d" released by "_delete_snapshot" :: held 6.374s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:49:00 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] Lock "cinder-quobyte-19085411-7634-42a4-a4a0-be31922d6feb" released by "delete_snapshot" :: held 6.399s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:49:01 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] Created reservations ['6de22653-5e59-4917-a49d-05c2d5817bde', 'dd95feba-e9af-499c-9a83-a7c0e794b2c8', '7db5b205-e737-443b-8935-3f82c8b3ee61', '1ccf5735-1369-427c-8d39-faa42fdb9dc2'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:49:01 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] Delete snapshot completed successfully. Jul 08 18:49:01 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] Lock "cinder-88f7c7d5-3df0-4bee-9a9f-88012f6f252d-delete_snapshot" released by "delete_snapshot" :: held 6.599s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:49:01 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] Acquiring lock "cinder-bf394e91-a0ca-4cfb-90c8-ea6eaa1c6796-delete_snapshot" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:49:01 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] Lock "cinder-bf394e91-a0ca-4cfb-90c8-ea6eaa1c6796-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:49:01 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] Acquiring lock "cinder-quobyte-19085411-7634-42a4-a4a0-be31922d6feb" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:49:01 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] Lock "cinder-quobyte-19085411-7634-42a4-a4a0-be31922d6feb" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:49:01 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] Acquiring lock "cinder-quobyte-bf394e91-a0ca-4cfb-90c8-ea6eaa1c6796" by "_delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:49:01 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] Lock "cinder-quobyte-bf394e91-a0ca-4cfb-90c8-ea6eaa1c6796" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:49:01 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] Deleting offline snapshot bf394e91-a0ca-4cfb-90c8-ea6eaa1c6796 of volume 19085411-7634-42a4-a4a0-be31922d6feb {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:49:01 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] snapshot_file for this snap is: volume-19085411-7634-42a4-a4a0-be31922d6feb.bf394e91-a0ca-4cfb-90c8-ea6eaa1c6796 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:49:01 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[aecf3f6a-d5e7-4b54-827c-5b29c962c0e4]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:49:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb.bf394e91-a0ca-4cfb-90c8-ea6eaa1c6796 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:01 devstack cinder-volume[86873]: INFO cinder.volume.manager [req-4ecc4ff6-9d9a-46f6-8cba-2c80473d602d req-7583ec95-32b3-4103-a6b0-9ab8c38157ed tempest-TestInstancesWithCinderVolumes-1161949889 None] Terminate volume connection completed successfully. Jul 08 18:49:01 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-4ecc4ff6-9d9a-46f6-8cba-2c80473d602d req-7583ec95-32b3-4103-a6b0-9ab8c38157ed tempest-TestInstancesWithCinderVolumes-1161949889 None] Deleting attachment 48ee2171-85d4-4fc5-96c5-7fa6cb953b18. {{(pid=86873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 18:49:01 devstack sudo[99129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb.bf394e91-a0ca-4cfb-90c8-ea6eaa1c6796 Jul 08 18:49:01 devstack sudo[99129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:01 devstack sudo[99129]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb.bf394e91-a0ca-4cfb-90c8-ea6eaa1c6796" returned: 0 in 0.752s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:01 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19085411-7634-42a4-a4a0-be31922d6feb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:49:01 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9a9ace-4494-4013-aa36-0be97f81fb0d]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:49:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:02 devstack sudo[99135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb Jul 08 18:49:02 devstack sudo[99135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:02 devstack sudo[99135]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb" returned: 0 in 0.745s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb.bf394e91-a0ca-4cfb-90c8-ea6eaa1c6796 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:02 devstack sudo[99179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb.bf394e91-a0ca-4cfb-90c8-ea6eaa1c6796 Jul 08 18:49:02 devstack sudo[99179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:03 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-2bfb76d3-1b9e-4a3a-8368-84348414997c tempest-TestInstancesWithCinderVolumes-1161949889 None] Acquiring lock "cinder-1940386e-ca1a-45ea-a5ab-56db44ed54a5-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:49:03 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-2bfb76d3-1b9e-4a3a-8368-84348414997c tempest-TestInstancesWithCinderVolumes-1161949889 None] Lock "cinder-1940386e-ca1a-45ea-a5ab-56db44ed54a5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:49:03 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-2bfb76d3-1b9e-4a3a-8368-84348414997c tempest-TestInstancesWithCinderVolumes-1161949889 None] Acquiring lock "cinder-quobyte-1940386e-ca1a-45ea-a5ab-56db44ed54a5" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:49:03 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-2bfb76d3-1b9e-4a3a-8368-84348414997c tempest-TestInstancesWithCinderVolumes-1161949889 None] Lock "cinder-quobyte-1940386e-ca1a-45ea-a5ab-56db44ed54a5" acquired by "delete_volume" :: waited 0.019s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:49:03 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2cb767-9886-4918-a933-0d5597e55746]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:49:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2bfb76d3-1b9e-4a3a-8368-84348414997c tempest-TestInstancesWithCinderVolumes-1161949889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-1940386e-ca1a-45ea-a5ab-56db44ed54a5 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:03 devstack sudo[99184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-1940386e-ca1a-45ea-a5ab-56db44ed54a5 Jul 08 18:49:03 devstack sudo[99184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:03 devstack sudo[99179]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb.bf394e91-a0ca-4cfb-90c8-ea6eaa1c6796" returned: 0 in 0.816s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb.bf394e91-a0ca-4cfb-90c8-ea6eaa1c6796 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:03 devstack sudo[99186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb.bf394e91-a0ca-4cfb-90c8-ea6eaa1c6796 Jul 08 18:49:03 devstack sudo[99186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:04 devstack sudo[99184]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2bfb76d3-1b9e-4a3a-8368-84348414997c tempest-TestInstancesWithCinderVolumes-1161949889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-1940386e-ca1a-45ea-a5ab-56db44ed54a5" returned: 0 in 0.864s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2bfb76d3-1b9e-4a3a-8368-84348414997c tempest-TestInstancesWithCinderVolumes-1161949889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-1940386e-ca1a-45ea-a5ab-56db44ed54a5 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:04 devstack sudo[99186]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb.bf394e91-a0ca-4cfb-90c8-ea6eaa1c6796" returned: 0 in 0.697s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:04 devstack sudo[99192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-1940386e-ca1a-45ea-a5ab-56db44ed54a5 Jul 08 18:49:04 devstack sudo[99192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:04 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] Lock "cinder-quobyte-bf394e91-a0ca-4cfb-90c8-ea6eaa1c6796" released by "_delete_snapshot" :: held 3.124s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:49:04 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] Lock "cinder-quobyte-19085411-7634-42a4-a4a0-be31922d6feb" released by "delete_snapshot" :: held 3.150s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:49:04 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] Created reservations ['b611ad1e-841a-4cba-a0de-6c7f9328f579', 'dd9b9dbc-d437-4764-a2ec-2f870d2fa5d2', 'db3f1596-0a7a-40cf-b47d-4cfe40d41674', '9ba3fbe9-6ba1-4952-9ac6-3e646f97c699'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:49:04 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] Delete snapshot completed successfully. Jul 08 18:49:04 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] Lock "cinder-bf394e91-a0ca-4cfb-90c8-ea6eaa1c6796-delete_snapshot" released by "delete_snapshot" :: held 3.320s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:49:04 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] Snapshots deleted, issuing volume delete {{(pid=86873) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 08 18:49:04 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] Acquiring lock "cinder-quobyte-19085411-7634-42a4-a4a0-be31922d6feb" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:49:04 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] Lock "cinder-quobyte-19085411-7634-42a4-a4a0-be31922d6feb" acquired by "delete_volume" :: waited 0.020s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:49:04 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b881a0e-5a31-4284-8f87-8defe763e01f]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:49:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:04 devstack sudo[99195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb Jul 08 18:49:04 devstack sudo[99195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:04 devstack sudo[99192]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2bfb76d3-1b9e-4a3a-8368-84348414997c tempest-TestInstancesWithCinderVolumes-1161949889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-1940386e-ca1a-45ea-a5ab-56db44ed54a5" returned: 0 in 0.757s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:04 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-2bfb76d3-1b9e-4a3a-8368-84348414997c tempest-TestInstancesWithCinderVolumes-1161949889 None] Lock "cinder-quobyte-1940386e-ca1a-45ea-a5ab-56db44ed54a5" released by "delete_volume" :: held 1.666s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:49:04 devstack cinder-volume[86873]: WARNING cinder.quota [None req-2bfb76d3-1b9e-4a3a-8368-84348414997c tempest-TestInstancesWithCinderVolumes-1161949889 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-537915767-716255109 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-537915767-716255109, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:49:04 devstack cinder-volume[86873]: WARNING cinder.quota [None req-2bfb76d3-1b9e-4a3a-8368-84348414997c tempest-TestInstancesWithCinderVolumes-1161949889 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-537915767-716255109 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-537915767-716255109, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:49:05 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-2bfb76d3-1b9e-4a3a-8368-84348414997c tempest-TestInstancesWithCinderVolumes-1161949889 None] Created reservations ['22101147-229b-436e-9331-2fc8b1e79c6a', '22d17525-edfd-40f6-886a-2596cba8c5d7', 'bb7f9961-3af5-4fdb-b574-3dc8fcc683af', '9d5ca950-3ccd-4924-a172-76f37e125a6e'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:49:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-2bfb76d3-1b9e-4a3a-8368-84348414997c tempest-TestInstancesWithCinderVolumes-1161949889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:49:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-2bfb76d3-1b9e-4a3a-8368-84348414997c tempest-TestInstancesWithCinderVolumes-1161949889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:49:05 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-2bfb76d3-1b9e-4a3a-8368-84348414997c tempest-TestInstancesWithCinderVolumes-1161949889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:49:05 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-2bfb76d3-1b9e-4a3a-8368-84348414997c tempest-TestInstancesWithCinderVolumes-1161949889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:49:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-2bfb76d3-1b9e-4a3a-8368-84348414997c tempest-TestInstancesWithCinderVolumes-1161949889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:49:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2bfb76d3-1b9e-4a3a-8368-84348414997c tempest-TestInstancesWithCinderVolumes-1161949889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:05 devstack sudo[99198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:49:05 devstack sudo[99198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:05 devstack sudo[99195]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb" returned: 0 in 0.911s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:05 devstack sudo[99204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb Jul 08 18:49:05 devstack sudo[99204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:05 devstack sudo[99198]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2bfb76d3-1b9e-4a3a-8368-84348414997c tempest-TestInstancesWithCinderVolumes-1161949889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.836s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:05 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-2bfb76d3-1b9e-4a3a-8368-84348414997c tempest-TestInstancesWithCinderVolumes-1161949889 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:49:05 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-2bfb76d3-1b9e-4a3a-8368-84348414997c tempest-TestInstancesWithCinderVolumes-1161949889 None] Deleted volume successfully. Jul 08 18:49:06 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-2bfb76d3-1b9e-4a3a-8368-84348414997c tempest-TestInstancesWithCinderVolumes-1161949889 None] Lock "cinder-1940386e-ca1a-45ea-a5ab-56db44ed54a5-delete_volume" released by "delete_volume" :: held 2.781s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:49:06 devstack sudo[99204]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-19085411-7634-42a4-a4a0-be31922d6feb" returned: 0 in 0.769s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:06 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] Lock "cinder-quobyte-19085411-7634-42a4-a4a0-be31922d6feb" released by "delete_volume" :: held 1.762s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:49:06 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] Created reservations ['28974f49-e6a0-442c-a03a-0da0a3382c46', 'b01d0e91-949a-44bd-93fb-b7ddbb93c6fb', 'a67c67c4-bee1-4438-ba40-3496febc8311', 'bf384f11-f1e3-4917-bd84-771c4ef545e4'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:49:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:49:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:49:06 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:49:06 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:49:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:49:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:06 devstack sudo[99210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:49:06 devstack sudo[99210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:06 devstack sudo[99210]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.703s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:07 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:49:07 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] Deleted volume successfully. Jul 08 18:49:07 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-67d25663-8a56-4278-a15e-ae01750747ba tempest-VolumesDeleteCascade-559030606 None] Lock "cinder-19085411-7634-42a4-a4a0-be31922d6feb-delete_volume" released by "delete_volume" :: held 12.636s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:49:07 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f67dcce-4fa1-4f69-aebb-77f2b7013bcb tempest-VolumesDeleteCascade-559030606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:49:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2f67dcce-4fa1-4f69-aebb-77f2b7013bcb tempest-VolumesDeleteCascade-559030606 None] Flow 'volume_create_manager' (86e95bd2-0978-4861-9459-95530f6aabda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:49:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2f67dcce-4fa1-4f69-aebb-77f2b7013bcb tempest-VolumesDeleteCascade-559030606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4693074-58c0-46be-a995-058f0df727d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2f67dcce-4fa1-4f69-aebb-77f2b7013bcb tempest-VolumesDeleteCascade-559030606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4693074-58c0-46be-a995-058f0df727d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:49:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1457220384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07efca51-0fc0-47ef-8841-2ab0263007f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c4976a626d5458f9cb129e6536c6dd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:49:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:49:07Z,use_quota=True,user_id='e664c6c374094c50beb16234e908c339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2f67dcce-4fa1-4f69-aebb-77f2b7013bcb tempest-VolumesDeleteCascade-559030606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52e55f08-871a-41c5-8bab-b3ccab20691e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2f67dcce-4fa1-4f69-aebb-77f2b7013bcb tempest-VolumesDeleteCascade-559030606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52e55f08-871a-41c5-8bab-b3ccab20691e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2f67dcce-4fa1-4f69-aebb-77f2b7013bcb tempest-VolumesDeleteCascade-559030606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2f91038-51e3-499e-a3b2-f74954265747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2f67dcce-4fa1-4f69-aebb-77f2b7013bcb tempest-VolumesDeleteCascade-559030606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2f91038-51e3-499e-a3b2-f74954265747) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07efca51-0fc0-47ef-8841-2ab0263007f8', 'volume_name': 'volume-07efca51-0fc0-47ef-8841-2ab0263007f8', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2f67dcce-4fa1-4f69-aebb-77f2b7013bcb tempest-VolumesDeleteCascade-559030606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acba6466-ad63-48e2-b71a-060acf1cfb13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2f67dcce-4fa1-4f69-aebb-77f2b7013bcb tempest-VolumesDeleteCascade-559030606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acba6466-ad63-48e2-b71a-060acf1cfb13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2f67dcce-4fa1-4f69-aebb-77f2b7013bcb tempest-VolumesDeleteCascade-559030606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53d49dae-a872-4d1b-b696-27120612f96a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:07 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-2f67dcce-4fa1-4f69-aebb-77f2b7013bcb tempest-VolumesDeleteCascade-559030606 None] Volume 07efca51-0fc0-47ef-8841-2ab0263007f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07efca51-0fc0-47ef-8841-2ab0263007f8', 'volume_size': 1} Jul 08 18:49:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-2f67dcce-4fa1-4f69-aebb-77f2b7013bcb tempest-VolumesDeleteCascade-559030606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:49:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-2f67dcce-4fa1-4f69-aebb-77f2b7013bcb tempest-VolumesDeleteCascade-559030606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:49:07 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-2f67dcce-4fa1-4f69-aebb-77f2b7013bcb tempest-VolumesDeleteCascade-559030606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:49:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1457220384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07efca51-0fc0-47ef-8841-2ab0263007f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c4976a626d5458f9cb129e6536c6dd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:49:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:49:07Z,use_quota=True,user_id='e664c6c374094c50beb16234e908c339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:49:07 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-2f67dcce-4fa1-4f69-aebb-77f2b7013bcb tempest-VolumesDeleteCascade-559030606 None] Creating volume 07efca51-0fc0-47ef-8841-2ab0263007f8 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:49:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-2f67dcce-4fa1-4f69-aebb-77f2b7013bcb tempest-VolumesDeleteCascade-559030606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:49:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-2f67dcce-4fa1-4f69-aebb-77f2b7013bcb tempest-VolumesDeleteCascade-559030606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:49:07 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-2f67dcce-4fa1-4f69-aebb-77f2b7013bcb tempest-VolumesDeleteCascade-559030606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:49:07 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-2f67dcce-4fa1-4f69-aebb-77f2b7013bcb tempest-VolumesDeleteCascade-559030606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:49:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-2f67dcce-4fa1-4f69-aebb-77f2b7013bcb tempest-VolumesDeleteCascade-559030606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:49:07 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-2f67dcce-4fa1-4f69-aebb-77f2b7013bcb tempest-VolumesDeleteCascade-559030606 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:49:07 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-2f67dcce-4fa1-4f69-aebb-77f2b7013bcb tempest-VolumesDeleteCascade-559030606 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:49:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2f67dcce-4fa1-4f69-aebb-77f2b7013bcb tempest-VolumesDeleteCascade-559030606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07efca51-0fc0-47ef-8841-2ab0263007f8 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:07 devstack sudo[99218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07efca51-0fc0-47ef-8841-2ab0263007f8 1073741824 Jul 08 18:49:07 devstack sudo[99218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:08 devstack sudo[99218]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2f67dcce-4fa1-4f69-aebb-77f2b7013bcb tempest-VolumesDeleteCascade-559030606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07efca51-0fc0-47ef-8841-2ab0263007f8 1073741824" returned: 0 in 1.087s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2f67dcce-4fa1-4f69-aebb-77f2b7013bcb tempest-VolumesDeleteCascade-559030606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07efca51-0fc0-47ef-8841-2ab0263007f8 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:08 devstack sudo[99244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07efca51-0fc0-47ef-8841-2ab0263007f8 Jul 08 18:49:08 devstack sudo[99244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:09 devstack sudo[99244]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2f67dcce-4fa1-4f69-aebb-77f2b7013bcb tempest-VolumesDeleteCascade-559030606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07efca51-0fc0-47ef-8841-2ab0263007f8" returned: 0 in 0.674s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:09 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-2f67dcce-4fa1-4f69-aebb-77f2b7013bcb tempest-VolumesDeleteCascade-559030606 None] <== create_volume: return (1813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:49:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-2f67dcce-4fa1-4f69-aebb-77f2b7013bcb tempest-VolumesDeleteCascade-559030606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.815s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:49:09 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2f67dcce-4fa1-4f69-aebb-77f2b7013bcb tempest-VolumesDeleteCascade-559030606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53d49dae-a872-4d1b-b696-27120612f96a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07efca51-0fc0-47ef-8841-2ab0263007f8', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:09 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2f67dcce-4fa1-4f69-aebb-77f2b7013bcb tempest-VolumesDeleteCascade-559030606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b877a18-8d71-4a85-8adf-6c96a57fa125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:09 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-2f67dcce-4fa1-4f69-aebb-77f2b7013bcb tempest-VolumesDeleteCascade-559030606 None] Volume volume-07efca51-0fc0-47ef-8841-2ab0263007f8 (07efca51-0fc0-47ef-8841-2ab0263007f8): created successfully Jul 08 18:49:09 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2f67dcce-4fa1-4f69-aebb-77f2b7013bcb tempest-VolumesDeleteCascade-559030606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b877a18-8d71-4a85-8adf-6c96a57fa125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:09 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2f67dcce-4fa1-4f69-aebb-77f2b7013bcb tempest-VolumesDeleteCascade-559030606 None] Flow 'volume_create_manager' (86e95bd2-0978-4861-9459-95530f6aabda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:49:09 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-2f67dcce-4fa1-4f69-aebb-77f2b7013bcb tempest-VolumesDeleteCascade-559030606 None] Created volume successfully. Jul 08 18:49:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f147caf9-8ef4-4d89-b28b-6c126f78b4cc tempest-VolumesDeleteCascade-559030606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:49:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f147caf9-8ef4-4d89-b28b-6c126f78b4cc tempest-VolumesDeleteCascade-559030606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:49:09 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-f147caf9-8ef4-4d89-b28b-6c126f78b4cc tempest-VolumesDeleteCascade-559030606 None] Creating offline snapshot f560d9f6-d71f-4236-a6ca-c845b4d716e8 of volume 07efca51-0fc0-47ef-8841-2ab0263007f8 {{(pid=86873) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:49:09 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b5b902-841b-408d-9e11-96986357763c]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:49:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f147caf9-8ef4-4d89-b28b-6c126f78b4cc tempest-VolumesDeleteCascade-559030606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07efca51-0fc0-47ef-8841-2ab0263007f8 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:09 devstack sudo[99248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07efca51-0fc0-47ef-8841-2ab0263007f8 Jul 08 18:49:09 devstack sudo[99248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:09 devstack cinder-volume[86873]: INFO cinder.volume.manager [req-173e1a4d-9646-4176-a9b5-e6c791032cef req-9ee7b828-ee09-4e60-9fd7-ae169443126d tempest-TestInstancesWithCinderVolumes-1161949889 None] Terminate volume connection completed successfully. Jul 08 18:49:09 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-173e1a4d-9646-4176-a9b5-e6c791032cef req-9ee7b828-ee09-4e60-9fd7-ae169443126d tempest-TestInstancesWithCinderVolumes-1161949889 None] Deleting attachment 3887962c-f000-48a7-8730-b441c7d64ef2. {{(pid=86873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 18:49:10 devstack sudo[99248]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f147caf9-8ef4-4d89-b28b-6c126f78b4cc tempest-VolumesDeleteCascade-559030606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07efca51-0fc0-47ef-8841-2ab0263007f8" returned: 0 in 0.762s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f147caf9-8ef4-4d89-b28b-6c126f78b4cc tempest-VolumesDeleteCascade-559030606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07efca51-0fc0-47ef-8841-2ab0263007f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07efca51-0fc0-47ef-8841-2ab0263007f8.f560d9f6-d71f-4236-a6ca-c845b4d716e8 1G {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:10 devstack sudo[99253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07efca51-0fc0-47ef-8841-2ab0263007f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07efca51-0fc0-47ef-8841-2ab0263007f8.f560d9f6-d71f-4236-a6ca-c845b4d716e8 1G Jul 08 18:49:10 devstack sudo[99253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:10 devstack sudo[99253]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f147caf9-8ef4-4d89-b28b-6c126f78b4cc tempest-VolumesDeleteCascade-559030606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07efca51-0fc0-47ef-8841-2ab0263007f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07efca51-0fc0-47ef-8841-2ab0263007f8.f560d9f6-d71f-4236-a6ca-c845b4d716e8 1G" returned: 0 in 0.833s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f147caf9-8ef4-4d89-b28b-6c126f78b4cc tempest-VolumesDeleteCascade-559030606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07efca51-0fc0-47ef-8841-2ab0263007f8 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07efca51-0fc0-47ef-8841-2ab0263007f8.f560d9f6-d71f-4236-a6ca-c845b4d716e8 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:10 devstack sudo[99259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07efca51-0fc0-47ef-8841-2ab0263007f8 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07efca51-0fc0-47ef-8841-2ab0263007f8.f560d9f6-d71f-4236-a6ca-c845b4d716e8 Jul 08 18:49:10 devstack sudo[99259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:11 devstack sudo[99259]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f147caf9-8ef4-4d89-b28b-6c126f78b4cc tempest-VolumesDeleteCascade-559030606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07efca51-0fc0-47ef-8841-2ab0263007f8 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07efca51-0fc0-47ef-8841-2ab0263007f8.f560d9f6-d71f-4236-a6ca-c845b4d716e8" returned: 0 in 0.674s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:11 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-f147caf9-8ef4-4d89-b28b-6c126f78b4cc tempest-VolumesDeleteCascade-559030606 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07efca51-0fc0-47ef-8841-2ab0263007f8.f560d9f6-d71f-4236-a6ca-c845b4d716e8 is being set with open permissions: ugo+rw Jul 08 18:49:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f147caf9-8ef4-4d89-b28b-6c126f78b4cc tempest-VolumesDeleteCascade-559030606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07efca51-0fc0-47ef-8841-2ab0263007f8.f560d9f6-d71f-4236-a6ca-c845b4d716e8 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:11 devstack sudo[99264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07efca51-0fc0-47ef-8841-2ab0263007f8.f560d9f6-d71f-4236-a6ca-c845b4d716e8 Jul 08 18:49:11 devstack sudo[99264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:12 devstack sudo[99264]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f147caf9-8ef4-4d89-b28b-6c126f78b4cc tempest-VolumesDeleteCascade-559030606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07efca51-0fc0-47ef-8841-2ab0263007f8.f560d9f6-d71f-4236-a6ca-c845b4d716e8" returned: 0 in 0.639s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f147caf9-8ef4-4d89-b28b-6c126f78b4cc tempest-VolumesDeleteCascade-559030606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07efca51-0fc0-47ef-8841-2ab0263007f8.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:12 devstack sudo[99268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07efca51-0fc0-47ef-8841-2ab0263007f8.info Jul 08 18:49:12 devstack sudo[99268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:12 devstack sudo[99268]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f147caf9-8ef4-4d89-b28b-6c126f78b4cc tempest-VolumesDeleteCascade-559030606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07efca51-0fc0-47ef-8841-2ab0263007f8.info" returned: 0 in 0.667s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:12 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-f147caf9-8ef4-4d89-b28b-6c126f78b4cc tempest-VolumesDeleteCascade-559030606 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07efca51-0fc0-47ef-8841-2ab0263007f8.info is being set with open permissions: ugo+rw Jul 08 18:49:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f147caf9-8ef4-4d89-b28b-6c126f78b4cc tempest-VolumesDeleteCascade-559030606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07efca51-0fc0-47ef-8841-2ab0263007f8.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:13 devstack sudo[99271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07efca51-0fc0-47ef-8841-2ab0263007f8.info Jul 08 18:49:13 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-07f939a9-5041-45b5-8bca-f68a78b3f847 tempest-TestInstancesWithCinderVolumes-1161949889 None] Acquiring lock "cinder-4f30777a-4d9c-4ac0-bbc1-cfdeca050453-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:49:13 devstack sudo[99271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:13 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-07f939a9-5041-45b5-8bca-f68a78b3f847 tempest-TestInstancesWithCinderVolumes-1161949889 None] Lock "cinder-4f30777a-4d9c-4ac0-bbc1-cfdeca050453-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:49:13 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-07f939a9-5041-45b5-8bca-f68a78b3f847 tempest-TestInstancesWithCinderVolumes-1161949889 None] Acquiring lock "cinder-quobyte-4f30777a-4d9c-4ac0-bbc1-cfdeca050453" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:49:13 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-07f939a9-5041-45b5-8bca-f68a78b3f847 tempest-TestInstancesWithCinderVolumes-1161949889 None] Lock "cinder-quobyte-4f30777a-4d9c-4ac0-bbc1-cfdeca050453" acquired by "delete_volume" :: waited 0.019s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:49:13 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a7d8aa-896d-4ea9-afad-85312fdc9b11]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:49:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-07f939a9-5041-45b5-8bca-f68a78b3f847 tempest-TestInstancesWithCinderVolumes-1161949889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4f30777a-4d9c-4ac0-bbc1-cfdeca050453 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:13 devstack sudo[99273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4f30777a-4d9c-4ac0-bbc1-cfdeca050453 Jul 08 18:49:13 devstack sudo[99273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:13 devstack sudo[99271]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f147caf9-8ef4-4d89-b28b-6c126f78b4cc tempest-VolumesDeleteCascade-559030606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07efca51-0fc0-47ef-8841-2ab0263007f8.info" returned: 0 in 0.717s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f147caf9-8ef4-4d89-b28b-6c126f78b4cc tempest-VolumesDeleteCascade-559030606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.380s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:49:13 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-f147caf9-8ef4-4d89-b28b-6c126f78b4cc tempest-VolumesDeleteCascade-559030606 None] Create snapshot completed successfully Jul 08 18:49:13 devstack sudo[99273]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-07f939a9-5041-45b5-8bca-f68a78b3f847 tempest-TestInstancesWithCinderVolumes-1161949889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4f30777a-4d9c-4ac0-bbc1-cfdeca050453" returned: 0 in 0.769s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-07f939a9-5041-45b5-8bca-f68a78b3f847 tempest-TestInstancesWithCinderVolumes-1161949889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4f30777a-4d9c-4ac0-bbc1-cfdeca050453 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:14 devstack sudo[99278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4f30777a-4d9c-4ac0-bbc1-cfdeca050453 Jul 08 18:49:14 devstack sudo[99278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:14 devstack sudo[99278]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-07f939a9-5041-45b5-8bca-f68a78b3f847 tempest-TestInstancesWithCinderVolumes-1161949889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4f30777a-4d9c-4ac0-bbc1-cfdeca050453" returned: 1 in 0.724s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-07f939a9-5041-45b5-8bca-f68a78b3f847 tempest-TestInstancesWithCinderVolumes-1161949889 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4f30777a-4d9c-4ac0-bbc1-cfdeca050453' failed. Not Retrying. {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:49:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-07f939a9-5041-45b5-8bca-f68a78b3f847 tempest-TestInstancesWithCinderVolumes-1161949889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4f30777a-4d9c-4ac0-bbc1-cfdeca050453 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:14 devstack sudo[99283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4f30777a-4d9c-4ac0-bbc1-cfdeca050453 Jul 08 18:49:14 devstack sudo[99283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:15 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-b49d16da-4d4c-4b22-b20a-ca0ae56ad48c tempest-VolumesDeleteCascade-559030606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:49:15 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b49d16da-4d4c-4b22-b20a-ca0ae56ad48c tempest-VolumesDeleteCascade-559030606 None] Flow 'volume_create_manager' (30732b1a-78e7-4bfe-9811-fff883989929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:49:15 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b49d16da-4d4c-4b22-b20a-ca0ae56ad48c tempest-VolumesDeleteCascade-559030606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fca7fc5-fd81-4753-8c70-865dd633d59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:15 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b49d16da-4d4c-4b22-b20a-ca0ae56ad48c tempest-VolumesDeleteCascade-559030606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fca7fc5-fd81-4753-8c70-865dd633d59f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:49:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1226792630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d346cce7-0fbc-44a3-b956-21c7ef223a18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c4976a626d5458f9cb129e6536c6dd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:49:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f560d9f6-d71f-4236-a6ca-c845b4d716e8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:49:15Z,use_quota=True,user_id='e664c6c374094c50beb16234e908c339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:15 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b49d16da-4d4c-4b22-b20a-ca0ae56ad48c tempest-VolumesDeleteCascade-559030606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87553922-5914-42e7-9e99-5dfc259f3881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:15 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b49d16da-4d4c-4b22-b20a-ca0ae56ad48c tempest-VolumesDeleteCascade-559030606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87553922-5914-42e7-9e99-5dfc259f3881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:15 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b49d16da-4d4c-4b22-b20a-ca0ae56ad48c tempest-VolumesDeleteCascade-559030606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (133442d7-da65-484e-ba1d-92849a0fac48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:15 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b49d16da-4d4c-4b22-b20a-ca0ae56ad48c tempest-VolumesDeleteCascade-559030606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (133442d7-da65-484e-ba1d-92849a0fac48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd346cce7-0fbc-44a3-b956-21c7ef223a18', 'volume_name': 'volume-d346cce7-0fbc-44a3-b956-21c7ef223a18', 'volume_size': 1, 'snapshot_id': 'f560d9f6-d71f-4236-a6ca-c845b4d716e8'}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:15 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b49d16da-4d4c-4b22-b20a-ca0ae56ad48c tempest-VolumesDeleteCascade-559030606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f4567d2-6521-4faf-a6bc-9c91bf9008a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:15 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b49d16da-4d4c-4b22-b20a-ca0ae56ad48c tempest-VolumesDeleteCascade-559030606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f4567d2-6521-4faf-a6bc-9c91bf9008a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:15 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b49d16da-4d4c-4b22-b20a-ca0ae56ad48c tempest-VolumesDeleteCascade-559030606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa352ee9-f35f-4acd-b806-e8be25a82946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:15 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-b49d16da-4d4c-4b22-b20a-ca0ae56ad48c tempest-VolumesDeleteCascade-559030606 None] Volume d346cce7-0fbc-44a3-b956-21c7ef223a18: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d346cce7-0fbc-44a3-b956-21c7ef223a18', 'volume_size': 1, 'snapshot_id': 'f560d9f6-d71f-4236-a6ca-c845b4d716e8'} Jul 08 18:49:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b49d16da-4d4c-4b22-b20a-ca0ae56ad48c tempest-VolumesDeleteCascade-559030606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:49:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b49d16da-4d4c-4b22-b20a-ca0ae56ad48c tempest-VolumesDeleteCascade-559030606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:49:15 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b49d16da-4d4c-4b22-b20a-ca0ae56ad48c tempest-VolumesDeleteCascade-559030606 None] Acquiring lock "cinder-quobyte-f560d9f6-d71f-4236-a6ca-c845b4d716e8-d346cce7-0fbc-44a3-b956-21c7ef223a18" by "_create_volume_from_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:49:15 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b49d16da-4d4c-4b22-b20a-ca0ae56ad48c tempest-VolumesDeleteCascade-559030606 None] Lock "cinder-quobyte-f560d9f6-d71f-4236-a6ca-c845b4d716e8-d346cce7-0fbc-44a3-b956-21c7ef223a18" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:49:15 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b49d16da-4d4c-4b22-b20a-ca0ae56ad48c tempest-VolumesDeleteCascade-559030606 None] Creating volume d346cce7-0fbc-44a3-b956-21c7ef223a18 from snapshot f560d9f6-d71f-4236-a6ca-c845b4d716e8 {{(pid=86873) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 18:49:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b49d16da-4d4c-4b22-b20a-ca0ae56ad48c tempest-VolumesDeleteCascade-559030606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:49:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b49d16da-4d4c-4b22-b20a-ca0ae56ad48c tempest-VolumesDeleteCascade-559030606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:49:15 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b49d16da-4d4c-4b22-b20a-ca0ae56ad48c tempest-VolumesDeleteCascade-559030606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:49:15 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b49d16da-4d4c-4b22-b20a-ca0ae56ad48c tempest-VolumesDeleteCascade-559030606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:49:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b49d16da-4d4c-4b22-b20a-ca0ae56ad48c tempest-VolumesDeleteCascade-559030606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:49:15 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b49d16da-4d4c-4b22-b20a-ca0ae56ad48c tempest-VolumesDeleteCascade-559030606 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:49:15 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b49d16da-4d4c-4b22-b20a-ca0ae56ad48c tempest-VolumesDeleteCascade-559030606 None] Acquiring lock "cinder-quobyte-d346cce7-0fbc-44a3-b956-21c7ef223a18" by "_copy_volume_from_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:49:15 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b49d16da-4d4c-4b22-b20a-ca0ae56ad48c tempest-VolumesDeleteCascade-559030606 None] Lock "cinder-quobyte-d346cce7-0fbc-44a3-b956-21c7ef223a18" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:49:15 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b49d16da-4d4c-4b22-b20a-ca0ae56ad48c tempest-VolumesDeleteCascade-559030606 None] snapshot: f560d9f6-d71f-4236-a6ca-c845b4d716e8, volume: d346cce7-0fbc-44a3-b956-21c7ef223a18, {{(pid=86873) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 18:49:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b49d16da-4d4c-4b22-b20a-ca0ae56ad48c tempest-VolumesDeleteCascade-559030606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:49:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b49d16da-4d4c-4b22-b20a-ca0ae56ad48c tempest-VolumesDeleteCascade-559030606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:49:15 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b49d16da-4d4c-4b22-b20a-ca0ae56ad48c tempest-VolumesDeleteCascade-559030606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:49:15 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b49d16da-4d4c-4b22-b20a-ca0ae56ad48c tempest-VolumesDeleteCascade-559030606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:49:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b49d16da-4d4c-4b22-b20a-ca0ae56ad48c tempest-VolumesDeleteCascade-559030606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:49:15 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[147dd83b-a823-4b49-b6d6-2b4fa6bcca6e]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:49:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b49d16da-4d4c-4b22-b20a-ca0ae56ad48c tempest-VolumesDeleteCascade-559030606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07efca51-0fc0-47ef-8841-2ab0263007f8.f560d9f6-d71f-4236-a6ca-c845b4d716e8 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:15 devstack sudo[99283]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-07f939a9-5041-45b5-8bca-f68a78b3f847 tempest-TestInstancesWithCinderVolumes-1161949889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4f30777a-4d9c-4ac0-bbc1-cfdeca050453" returned: 0 in 0.676s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:15 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-07f939a9-5041-45b5-8bca-f68a78b3f847 tempest-TestInstancesWithCinderVolumes-1161949889 None] Lock "cinder-quobyte-4f30777a-4d9c-4ac0-bbc1-cfdeca050453" released by "delete_volume" :: held 2.235s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:49:15 devstack cinder-volume[86873]: WARNING cinder.quota [None req-07f939a9-5041-45b5-8bca-f68a78b3f847 tempest-TestInstancesWithCinderVolumes-1161949889 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1813455755-1027145194 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1813455755-1027145194, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:49:15 devstack cinder-volume[86873]: WARNING cinder.quota [None req-07f939a9-5041-45b5-8bca-f68a78b3f847 tempest-TestInstancesWithCinderVolumes-1161949889 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1813455755-1027145194 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1813455755-1027145194, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:49:15 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-07f939a9-5041-45b5-8bca-f68a78b3f847 tempest-TestInstancesWithCinderVolumes-1161949889 None] Created reservations ['aa3d000c-3d61-4c2a-9d3b-4ad83bde4d89', '53163139-b76a-4a03-87f7-9339517cdff2', '8c0de4bf-d130-49a4-ad09-52a61b05d12b', 'd48d997b-1201-4adf-bf3c-64bf9c3a82d2'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:49:15 devstack sudo[99286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07efca51-0fc0-47ef-8841-2ab0263007f8.f560d9f6-d71f-4236-a6ca-c845b4d716e8 Jul 08 18:49:15 devstack sudo[99286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-07f939a9-5041-45b5-8bca-f68a78b3f847 tempest-TestInstancesWithCinderVolumes-1161949889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:49:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-07f939a9-5041-45b5-8bca-f68a78b3f847 tempest-TestInstancesWithCinderVolumes-1161949889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:49:15 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-07f939a9-5041-45b5-8bca-f68a78b3f847 tempest-TestInstancesWithCinderVolumes-1161949889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:49:15 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-07f939a9-5041-45b5-8bca-f68a78b3f847 tempest-TestInstancesWithCinderVolumes-1161949889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:49:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-07f939a9-5041-45b5-8bca-f68a78b3f847 tempest-TestInstancesWithCinderVolumes-1161949889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:49:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-07f939a9-5041-45b5-8bca-f68a78b3f847 tempest-TestInstancesWithCinderVolumes-1161949889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:15 devstack sudo[99288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:49:15 devstack sudo[99288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:16 devstack sudo[99286]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b49d16da-4d4c-4b22-b20a-ca0ae56ad48c tempest-VolumesDeleteCascade-559030606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07efca51-0fc0-47ef-8841-2ab0263007f8.f560d9f6-d71f-4236-a6ca-c845b4d716e8" returned: 0 in 0.777s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:16 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-b49d16da-4d4c-4b22-b20a-ca0ae56ad48c tempest-VolumesDeleteCascade-559030606 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07efca51-0fc0-47ef-8841-2ab0263007f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:49:16 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b49d16da-4d4c-4b22-b20a-ca0ae56ad48c tempest-VolumesDeleteCascade-559030606 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07efca51-0fc0-47ef-8841-2ab0263007f8 {{(pid=86873) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 18:49:16 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b49d16da-4d4c-4b22-b20a-ca0ae56ad48c tempest-VolumesDeleteCascade-559030606 None] Creating direct copy from snapshot {{(pid=86873) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 18:49:16 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c9d4b7-662e-4625-af5b-0b9c824c30b1]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:49:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b49d16da-4d4c-4b22-b20a-ca0ae56ad48c tempest-VolumesDeleteCascade-559030606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07efca51-0fc0-47ef-8841-2ab0263007f8 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:16 devstack sudo[99288]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-07f939a9-5041-45b5-8bca-f68a78b3f847 tempest-TestInstancesWithCinderVolumes-1161949889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.682s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:16 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-07f939a9-5041-45b5-8bca-f68a78b3f847 tempest-TestInstancesWithCinderVolumes-1161949889 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:49:16 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-07f939a9-5041-45b5-8bca-f68a78b3f847 tempest-TestInstancesWithCinderVolumes-1161949889 None] Deleted volume successfully. Jul 08 18:49:16 devstack sudo[99300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07efca51-0fc0-47ef-8841-2ab0263007f8 Jul 08 18:49:16 devstack sudo[99300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:16 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-07f939a9-5041-45b5-8bca-f68a78b3f847 tempest-TestInstancesWithCinderVolumes-1161949889 None] Lock "cinder-4f30777a-4d9c-4ac0-bbc1-cfdeca050453-delete_volume" released by "delete_volume" :: held 3.136s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:49:16 devstack sudo[99300]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b49d16da-4d4c-4b22-b20a-ca0ae56ad48c tempest-VolumesDeleteCascade-559030606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07efca51-0fc0-47ef-8841-2ab0263007f8" returned: 0 in 0.764s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:16 devstack cinder-volume[86873]: DEBUG cinder.utils [None req-b49d16da-4d4c-4b22-b20a-ca0ae56ad48c tempest-VolumesDeleteCascade-559030606 None] Path /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d346cce7-0fbc-44a3-b956-21c7ef223a18 not found in is_blk_device check {{(pid=86873) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 18:49:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b49d16da-4d4c-4b22-b20a-ca0ae56ad48c tempest-VolumesDeleteCascade-559030606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07efca51-0fc0-47ef-8841-2ab0263007f8 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d346cce7-0fbc-44a3-b956-21c7ef223a18 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:16 devstack sudo[99305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07efca51-0fc0-47ef-8841-2ab0263007f8 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d346cce7-0fbc-44a3-b956-21c7ef223a18 Jul 08 18:49:16 devstack sudo[99305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:22 devstack sudo[99305]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b49d16da-4d4c-4b22-b20a-ca0ae56ad48c tempest-VolumesDeleteCascade-559030606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07efca51-0fc0-47ef-8841-2ab0263007f8 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d346cce7-0fbc-44a3-b956-21c7ef223a18" returned: 0 in 5.490s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:22 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c61bbf6-41c0-4ecc-88ce-6d1bdb77f030]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:49:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b49d16da-4d4c-4b22-b20a-ca0ae56ad48c tempest-VolumesDeleteCascade-559030606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07efca51-0fc0-47ef-8841-2ab0263007f8 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:22 devstack sudo[99324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07efca51-0fc0-47ef-8841-2ab0263007f8 Jul 08 18:49:22 devstack sudo[99324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:23 devstack sudo[99324]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b49d16da-4d4c-4b22-b20a-ca0ae56ad48c tempest-VolumesDeleteCascade-559030606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07efca51-0fc0-47ef-8841-2ab0263007f8" returned: 0 in 0.994s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:23 devstack cinder-volume[86873]: DEBUG cinder.image.image_utils [None req-b49d16da-4d4c-4b22-b20a-ca0ae56ad48c tempest-VolumesDeleteCascade-559030606 None] Image conversion details: src /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07efca51-0fc0-47ef-8841-2ab0263007f8, size 1024.00 MB, duration 5.49 sec, destination /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d346cce7-0fbc-44a3-b956-21c7ef223a18 {{(pid=86873) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:49:23 devstack cinder-volume[86873]: INFO cinder.image.image_utils [None req-b49d16da-4d4c-4b22-b20a-ca0ae56ad48c tempest-VolumesDeleteCascade-559030606 None] Converted 1024.00 MB image at 186.47 MB/s Jul 08 18:49:23 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-b49d16da-4d4c-4b22-b20a-ca0ae56ad48c tempest-VolumesDeleteCascade-559030606 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d346cce7-0fbc-44a3-b956-21c7ef223a18 is being set with open permissions: ugo+rw Jul 08 18:49:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b49d16da-4d4c-4b22-b20a-ca0ae56ad48c tempest-VolumesDeleteCascade-559030606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d346cce7-0fbc-44a3-b956-21c7ef223a18 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:23 devstack sudo[99330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d346cce7-0fbc-44a3-b956-21c7ef223a18 Jul 08 18:49:23 devstack sudo[99330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:24 devstack sudo[99330]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b49d16da-4d4c-4b22-b20a-ca0ae56ad48c tempest-VolumesDeleteCascade-559030606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d346cce7-0fbc-44a3-b956-21c7ef223a18" returned: 0 in 0.752s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:24 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b49d16da-4d4c-4b22-b20a-ca0ae56ad48c tempest-VolumesDeleteCascade-559030606 None] Lock "cinder-quobyte-d346cce7-0fbc-44a3-b956-21c7ef223a18" released by "_copy_volume_from_snapshot" :: held 8.875s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:49:24 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b49d16da-4d4c-4b22-b20a-ca0ae56ad48c tempest-VolumesDeleteCascade-559030606 None] Lock "cinder-quobyte-f560d9f6-d71f-4236-a6ca-c845b4d716e8-d346cce7-0fbc-44a3-b956-21c7ef223a18" released by "_create_volume_from_snapshot" :: held 8.907s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:49:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b49d16da-4d4c-4b22-b20a-ca0ae56ad48c tempest-VolumesDeleteCascade-559030606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.925s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:49:24 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:UPDATE=77,cinder:SELECT=75,cinder:INSERT=19,cinder:DELETE=8 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:49:24 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:SELECT=79,cinder:INSERT=19,cinder:UPDATE=74,cinder:DELETE=4 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:49:24 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b49d16da-4d4c-4b22-b20a-ca0ae56ad48c tempest-VolumesDeleteCascade-559030606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa352ee9-f35f-4acd-b806-e8be25a82946) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d346cce7-0fbc-44a3-b956-21c7ef223a18', 'volume_size': 1, 'snapshot_id': 'f560d9f6-d71f-4236-a6ca-c845b4d716e8'}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:24 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b49d16da-4d4c-4b22-b20a-ca0ae56ad48c tempest-VolumesDeleteCascade-559030606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad55c1f2-7b3d-40ae-bad6-e07e8e692cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:24 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-b49d16da-4d4c-4b22-b20a-ca0ae56ad48c tempest-VolumesDeleteCascade-559030606 None] Volume volume-d346cce7-0fbc-44a3-b956-21c7ef223a18 (d346cce7-0fbc-44a3-b956-21c7ef223a18): created successfully Jul 08 18:49:24 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b49d16da-4d4c-4b22-b20a-ca0ae56ad48c tempest-VolumesDeleteCascade-559030606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad55c1f2-7b3d-40ae-bad6-e07e8e692cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:24 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b49d16da-4d4c-4b22-b20a-ca0ae56ad48c tempest-VolumesDeleteCascade-559030606 None] Flow 'volume_create_manager' (30732b1a-78e7-4bfe-9811-fff883989929) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:49:24 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-b49d16da-4d4c-4b22-b20a-ca0ae56ad48c tempest-VolumesDeleteCascade-559030606 None] Created volume successfully. Jul 08 18:49:25 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9cbaf79b-eaaa-42b7-855a-4ffe28515fd3 tempest-VolumesDeleteCascade-559030606 None] Acquiring lock "cinder-07efca51-0fc0-47ef-8841-2ab0263007f8-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:49:25 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9cbaf79b-eaaa-42b7-855a-4ffe28515fd3 tempest-VolumesDeleteCascade-559030606 None] Lock "cinder-07efca51-0fc0-47ef-8841-2ab0263007f8-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:49:25 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-9cbaf79b-eaaa-42b7-855a-4ffe28515fd3 tempest-VolumesDeleteCascade-559030606 None] Performing cascade delete. {{(pid=86873) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 08 18:49:25 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9cbaf79b-eaaa-42b7-855a-4ffe28515fd3 tempest-VolumesDeleteCascade-559030606 None] Acquiring lock "cinder-f560d9f6-d71f-4236-a6ca-c845b4d716e8-delete_snapshot" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:49:25 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9cbaf79b-eaaa-42b7-855a-4ffe28515fd3 tempest-VolumesDeleteCascade-559030606 None] Lock "cinder-f560d9f6-d71f-4236-a6ca-c845b4d716e8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:49:25 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9cbaf79b-eaaa-42b7-855a-4ffe28515fd3 tempest-VolumesDeleteCascade-559030606 None] Acquiring lock "cinder-quobyte-07efca51-0fc0-47ef-8841-2ab0263007f8" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:49:25 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9cbaf79b-eaaa-42b7-855a-4ffe28515fd3 tempest-VolumesDeleteCascade-559030606 None] Lock "cinder-quobyte-07efca51-0fc0-47ef-8841-2ab0263007f8" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:49:25 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9cbaf79b-eaaa-42b7-855a-4ffe28515fd3 tempest-VolumesDeleteCascade-559030606 None] Acquiring lock "cinder-quobyte-f560d9f6-d71f-4236-a6ca-c845b4d716e8" by "_delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:49:25 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9cbaf79b-eaaa-42b7-855a-4ffe28515fd3 tempest-VolumesDeleteCascade-559030606 None] Lock "cinder-quobyte-f560d9f6-d71f-4236-a6ca-c845b4d716e8" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:49:25 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-9cbaf79b-eaaa-42b7-855a-4ffe28515fd3 tempest-VolumesDeleteCascade-559030606 None] Deleting offline snapshot f560d9f6-d71f-4236-a6ca-c845b4d716e8 of volume 07efca51-0fc0-47ef-8841-2ab0263007f8 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:49:25 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-9cbaf79b-eaaa-42b7-855a-4ffe28515fd3 tempest-VolumesDeleteCascade-559030606 None] snapshot_file for this snap is: volume-07efca51-0fc0-47ef-8841-2ab0263007f8.f560d9f6-d71f-4236-a6ca-c845b4d716e8 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:49:25 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d98f23f-3f24-4138-a14c-82d0fb7e067b]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:49:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9cbaf79b-eaaa-42b7-855a-4ffe28515fd3 tempest-VolumesDeleteCascade-559030606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07efca51-0fc0-47ef-8841-2ab0263007f8.f560d9f6-d71f-4236-a6ca-c845b4d716e8 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:25 devstack sudo[99334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07efca51-0fc0-47ef-8841-2ab0263007f8.f560d9f6-d71f-4236-a6ca-c845b4d716e8 Jul 08 18:49:25 devstack sudo[99334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:26 devstack sudo[99334]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9cbaf79b-eaaa-42b7-855a-4ffe28515fd3 tempest-VolumesDeleteCascade-559030606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07efca51-0fc0-47ef-8841-2ab0263007f8.f560d9f6-d71f-4236-a6ca-c845b4d716e8" returned: 0 in 0.863s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:26 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-9cbaf79b-eaaa-42b7-855a-4ffe28515fd3 tempest-VolumesDeleteCascade-559030606 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07efca51-0fc0-47ef-8841-2ab0263007f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:49:26 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ee927b-793a-4dda-9ec1-2c46be156fb4]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:49:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9cbaf79b-eaaa-42b7-855a-4ffe28515fd3 tempest-VolumesDeleteCascade-559030606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07efca51-0fc0-47ef-8841-2ab0263007f8 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:26 devstack sudo[99339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07efca51-0fc0-47ef-8841-2ab0263007f8 Jul 08 18:49:26 devstack sudo[99339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:27 devstack sudo[99339]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9cbaf79b-eaaa-42b7-855a-4ffe28515fd3 tempest-VolumesDeleteCascade-559030606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07efca51-0fc0-47ef-8841-2ab0263007f8" returned: 0 in 0.826s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9cbaf79b-eaaa-42b7-855a-4ffe28515fd3 tempest-VolumesDeleteCascade-559030606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07efca51-0fc0-47ef-8841-2ab0263007f8.f560d9f6-d71f-4236-a6ca-c845b4d716e8 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:27 devstack sudo[99345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07efca51-0fc0-47ef-8841-2ab0263007f8.f560d9f6-d71f-4236-a6ca-c845b4d716e8 Jul 08 18:49:27 devstack sudo[99345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:27 devstack sudo[99345]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9cbaf79b-eaaa-42b7-855a-4ffe28515fd3 tempest-VolumesDeleteCascade-559030606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07efca51-0fc0-47ef-8841-2ab0263007f8.f560d9f6-d71f-4236-a6ca-c845b4d716e8" returned: 0 in 0.797s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9cbaf79b-eaaa-42b7-855a-4ffe28515fd3 tempest-VolumesDeleteCascade-559030606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07efca51-0fc0-47ef-8841-2ab0263007f8.f560d9f6-d71f-4236-a6ca-c845b4d716e8 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:27 devstack sudo[99351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07efca51-0fc0-47ef-8841-2ab0263007f8.f560d9f6-d71f-4236-a6ca-c845b4d716e8 Jul 08 18:49:27 devstack sudo[99351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:28 devstack sudo[99351]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9cbaf79b-eaaa-42b7-855a-4ffe28515fd3 tempest-VolumesDeleteCascade-559030606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07efca51-0fc0-47ef-8841-2ab0263007f8.f560d9f6-d71f-4236-a6ca-c845b4d716e8" returned: 0 in 0.751s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:28 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9cbaf79b-eaaa-42b7-855a-4ffe28515fd3 tempest-VolumesDeleteCascade-559030606 None] Lock "cinder-quobyte-f560d9f6-d71f-4236-a6ca-c845b4d716e8" released by "_delete_snapshot" :: held 3.335s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:49:28 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9cbaf79b-eaaa-42b7-855a-4ffe28515fd3 tempest-VolumesDeleteCascade-559030606 None] Lock "cinder-quobyte-07efca51-0fc0-47ef-8841-2ab0263007f8" released by "delete_snapshot" :: held 3.356s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:49:28 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-9cbaf79b-eaaa-42b7-855a-4ffe28515fd3 tempest-VolumesDeleteCascade-559030606 None] Created reservations ['a3932628-2a4d-42e9-8222-9c0ce3be5126', '11700889-cfa4-45a1-ac9f-b0e1faf098a7', '9d30dd30-4742-4a96-a8bd-b39eaf409013', '10f36b8f-8bca-44e2-bce0-116e4f2a0a6c'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:49:28 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-9cbaf79b-eaaa-42b7-855a-4ffe28515fd3 tempest-VolumesDeleteCascade-559030606 None] Delete snapshot completed successfully. Jul 08 18:49:28 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9cbaf79b-eaaa-42b7-855a-4ffe28515fd3 tempest-VolumesDeleteCascade-559030606 None] Lock "cinder-f560d9f6-d71f-4236-a6ca-c845b4d716e8-delete_snapshot" released by "delete_snapshot" :: held 3.520s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:49:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-9cbaf79b-eaaa-42b7-855a-4ffe28515fd3 tempest-VolumesDeleteCascade-559030606 None] Snapshots deleted, issuing volume delete {{(pid=86873) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 08 18:49:28 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9cbaf79b-eaaa-42b7-855a-4ffe28515fd3 tempest-VolumesDeleteCascade-559030606 None] Acquiring lock "cinder-quobyte-07efca51-0fc0-47ef-8841-2ab0263007f8" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:49:28 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9cbaf79b-eaaa-42b7-855a-4ffe28515fd3 tempest-VolumesDeleteCascade-559030606 None] Lock "cinder-quobyte-07efca51-0fc0-47ef-8841-2ab0263007f8" acquired by "delete_volume" :: waited 0.015s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:49:28 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[93df8f28-d49d-43b9-9fd8-dc759ad74c51]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:49:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9cbaf79b-eaaa-42b7-855a-4ffe28515fd3 tempest-VolumesDeleteCascade-559030606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07efca51-0fc0-47ef-8841-2ab0263007f8 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:28 devstack sudo[99354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07efca51-0fc0-47ef-8841-2ab0263007f8 Jul 08 18:49:28 devstack sudo[99354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:29 devstack sudo[99354]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9cbaf79b-eaaa-42b7-855a-4ffe28515fd3 tempest-VolumesDeleteCascade-559030606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07efca51-0fc0-47ef-8841-2ab0263007f8" returned: 0 in 0.800s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9cbaf79b-eaaa-42b7-855a-4ffe28515fd3 tempest-VolumesDeleteCascade-559030606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07efca51-0fc0-47ef-8841-2ab0263007f8 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:29 devstack sudo[99359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07efca51-0fc0-47ef-8841-2ab0263007f8 Jul 08 18:49:29 devstack sudo[99359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:30 devstack sudo[99359]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9cbaf79b-eaaa-42b7-855a-4ffe28515fd3 tempest-VolumesDeleteCascade-559030606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-07efca51-0fc0-47ef-8841-2ab0263007f8" returned: 0 in 0.686s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:30 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9cbaf79b-eaaa-42b7-855a-4ffe28515fd3 tempest-VolumesDeleteCascade-559030606 None] Lock "cinder-quobyte-07efca51-0fc0-47ef-8841-2ab0263007f8" released by "delete_volume" :: held 1.561s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:49:30 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-9cbaf79b-eaaa-42b7-855a-4ffe28515fd3 tempest-VolumesDeleteCascade-559030606 None] Created reservations ['c27420e3-46ef-4abb-8a1e-51cd1e15dc7d', '4d1817ba-f1bb-45f5-a2b0-107df1b0734c', '26855613-1e4a-4cb8-985b-2e77157842b0', '0b4d984f-3b8d-4114-890f-7adeb4aec4b8'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:49:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-9cbaf79b-eaaa-42b7-855a-4ffe28515fd3 tempest-VolumesDeleteCascade-559030606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:49:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-9cbaf79b-eaaa-42b7-855a-4ffe28515fd3 tempest-VolumesDeleteCascade-559030606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:49:30 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-9cbaf79b-eaaa-42b7-855a-4ffe28515fd3 tempest-VolumesDeleteCascade-559030606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:49:30 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-9cbaf79b-eaaa-42b7-855a-4ffe28515fd3 tempest-VolumesDeleteCascade-559030606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:49:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-9cbaf79b-eaaa-42b7-855a-4ffe28515fd3 tempest-VolumesDeleteCascade-559030606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:49:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9cbaf79b-eaaa-42b7-855a-4ffe28515fd3 tempest-VolumesDeleteCascade-559030606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:30 devstack sudo[99362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:49:30 devstack sudo[99362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:30 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-588cd953-313b-41bd-8661-b2f10337caff tempest-VolumesDeleteCascade-559030606 None] Acquiring lock "cinder-d346cce7-0fbc-44a3-b956-21c7ef223a18-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:49:30 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-588cd953-313b-41bd-8661-b2f10337caff tempest-VolumesDeleteCascade-559030606 None] Lock "cinder-d346cce7-0fbc-44a3-b956-21c7ef223a18-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:49:30 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-588cd953-313b-41bd-8661-b2f10337caff tempest-VolumesDeleteCascade-559030606 None] Acquiring lock "cinder-quobyte-d346cce7-0fbc-44a3-b956-21c7ef223a18" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:49:30 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-588cd953-313b-41bd-8661-b2f10337caff tempest-VolumesDeleteCascade-559030606 None] Lock "cinder-quobyte-d346cce7-0fbc-44a3-b956-21c7ef223a18" acquired by "delete_volume" :: waited 0.025s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:49:30 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[5478f57b-75b4-424d-b2f7-b489b5222e3d]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:49:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-588cd953-313b-41bd-8661-b2f10337caff tempest-VolumesDeleteCascade-559030606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d346cce7-0fbc-44a3-b956-21c7ef223a18 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:31 devstack sudo[99364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d346cce7-0fbc-44a3-b956-21c7ef223a18 Jul 08 18:49:31 devstack sudo[99364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:31 devstack sudo[99362]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9cbaf79b-eaaa-42b7-855a-4ffe28515fd3 tempest-VolumesDeleteCascade-559030606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.785s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:31 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-9cbaf79b-eaaa-42b7-855a-4ffe28515fd3 tempest-VolumesDeleteCascade-559030606 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:49:31 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-9cbaf79b-eaaa-42b7-855a-4ffe28515fd3 tempest-VolumesDeleteCascade-559030606 None] Deleted volume successfully. Jul 08 18:49:31 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9cbaf79b-eaaa-42b7-855a-4ffe28515fd3 tempest-VolumesDeleteCascade-559030606 None] Lock "cinder-07efca51-0fc0-47ef-8841-2ab0263007f8-delete_volume" released by "delete_volume" :: held 6.136s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:49:31 devstack sudo[99364]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-588cd953-313b-41bd-8661-b2f10337caff tempest-VolumesDeleteCascade-559030606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d346cce7-0fbc-44a3-b956-21c7ef223a18" returned: 0 in 0.797s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-588cd953-313b-41bd-8661-b2f10337caff tempest-VolumesDeleteCascade-559030606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d346cce7-0fbc-44a3-b956-21c7ef223a18 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:31 devstack sudo[99370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d346cce7-0fbc-44a3-b956-21c7ef223a18 Jul 08 18:49:31 devstack sudo[99370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:32 devstack sudo[99370]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:32 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-588cd953-313b-41bd-8661-b2f10337caff tempest-VolumesDeleteCascade-559030606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d346cce7-0fbc-44a3-b956-21c7ef223a18" returned: 0 in 0.676s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:32 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-588cd953-313b-41bd-8661-b2f10337caff tempest-VolumesDeleteCascade-559030606 None] Lock "cinder-quobyte-d346cce7-0fbc-44a3-b956-21c7ef223a18" released by "delete_volume" :: held 1.531s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:49:32 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-588cd953-313b-41bd-8661-b2f10337caff tempest-VolumesDeleteCascade-559030606 None] Created reservations ['21cef403-1f80-436a-bdeb-6b53daad59a9', 'd3ec4003-133a-48b5-b9ee-15bdf056c51d', '4b536c2b-a1a6-4a37-ae91-67f84fc639b5', '145add84-98b9-4291-87d6-520f7d7cc568'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:49:32 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-588cd953-313b-41bd-8661-b2f10337caff tempest-VolumesDeleteCascade-559030606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:49:32 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-588cd953-313b-41bd-8661-b2f10337caff tempest-VolumesDeleteCascade-559030606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:49:32 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-588cd953-313b-41bd-8661-b2f10337caff tempest-VolumesDeleteCascade-559030606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:49:32 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-588cd953-313b-41bd-8661-b2f10337caff tempest-VolumesDeleteCascade-559030606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:49:32 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-588cd953-313b-41bd-8661-b2f10337caff tempest-VolumesDeleteCascade-559030606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:49:32 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-588cd953-313b-41bd-8661-b2f10337caff tempest-VolumesDeleteCascade-559030606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:32 devstack sudo[99374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:49:32 devstack sudo[99374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:33 devstack sudo[99374]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-588cd953-313b-41bd-8661-b2f10337caff tempest-VolumesDeleteCascade-559030606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.796s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:33 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-588cd953-313b-41bd-8661-b2f10337caff tempest-VolumesDeleteCascade-559030606 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:49:33 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-588cd953-313b-41bd-8661-b2f10337caff tempest-VolumesDeleteCascade-559030606 None] Deleted volume successfully. Jul 08 18:49:33 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-588cd953-313b-41bd-8661-b2f10337caff tempest-VolumesDeleteCascade-559030606 None] Lock "cinder-d346cce7-0fbc-44a3-b956-21c7ef223a18-delete_volume" released by "delete_volume" :: held 2.585s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:49:36 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-217bfb24-acc8-448d-a930-0a919ad3b6ac tempest-VolumesNegativeTest-1714961883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:49:36 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-217bfb24-acc8-448d-a930-0a919ad3b6ac tempest-VolumesNegativeTest-1714961883 None] Flow 'volume_create_manager' (46dc17bd-e196-4b58-ae4b-ccb1e3844376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:49:36 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-217bfb24-acc8-448d-a930-0a919ad3b6ac tempest-VolumesNegativeTest-1714961883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a785d3b-c0fa-4137-946c-0cbe1afcde4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:36 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-217bfb24-acc8-448d-a930-0a919ad3b6ac tempest-VolumesNegativeTest-1714961883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a785d3b-c0fa-4137-946c-0cbe1afcde4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:49:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1307145989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14681c81-1855-43c1-851d-7342de22b9fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc94c113858548229839d776ff6f671f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:49:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:49:36Z,use_quota=True,user_id='1f95e30377a948918c44f3d0dcc271fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:36 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-217bfb24-acc8-448d-a930-0a919ad3b6ac tempest-VolumesNegativeTest-1714961883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f9de00a-70b9-401d-a50b-d61daf8dfcd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:36 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-217bfb24-acc8-448d-a930-0a919ad3b6ac tempest-VolumesNegativeTest-1714961883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f9de00a-70b9-401d-a50b-d61daf8dfcd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:36 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-217bfb24-acc8-448d-a930-0a919ad3b6ac tempest-VolumesNegativeTest-1714961883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (252f8fcb-6b02-4f48-b802-bca1355cbde0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:36 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-217bfb24-acc8-448d-a930-0a919ad3b6ac tempest-VolumesNegativeTest-1714961883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (252f8fcb-6b02-4f48-b802-bca1355cbde0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14681c81-1855-43c1-851d-7342de22b9fb', 'volume_name': 'volume-14681c81-1855-43c1-851d-7342de22b9fb', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:36 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-217bfb24-acc8-448d-a930-0a919ad3b6ac tempest-VolumesNegativeTest-1714961883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b83c6cba-c07e-4f13-b967-ea3bf6927146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:36 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-217bfb24-acc8-448d-a930-0a919ad3b6ac tempest-VolumesNegativeTest-1714961883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b83c6cba-c07e-4f13-b967-ea3bf6927146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:36 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-217bfb24-acc8-448d-a930-0a919ad3b6ac tempest-VolumesNegativeTest-1714961883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dde0fd5-e031-4cf3-8c15-ff4e82bbe9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:36 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-217bfb24-acc8-448d-a930-0a919ad3b6ac tempest-VolumesNegativeTest-1714961883 None] Volume 14681c81-1855-43c1-851d-7342de22b9fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14681c81-1855-43c1-851d-7342de22b9fb', 'volume_size': 1} Jul 08 18:49:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-217bfb24-acc8-448d-a930-0a919ad3b6ac tempest-VolumesNegativeTest-1714961883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:49:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-217bfb24-acc8-448d-a930-0a919ad3b6ac tempest-VolumesNegativeTest-1714961883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:49:36 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-217bfb24-acc8-448d-a930-0a919ad3b6ac tempest-VolumesNegativeTest-1714961883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:49:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1307145989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14681c81-1855-43c1-851d-7342de22b9fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc94c113858548229839d776ff6f671f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:49:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:49:36Z,use_quota=True,user_id='1f95e30377a948918c44f3d0dcc271fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:49:36 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-217bfb24-acc8-448d-a930-0a919ad3b6ac tempest-VolumesNegativeTest-1714961883 None] Creating volume 14681c81-1855-43c1-851d-7342de22b9fb {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:49:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-217bfb24-acc8-448d-a930-0a919ad3b6ac tempest-VolumesNegativeTest-1714961883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:49:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-217bfb24-acc8-448d-a930-0a919ad3b6ac tempest-VolumesNegativeTest-1714961883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:49:36 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-217bfb24-acc8-448d-a930-0a919ad3b6ac tempest-VolumesNegativeTest-1714961883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:49:36 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-217bfb24-acc8-448d-a930-0a919ad3b6ac tempest-VolumesNegativeTest-1714961883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:49:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-217bfb24-acc8-448d-a930-0a919ad3b6ac tempest-VolumesNegativeTest-1714961883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:49:36 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-217bfb24-acc8-448d-a930-0a919ad3b6ac tempest-VolumesNegativeTest-1714961883 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:49:36 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-217bfb24-acc8-448d-a930-0a919ad3b6ac tempest-VolumesNegativeTest-1714961883 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:49:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-217bfb24-acc8-448d-a930-0a919ad3b6ac tempest-VolumesNegativeTest-1714961883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-14681c81-1855-43c1-851d-7342de22b9fb 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:36 devstack sudo[99377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-14681c81-1855-43c1-851d-7342de22b9fb 1073741824 Jul 08 18:49:36 devstack sudo[99377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:37 devstack sudo[99377]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-217bfb24-acc8-448d-a930-0a919ad3b6ac tempest-VolumesNegativeTest-1714961883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-14681c81-1855-43c1-851d-7342de22b9fb 1073741824" returned: 0 in 0.907s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-217bfb24-acc8-448d-a930-0a919ad3b6ac tempest-VolumesNegativeTest-1714961883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-14681c81-1855-43c1-851d-7342de22b9fb {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:37 devstack sudo[99382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-14681c81-1855-43c1-851d-7342de22b9fb Jul 08 18:49:37 devstack sudo[99382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:38 devstack sudo[99382]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:38 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-217bfb24-acc8-448d-a930-0a919ad3b6ac tempest-VolumesNegativeTest-1714961883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-14681c81-1855-43c1-851d-7342de22b9fb" returned: 0 in 0.706s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:38 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-217bfb24-acc8-448d-a930-0a919ad3b6ac tempest-VolumesNegativeTest-1714961883 None] <== create_volume: return (1660ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:49:38 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-217bfb24-acc8-448d-a930-0a919ad3b6ac tempest-VolumesNegativeTest-1714961883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.662s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:49:38 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-217bfb24-acc8-448d-a930-0a919ad3b6ac tempest-VolumesNegativeTest-1714961883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dde0fd5-e031-4cf3-8c15-ff4e82bbe9ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14681c81-1855-43c1-851d-7342de22b9fb', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:38 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-217bfb24-acc8-448d-a930-0a919ad3b6ac tempest-VolumesNegativeTest-1714961883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c9d7e96-7dfd-4ef2-8d5d-d3a4e97c8a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:38 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-217bfb24-acc8-448d-a930-0a919ad3b6ac tempest-VolumesNegativeTest-1714961883 None] Volume volume-14681c81-1855-43c1-851d-7342de22b9fb (14681c81-1855-43c1-851d-7342de22b9fb): created successfully Jul 08 18:49:38 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-217bfb24-acc8-448d-a930-0a919ad3b6ac tempest-VolumesNegativeTest-1714961883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c9d7e96-7dfd-4ef2-8d5d-d3a4e97c8a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:38 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-217bfb24-acc8-448d-a930-0a919ad3b6ac tempest-VolumesNegativeTest-1714961883 None] Flow 'volume_create_manager' (46dc17bd-e196-4b58-ae4b-ccb1e3844376) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:49:38 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-217bfb24-acc8-448d-a930-0a919ad3b6ac tempest-VolumesNegativeTest-1714961883 None] Created volume successfully. Jul 08 18:49:48 devstack cinder-volume[86873]: DEBUG oslo_service.periodic_task [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86873) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:49:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:49:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:49:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:49:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:49:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:49:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:48 devstack sudo[99405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:49:48 devstack sudo[99405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:48 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:UPDATE=30,cinder:DELETE=2,cinder:SELECT=16,cinder:INSERT=7 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:49:48 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:SELECT=19,cinder:INSERT=6,cinder:UPDATE=21,cinder:DELETE=2 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:49:49 devstack sudo[99405]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.839s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:49 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:49:49 devstack cinder-volume[86873]: DEBUG oslo_service.periodic_task [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running periodic task VolumeManager._thread_info {{(pid=86873) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:49:49 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] thread count: 29 {{(pid=86873) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:49:49 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] thread info: [<_MainThread(MainThread, started 138577734545536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86873) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:50:14 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-7f36fb48-b44f-466c-a84b-5e34560c7617 tempest-VolumesNegativeTest-1714961883 None] Acquiring lock "cinder-14681c81-1855-43c1-851d-7342de22b9fb-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:50:14 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-7f36fb48-b44f-466c-a84b-5e34560c7617 tempest-VolumesNegativeTest-1714961883 None] Lock "cinder-14681c81-1855-43c1-851d-7342de22b9fb-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:50:14 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-7f36fb48-b44f-466c-a84b-5e34560c7617 tempest-VolumesNegativeTest-1714961883 None] Acquiring lock "cinder-quobyte-14681c81-1855-43c1-851d-7342de22b9fb" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:50:14 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-7f36fb48-b44f-466c-a84b-5e34560c7617 tempest-VolumesNegativeTest-1714961883 None] Lock "cinder-quobyte-14681c81-1855-43c1-851d-7342de22b9fb" acquired by "delete_volume" :: waited 0.016s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:50:14 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb91026b-e42a-46a8-9b99-19ddb47b03e1]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:50:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-7f36fb48-b44f-466c-a84b-5e34560c7617 tempest-VolumesNegativeTest-1714961883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-14681c81-1855-43c1-851d-7342de22b9fb {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:14 devstack sudo[99644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-14681c81-1855-43c1-851d-7342de22b9fb Jul 08 18:50:14 devstack sudo[99644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:15 devstack sudo[99644]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-7f36fb48-b44f-466c-a84b-5e34560c7617 tempest-VolumesNegativeTest-1714961883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-14681c81-1855-43c1-851d-7342de22b9fb" returned: 0 in 0.808s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-7f36fb48-b44f-466c-a84b-5e34560c7617 tempest-VolumesNegativeTest-1714961883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-14681c81-1855-43c1-851d-7342de22b9fb {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:15 devstack sudo[99649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-14681c81-1855-43c1-851d-7342de22b9fb Jul 08 18:50:15 devstack sudo[99649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:16 devstack sudo[99649]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-7f36fb48-b44f-466c-a84b-5e34560c7617 tempest-VolumesNegativeTest-1714961883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-14681c81-1855-43c1-851d-7342de22b9fb" returned: 0 in 0.659s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:16 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-7f36fb48-b44f-466c-a84b-5e34560c7617 tempest-VolumesNegativeTest-1714961883 None] Lock "cinder-quobyte-14681c81-1855-43c1-851d-7342de22b9fb" released by "delete_volume" :: held 1.518s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:50:16 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-7f36fb48-b44f-466c-a84b-5e34560c7617 tempest-VolumesNegativeTest-1714961883 None] Created reservations ['7fca3677-d79f-46ad-838b-43450d171b11', 'd8aaf384-967a-477c-abd6-a20b8d6cf60f', '4b6fb168-ba4a-461d-a409-16eeaf876750', '4ec5250a-2480-49a5-9894-cbd6d10fccc5'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:50:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-7f36fb48-b44f-466c-a84b-5e34560c7617 tempest-VolumesNegativeTest-1714961883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:50:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-7f36fb48-b44f-466c-a84b-5e34560c7617 tempest-VolumesNegativeTest-1714961883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:50:16 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-7f36fb48-b44f-466c-a84b-5e34560c7617 tempest-VolumesNegativeTest-1714961883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:50:16 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-7f36fb48-b44f-466c-a84b-5e34560c7617 tempest-VolumesNegativeTest-1714961883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:50:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-7f36fb48-b44f-466c-a84b-5e34560c7617 tempest-VolumesNegativeTest-1714961883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:50:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-7f36fb48-b44f-466c-a84b-5e34560c7617 tempest-VolumesNegativeTest-1714961883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:16 devstack sudo[99670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:50:16 devstack sudo[99670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:17 devstack sudo[99670]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-7f36fb48-b44f-466c-a84b-5e34560c7617 tempest-VolumesNegativeTest-1714961883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.672s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:17 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-7f36fb48-b44f-466c-a84b-5e34560c7617 tempest-VolumesNegativeTest-1714961883 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:50:17 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-7f36fb48-b44f-466c-a84b-5e34560c7617 tempest-VolumesNegativeTest-1714961883 None] Deleted volume successfully. Jul 08 18:50:17 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-7f36fb48-b44f-466c-a84b-5e34560c7617 tempest-VolumesNegativeTest-1714961883 None] Lock "cinder-14681c81-1855-43c1-851d-7342de22b9fb-delete_volume" released by "delete_volume" :: held 2.399s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:50:26 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:SELECT=7,cinder:UPDATE=8,cinder:INSERT=1 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:50:27 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:SELECT=3,cinder:INSERT=3,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:50:28 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-de155a5c-9ecd-45e4-b84a-7b1d04af46e2 tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:50:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-de155a5c-9ecd-45e4-b84a-7b1d04af46e2 tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] Flow 'volume_create_manager' (38b041d1-e5dd-4194-9e80-46b1ed03dfb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:50:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-de155a5c-9ecd-45e4-b84a-7b1d04af46e2 tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a9e8bff-13e8-4bdb-9d3e-1a5a5dc09ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:50:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-de155a5c-9ecd-45e4-b84a-7b1d04af46e2 tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a9e8bff-13e8-4bdb-9d3e-1a5a5dc09ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1853310300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41919ab8-a49c-49b1-9fc0-2b19e2a61c27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='950fddf88f094020bc249f3ce6d45bdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:50:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:50:28Z,use_quota=True,user_id='8ed70810311148fa9b3bb8cbadae5426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:50:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-de155a5c-9ecd-45e4-b84a-7b1d04af46e2 tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6230c22d-2e16-4eda-9431-e1fe6aa25ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:50:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-de155a5c-9ecd-45e4-b84a-7b1d04af46e2 tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6230c22d-2e16-4eda-9431-e1fe6aa25ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:50:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-de155a5c-9ecd-45e4-b84a-7b1d04af46e2 tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (683654c2-82db-4980-995c-2baa5d81728b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:50:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-de155a5c-9ecd-45e4-b84a-7b1d04af46e2 tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (683654c2-82db-4980-995c-2baa5d81728b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41919ab8-a49c-49b1-9fc0-2b19e2a61c27', 'volume_name': 'volume-41919ab8-a49c-49b1-9fc0-2b19e2a61c27', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:50:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-de155a5c-9ecd-45e4-b84a-7b1d04af46e2 tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f877e02-3679-4c13-adfe-30449ab3ae7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:50:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-de155a5c-9ecd-45e4-b84a-7b1d04af46e2 tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f877e02-3679-4c13-adfe-30449ab3ae7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:50:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-de155a5c-9ecd-45e4-b84a-7b1d04af46e2 tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47901a94-433d-44ad-879e-f9c0c362bcc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:50:28 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-de155a5c-9ecd-45e4-b84a-7b1d04af46e2 tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] Volume 41919ab8-a49c-49b1-9fc0-2b19e2a61c27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41919ab8-a49c-49b1-9fc0-2b19e2a61c27', 'volume_size': 1} Jul 08 18:50:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-de155a5c-9ecd-45e4-b84a-7b1d04af46e2 tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:50:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-de155a5c-9ecd-45e4-b84a-7b1d04af46e2 tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:50:28 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-de155a5c-9ecd-45e4-b84a-7b1d04af46e2 tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1853310300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41919ab8-a49c-49b1-9fc0-2b19e2a61c27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='950fddf88f094020bc249f3ce6d45bdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:50:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:50:28Z,use_quota=True,user_id='8ed70810311148fa9b3bb8cbadae5426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:50:28 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-de155a5c-9ecd-45e4-b84a-7b1d04af46e2 tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] Creating volume 41919ab8-a49c-49b1-9fc0-2b19e2a61c27 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:50:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-de155a5c-9ecd-45e4-b84a-7b1d04af46e2 tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:50:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-de155a5c-9ecd-45e4-b84a-7b1d04af46e2 tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:50:28 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-de155a5c-9ecd-45e4-b84a-7b1d04af46e2 tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:50:28 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-de155a5c-9ecd-45e4-b84a-7b1d04af46e2 tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:50:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-de155a5c-9ecd-45e4-b84a-7b1d04af46e2 tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:50:28 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-de155a5c-9ecd-45e4-b84a-7b1d04af46e2 tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:50:28 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-de155a5c-9ecd-45e4-b84a-7b1d04af46e2 tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:50:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-de155a5c-9ecd-45e4-b84a-7b1d04af46e2 tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-41919ab8-a49c-49b1-9fc0-2b19e2a61c27 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:28 devstack sudo[99678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-41919ab8-a49c-49b1-9fc0-2b19e2a61c27 1073741824 Jul 08 18:50:28 devstack sudo[99678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:29 devstack sudo[99678]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-de155a5c-9ecd-45e4-b84a-7b1d04af46e2 tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-41919ab8-a49c-49b1-9fc0-2b19e2a61c27 1073741824" returned: 0 in 0.950s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-de155a5c-9ecd-45e4-b84a-7b1d04af46e2 tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-41919ab8-a49c-49b1-9fc0-2b19e2a61c27 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:29 devstack sudo[99684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-41919ab8-a49c-49b1-9fc0-2b19e2a61c27 Jul 08 18:50:29 devstack sudo[99684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:30 devstack sudo[99684]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-de155a5c-9ecd-45e4-b84a-7b1d04af46e2 tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-41919ab8-a49c-49b1-9fc0-2b19e2a61c27" returned: 0 in 0.727s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:30 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-de155a5c-9ecd-45e4-b84a-7b1d04af46e2 tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] <== create_volume: return (1727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:50:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-de155a5c-9ecd-45e4-b84a-7b1d04af46e2 tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.730s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:50:30 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-de155a5c-9ecd-45e4-b84a-7b1d04af46e2 tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47901a94-433d-44ad-879e-f9c0c362bcc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41919ab8-a49c-49b1-9fc0-2b19e2a61c27', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:50:30 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-de155a5c-9ecd-45e4-b84a-7b1d04af46e2 tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (116615c2-21f9-438d-8218-3fd075f10280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:50:30 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-de155a5c-9ecd-45e4-b84a-7b1d04af46e2 tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] Volume volume-41919ab8-a49c-49b1-9fc0-2b19e2a61c27 (41919ab8-a49c-49b1-9fc0-2b19e2a61c27): created successfully Jul 08 18:50:30 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-de155a5c-9ecd-45e4-b84a-7b1d04af46e2 tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (116615c2-21f9-438d-8218-3fd075f10280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:50:30 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-de155a5c-9ecd-45e4-b84a-7b1d04af46e2 tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] Flow 'volume_create_manager' (38b041d1-e5dd-4194-9e80-46b1ed03dfb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:50:30 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-de155a5c-9ecd-45e4-b84a-7b1d04af46e2 tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] Created volume successfully. Jul 08 18:50:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-f3a154b8-25cd-4523-af00-23bc2643e9d1 req-75520cab-9a53-4db3-a389-e29339ef646b tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:50:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-f3a154b8-25cd-4523-af00-23bc2643e9d1 req-75520cab-9a53-4db3-a389-e29339ef646b tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:50:33 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f95054b-2447-4a1a-816d-e02d20b5d238]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:50:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-f3a154b8-25cd-4523-af00-23bc2643e9d1 req-75520cab-9a53-4db3-a389-e29339ef646b tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-41919ab8-a49c-49b1-9fc0-2b19e2a61c27 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:33 devstack sudo[99699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-41919ab8-a49c-49b1-9fc0-2b19e2a61c27 Jul 08 18:50:33 devstack sudo[99699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:34 devstack sudo[99699]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-f3a154b8-25cd-4523-af00-23bc2643e9d1 req-75520cab-9a53-4db3-a389-e29339ef646b tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-41919ab8-a49c-49b1-9fc0-2b19e2a61c27" returned: 0 in 0.980s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-f3a154b8-25cd-4523-af00-23bc2643e9d1 req-75520cab-9a53-4db3-a389-e29339ef646b tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.997s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:50:34 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-f3a154b8-25cd-4523-af00-23bc2643e9d1 req-75520cab-9a53-4db3-a389-e29339ef646b tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2', 'name': 'volume-41919ab8-a49c-49b1-9fc0-2b19e2a61c27', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5f43bb8f-a8b5-4297-98df-ae7b6fbb8358', 'enforce_multipath': True} {{(pid=86873) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 18:50:34 devstack cinder-volume[86873]: INFO cinder.volume.manager [req-f3a154b8-25cd-4523-af00-23bc2643e9d1 req-75520cab-9a53-4db3-a389-e29339ef646b tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] attachment_update completed successfully. Jul 08 18:50:38 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7f3d975-0f03-4f22-87e8-3f9dd28f8955 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:50:38 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d7f3d975-0f03-4f22-87e8-3f9dd28f8955 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Flow 'volume_create_manager' (dc69420a-f9dd-4e52-984f-e7080499021b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:50:38 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d7f3d975-0f03-4f22-87e8-3f9dd28f8955 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfe371d6-0ac3-4e56-b5a5-2310b6cfdd6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:50:38 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d7f3d975-0f03-4f22-87e8-3f9dd28f8955 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfe371d6-0ac3-4e56-b5a5-2310b6cfdd6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:50:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1444100337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afd023d3-ed04-4aae-a99f-7b4f76fba828,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea902a8a0df940338668aeb444d1f0e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:50:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:50:39Z,use_quota=True,user_id='7e85d7cadd574a908883925badd776e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:50:38 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d7f3d975-0f03-4f22-87e8-3f9dd28f8955 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1358ffd-e5b5-47e7-921d-c46c6a0325dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:50:38 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d7f3d975-0f03-4f22-87e8-3f9dd28f8955 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1358ffd-e5b5-47e7-921d-c46c6a0325dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:50:38 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d7f3d975-0f03-4f22-87e8-3f9dd28f8955 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (238dc894-81af-4a3c-8b81-8eb7c3df04b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:50:38 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d7f3d975-0f03-4f22-87e8-3f9dd28f8955 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (238dc894-81af-4a3c-8b81-8eb7c3df04b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afd023d3-ed04-4aae-a99f-7b4f76fba828', 'volume_name': 'volume-afd023d3-ed04-4aae-a99f-7b4f76fba828', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:50:38 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d7f3d975-0f03-4f22-87e8-3f9dd28f8955 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (272055e3-277a-4cf0-8953-62e52dd128f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:50:38 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d7f3d975-0f03-4f22-87e8-3f9dd28f8955 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (272055e3-277a-4cf0-8953-62e52dd128f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:50:38 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d7f3d975-0f03-4f22-87e8-3f9dd28f8955 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (352c9eb2-be6c-49fc-a465-20a540bf660c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:50:38 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-d7f3d975-0f03-4f22-87e8-3f9dd28f8955 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Volume afd023d3-ed04-4aae-a99f-7b4f76fba828: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afd023d3-ed04-4aae-a99f-7b4f76fba828', 'volume_size': 1} Jul 08 18:50:38 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-d7f3d975-0f03-4f22-87e8-3f9dd28f8955 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:50:38 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-d7f3d975-0f03-4f22-87e8-3f9dd28f8955 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:50:38 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-d7f3d975-0f03-4f22-87e8-3f9dd28f8955 tempest-TestServerVolumeAttachmentScenario-1944532969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:50:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1444100337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afd023d3-ed04-4aae-a99f-7b4f76fba828,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea902a8a0df940338668aeb444d1f0e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:50:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:50:39Z,use_quota=True,user_id='7e85d7cadd574a908883925badd776e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:50:38 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-d7f3d975-0f03-4f22-87e8-3f9dd28f8955 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Creating volume afd023d3-ed04-4aae-a99f-7b4f76fba828 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:50:38 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-d7f3d975-0f03-4f22-87e8-3f9dd28f8955 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:50:38 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-d7f3d975-0f03-4f22-87e8-3f9dd28f8955 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:50:38 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-d7f3d975-0f03-4f22-87e8-3f9dd28f8955 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:50:38 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-d7f3d975-0f03-4f22-87e8-3f9dd28f8955 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:50:38 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-d7f3d975-0f03-4f22-87e8-3f9dd28f8955 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:50:38 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-d7f3d975-0f03-4f22-87e8-3f9dd28f8955 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:50:38 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-d7f3d975-0f03-4f22-87e8-3f9dd28f8955 tempest-TestServerVolumeAttachmentScenario-1944532969 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:50:38 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d7f3d975-0f03-4f22-87e8-3f9dd28f8955 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-afd023d3-ed04-4aae-a99f-7b4f76fba828 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:38 devstack sudo[100086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-afd023d3-ed04-4aae-a99f-7b4f76fba828 1073741824 Jul 08 18:50:38 devstack sudo[100086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:39 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-293aec7b-a216-492b-8f47-b7b7a97bd5bf tempest-TestServerVolumeAttachmentScenario-1944532969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:50:39 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-293aec7b-a216-492b-8f47-b7b7a97bd5bf tempest-TestServerVolumeAttachmentScenario-1944532969 None] Flow 'volume_create_manager' (7af2f619-856f-4882-8b7a-515883cbfb29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:50:39 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-293aec7b-a216-492b-8f47-b7b7a97bd5bf tempest-TestServerVolumeAttachmentScenario-1944532969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6ee1536-ead3-41f8-b134-3ec6fbefa85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:50:39 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-293aec7b-a216-492b-8f47-b7b7a97bd5bf tempest-TestServerVolumeAttachmentScenario-1944532969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6ee1536-ead3-41f8-b134-3ec6fbefa85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:50:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1507932017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bd2ab0b-ba50-439d-b54f-cd6a9cb20556,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea902a8a0df940338668aeb444d1f0e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:50:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:50:39Z,use_quota=True,user_id='7e85d7cadd574a908883925badd776e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:50:39 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-293aec7b-a216-492b-8f47-b7b7a97bd5bf tempest-TestServerVolumeAttachmentScenario-1944532969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d43b4b5d-2e3b-45d9-ac4e-175807b810e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:50:39 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-293aec7b-a216-492b-8f47-b7b7a97bd5bf tempest-TestServerVolumeAttachmentScenario-1944532969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d43b4b5d-2e3b-45d9-ac4e-175807b810e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:50:39 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-293aec7b-a216-492b-8f47-b7b7a97bd5bf tempest-TestServerVolumeAttachmentScenario-1944532969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fed3b89-7791-47b4-bbc5-bd51d25d7b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:50:39 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-293aec7b-a216-492b-8f47-b7b7a97bd5bf tempest-TestServerVolumeAttachmentScenario-1944532969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fed3b89-7791-47b4-bbc5-bd51d25d7b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bd2ab0b-ba50-439d-b54f-cd6a9cb20556', 'volume_name': 'volume-3bd2ab0b-ba50-439d-b54f-cd6a9cb20556', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:50:39 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-293aec7b-a216-492b-8f47-b7b7a97bd5bf tempest-TestServerVolumeAttachmentScenario-1944532969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (628e575c-2c32-4125-b7cd-22452499a0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:50:39 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-293aec7b-a216-492b-8f47-b7b7a97bd5bf tempest-TestServerVolumeAttachmentScenario-1944532969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (628e575c-2c32-4125-b7cd-22452499a0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:50:39 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-293aec7b-a216-492b-8f47-b7b7a97bd5bf tempest-TestServerVolumeAttachmentScenario-1944532969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85972c77-6c59-4259-94f5-fb7c3c84579f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:50:39 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-293aec7b-a216-492b-8f47-b7b7a97bd5bf tempest-TestServerVolumeAttachmentScenario-1944532969 None] Volume 3bd2ab0b-ba50-439d-b54f-cd6a9cb20556: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bd2ab0b-ba50-439d-b54f-cd6a9cb20556', 'volume_size': 1} Jul 08 18:50:39 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-293aec7b-a216-492b-8f47-b7b7a97bd5bf tempest-TestServerVolumeAttachmentScenario-1944532969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:50:39 devstack sudo[100086]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:39 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d7f3d975-0f03-4f22-87e8-3f9dd28f8955 tempest-TestServerVolumeAttachmentScenario-1944532969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-afd023d3-ed04-4aae-a99f-7b4f76fba828 1073741824" returned: 0 in 0.926s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:39 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d7f3d975-0f03-4f22-87e8-3f9dd28f8955 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-afd023d3-ed04-4aae-a99f-7b4f76fba828 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:39 devstack sudo[100092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-afd023d3-ed04-4aae-a99f-7b4f76fba828 Jul 08 18:50:39 devstack sudo[100092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:40 devstack sudo[100092]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d7f3d975-0f03-4f22-87e8-3f9dd28f8955 tempest-TestServerVolumeAttachmentScenario-1944532969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-afd023d3-ed04-4aae-a99f-7b4f76fba828" returned: 0 in 0.802s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:40 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-d7f3d975-0f03-4f22-87e8-3f9dd28f8955 tempest-TestServerVolumeAttachmentScenario-1944532969 None] <== create_volume: return (1785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:50:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-d7f3d975-0f03-4f22-87e8-3f9dd28f8955 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.789s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:50:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-293aec7b-a216-492b-8f47-b7b7a97bd5bf tempest-TestServerVolumeAttachmentScenario-1944532969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.385s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:50:40 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-293aec7b-a216-492b-8f47-b7b7a97bd5bf tempest-TestServerVolumeAttachmentScenario-1944532969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:50:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1507932017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bd2ab0b-ba50-439d-b54f-cd6a9cb20556,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea902a8a0df940338668aeb444d1f0e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:50:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:50:39Z,use_quota=True,user_id='7e85d7cadd574a908883925badd776e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:50:40 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-293aec7b-a216-492b-8f47-b7b7a97bd5bf tempest-TestServerVolumeAttachmentScenario-1944532969 None] Creating volume 3bd2ab0b-ba50-439d-b54f-cd6a9cb20556 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:50:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-293aec7b-a216-492b-8f47-b7b7a97bd5bf tempest-TestServerVolumeAttachmentScenario-1944532969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:50:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-293aec7b-a216-492b-8f47-b7b7a97bd5bf tempest-TestServerVolumeAttachmentScenario-1944532969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:50:40 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-293aec7b-a216-492b-8f47-b7b7a97bd5bf tempest-TestServerVolumeAttachmentScenario-1944532969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:50:40 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-293aec7b-a216-492b-8f47-b7b7a97bd5bf tempest-TestServerVolumeAttachmentScenario-1944532969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:50:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-293aec7b-a216-492b-8f47-b7b7a97bd5bf tempest-TestServerVolumeAttachmentScenario-1944532969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:50:40 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-293aec7b-a216-492b-8f47-b7b7a97bd5bf tempest-TestServerVolumeAttachmentScenario-1944532969 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:50:40 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-293aec7b-a216-492b-8f47-b7b7a97bd5bf tempest-TestServerVolumeAttachmentScenario-1944532969 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:50:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-293aec7b-a216-492b-8f47-b7b7a97bd5bf tempest-TestServerVolumeAttachmentScenario-1944532969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3bd2ab0b-ba50-439d-b54f-cd6a9cb20556 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:40 devstack sudo[100095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3bd2ab0b-ba50-439d-b54f-cd6a9cb20556 1073741824 Jul 08 18:50:40 devstack sudo[100095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:40 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d7f3d975-0f03-4f22-87e8-3f9dd28f8955 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (352c9eb2-be6c-49fc-a465-20a540bf660c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afd023d3-ed04-4aae-a99f-7b4f76fba828', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:50:40 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d7f3d975-0f03-4f22-87e8-3f9dd28f8955 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5b0b8ad-fce3-4b4d-bb03-2ce882f4fd4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:50:40 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-d7f3d975-0f03-4f22-87e8-3f9dd28f8955 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Volume volume-afd023d3-ed04-4aae-a99f-7b4f76fba828 (afd023d3-ed04-4aae-a99f-7b4f76fba828): created successfully Jul 08 18:50:40 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d7f3d975-0f03-4f22-87e8-3f9dd28f8955 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5b0b8ad-fce3-4b4d-bb03-2ce882f4fd4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:50:40 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d7f3d975-0f03-4f22-87e8-3f9dd28f8955 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Flow 'volume_create_manager' (dc69420a-f9dd-4e52-984f-e7080499021b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:50:40 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-d7f3d975-0f03-4f22-87e8-3f9dd28f8955 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Created volume successfully. Jul 08 18:50:41 devstack sudo[100095]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-293aec7b-a216-492b-8f47-b7b7a97bd5bf tempest-TestServerVolumeAttachmentScenario-1944532969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3bd2ab0b-ba50-439d-b54f-cd6a9cb20556 1073741824" returned: 0 in 0.976s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-293aec7b-a216-492b-8f47-b7b7a97bd5bf tempest-TestServerVolumeAttachmentScenario-1944532969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3bd2ab0b-ba50-439d-b54f-cd6a9cb20556 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:41 devstack sudo[100101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3bd2ab0b-ba50-439d-b54f-cd6a9cb20556 Jul 08 18:50:41 devstack sudo[100101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:42 devstack sudo[100101]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-293aec7b-a216-492b-8f47-b7b7a97bd5bf tempest-TestServerVolumeAttachmentScenario-1944532969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3bd2ab0b-ba50-439d-b54f-cd6a9cb20556" returned: 0 in 0.686s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:42 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-293aec7b-a216-492b-8f47-b7b7a97bd5bf tempest-TestServerVolumeAttachmentScenario-1944532969 None] <== create_volume: return (1717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:50:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-293aec7b-a216-492b-8f47-b7b7a97bd5bf tempest-TestServerVolumeAttachmentScenario-1944532969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.720s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:50:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-293aec7b-a216-492b-8f47-b7b7a97bd5bf tempest-TestServerVolumeAttachmentScenario-1944532969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85972c77-6c59-4259-94f5-fb7c3c84579f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bd2ab0b-ba50-439d-b54f-cd6a9cb20556', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:50:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-293aec7b-a216-492b-8f47-b7b7a97bd5bf tempest-TestServerVolumeAttachmentScenario-1944532969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a8308ec-6708-4a4c-a5ee-7f5a25e2c4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:50:42 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-293aec7b-a216-492b-8f47-b7b7a97bd5bf tempest-TestServerVolumeAttachmentScenario-1944532969 None] Volume volume-3bd2ab0b-ba50-439d-b54f-cd6a9cb20556 (3bd2ab0b-ba50-439d-b54f-cd6a9cb20556): created successfully Jul 08 18:50:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-293aec7b-a216-492b-8f47-b7b7a97bd5bf tempest-TestServerVolumeAttachmentScenario-1944532969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a8308ec-6708-4a4c-a5ee-7f5a25e2c4c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:50:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-293aec7b-a216-492b-8f47-b7b7a97bd5bf tempest-TestServerVolumeAttachmentScenario-1944532969 None] Flow 'volume_create_manager' (7af2f619-856f-4882-8b7a-515883cbfb29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:50:42 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-293aec7b-a216-492b-8f47-b7b7a97bd5bf tempest-TestServerVolumeAttachmentScenario-1944532969 None] Created volume successfully. Jul 08 18:50:42 devstack cinder-volume[86873]: INFO cinder.volume.manager [req-5afb2cc5-824f-4b34-8166-e0c04158e3a4 req-02122e00-7baf-4b70-aef7-ef5de8894dc2 tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] Terminate volume connection completed successfully. Jul 08 18:50:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-5afb2cc5-824f-4b34-8166-e0c04158e3a4 req-02122e00-7baf-4b70-aef7-ef5de8894dc2 tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] Deleting attachment 5f43bb8f-a8b5-4297-98df-ae7b6fbb8358. {{(pid=86873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 18:50:44 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-869e7036-1ecb-4eb9-9265-96eb8e72a84a tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] Acquiring lock "cinder-41919ab8-a49c-49b1-9fc0-2b19e2a61c27-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:50:44 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-869e7036-1ecb-4eb9-9265-96eb8e72a84a tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] Lock "cinder-41919ab8-a49c-49b1-9fc0-2b19e2a61c27-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:50:44 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-869e7036-1ecb-4eb9-9265-96eb8e72a84a tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] Acquiring lock "cinder-quobyte-41919ab8-a49c-49b1-9fc0-2b19e2a61c27" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:50:44 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-869e7036-1ecb-4eb9-9265-96eb8e72a84a tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] Lock "cinder-quobyte-41919ab8-a49c-49b1-9fc0-2b19e2a61c27" acquired by "delete_volume" :: waited 0.014s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:50:44 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[782f8c08-6ee4-4d2c-b10c-29926791dba4]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:50:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-869e7036-1ecb-4eb9-9265-96eb8e72a84a tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-41919ab8-a49c-49b1-9fc0-2b19e2a61c27 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:44 devstack sudo[100135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-41919ab8-a49c-49b1-9fc0-2b19e2a61c27 Jul 08 18:50:44 devstack sudo[100135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:45 devstack sudo[100135]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-869e7036-1ecb-4eb9-9265-96eb8e72a84a tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-41919ab8-a49c-49b1-9fc0-2b19e2a61c27" returned: 0 in 0.786s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-869e7036-1ecb-4eb9-9265-96eb8e72a84a tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-41919ab8-a49c-49b1-9fc0-2b19e2a61c27 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:45 devstack sudo[100140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-41919ab8-a49c-49b1-9fc0-2b19e2a61c27 Jul 08 18:50:45 devstack sudo[100140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:46 devstack sudo[100140]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-869e7036-1ecb-4eb9-9265-96eb8e72a84a tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-41919ab8-a49c-49b1-9fc0-2b19e2a61c27" returned: 0 in 0.667s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:46 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-869e7036-1ecb-4eb9-9265-96eb8e72a84a tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] Lock "cinder-quobyte-41919ab8-a49c-49b1-9fc0-2b19e2a61c27" released by "delete_volume" :: held 1.489s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:50:46 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-869e7036-1ecb-4eb9-9265-96eb8e72a84a tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] Created reservations ['18599264-2647-4259-aaf8-8c316a8671f2', 'be9141b1-754c-4633-bc7d-3458261654ac', 'ec12a17a-8981-4789-9ad0-ddb2b5aad42b', 'e1b7ed66-1377-4a5b-be22-d013e2a2bcd8'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:50:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-869e7036-1ecb-4eb9-9265-96eb8e72a84a tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:50:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-869e7036-1ecb-4eb9-9265-96eb8e72a84a tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:50:46 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-869e7036-1ecb-4eb9-9265-96eb8e72a84a tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:50:46 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-869e7036-1ecb-4eb9-9265-96eb8e72a84a tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:50:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-869e7036-1ecb-4eb9-9265-96eb8e72a84a tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:50:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-869e7036-1ecb-4eb9-9265-96eb8e72a84a tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:46 devstack sudo[100143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:50:46 devstack sudo[100143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:46 devstack sudo[100143]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-869e7036-1ecb-4eb9-9265-96eb8e72a84a tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.688s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:46 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-869e7036-1ecb-4eb9-9265-96eb8e72a84a tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:50:46 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-869e7036-1ecb-4eb9-9265-96eb8e72a84a tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] Deleted volume successfully. Jul 08 18:50:46 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-869e7036-1ecb-4eb9-9265-96eb8e72a84a tempest-TestServerVolumeAttachScenarioOldVersion-1288808650 None] Lock "cinder-41919ab8-a49c-49b1-9fc0-2b19e2a61c27-delete_volume" released by "delete_volume" :: held 2.387s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:50:48 devstack cinder-volume[86873]: DEBUG oslo_service.periodic_task [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86873) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:50:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:50:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:50:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:50:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:50:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:50:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:48 devstack sudo[100152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:50:48 devstack sudo[100152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:49 devstack sudo[100152]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.898s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:49 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:50:49 devstack cinder-volume[86873]: DEBUG oslo_service.periodic_task [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running periodic task VolumeManager._thread_info {{(pid=86873) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:50:49 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] thread count: 29 {{(pid=86873) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:50:49 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] thread info: [<_MainThread(MainThread, started 138577734545536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86873) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:50:59 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:UPDATE=17,cinder:SELECT=19,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:50:59 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:SELECT=17,cinder:UPDATE=21,cinder:DELETE=3,cinder:INSERT=4 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:51:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-5597b55f-e280-4dc3-9b73-a85cb3bda532 req-b890f34e-651c-48fd-a521-94df9fb55ad1 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:51:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-5597b55f-e280-4dc3-9b73-a85cb3bda532 req-b890f34e-651c-48fd-a521-94df9fb55ad1 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:51:23 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e51ca89-b895-4898-ace5-82054fbe64ec]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:51:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-5597b55f-e280-4dc3-9b73-a85cb3bda532 req-b890f34e-651c-48fd-a521-94df9fb55ad1 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-afd023d3-ed04-4aae-a99f-7b4f76fba828 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:51:23 devstack sudo[100357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-afd023d3-ed04-4aae-a99f-7b4f76fba828 Jul 08 18:51:23 devstack sudo[100357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:51:23 devstack sudo[100357]: pam_unix(sudo:session): session closed for user root Jul 08 18:51:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-5597b55f-e280-4dc3-9b73-a85cb3bda532 req-b890f34e-651c-48fd-a521-94df9fb55ad1 tempest-TestServerVolumeAttachmentScenario-1944532969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-afd023d3-ed04-4aae-a99f-7b4f76fba828" returned: 0 in 0.856s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:51:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-5597b55f-e280-4dc3-9b73-a85cb3bda532 req-b890f34e-651c-48fd-a521-94df9fb55ad1 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.884s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:51:24 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-5597b55f-e280-4dc3-9b73-a85cb3bda532 req-b890f34e-651c-48fd-a521-94df9fb55ad1 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2', 'name': 'volume-afd023d3-ed04-4aae-a99f-7b4f76fba828', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ef5c18ff-aa9f-49ca-8164-70515dcf371e', 'enforce_multipath': True} {{(pid=86873) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 18:51:24 devstack cinder-volume[86873]: INFO cinder.volume.manager [req-5597b55f-e280-4dc3-9b73-a85cb3bda532 req-b890f34e-651c-48fd-a521-94df9fb55ad1 tempest-TestServerVolumeAttachmentScenario-1944532969 None] attachment_update completed successfully. Jul 08 18:51:29 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:51:29 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] Flow 'volume_create_manager' (443cef39-98c5-492d-b238-ad605a0b4596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:51:29 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3515602-8911-4f0b-a1c9-2c75851c76e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:51:29 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3515602-8911-4f0b-a1c9-2c75851c76e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:51:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1572563130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0888f28ffa844ec69e48f22ec266101a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:51:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:51:29Z,use_quota=True,user_id='9499d043088d4914a9758eb9cc190f3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:51:29 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1693ff5-840b-421c-adcd-1c1f8f67d80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:51:29 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1693ff5-840b-421c-adcd-1c1f8f67d80e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:51:29 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb8221b7-1608-46ba-bbe0-a8ea4eb6e9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:51:29 devstack cinder-volume[86873]: DEBUG cinder.image.glance [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] Creating Keystone auth plugin from conf {{(pid=86873) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 18:51:29 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb8221b7-1608-46ba-bbe0-a8ea4eb6e9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8', 'volume_name': 'volume-ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8', 'volume_size': 1, 'image_id': '9af8b46e-3f06-4165-9812-4f0470d72624', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9af8b46e-3f06-4165-9812-4f0470d72624', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '14269f30917742408b75240392484938', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9af8b46e-3f06-4165-9812-4f0470d72624', 'created_at': datetime.datetime(2026, 7, 8, 16, 25, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 25, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9af8b46e-3f06-4165-9812-4f0470d72624/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:51:29 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10aed276-10bd-45bc-8eca-d6a8be66f871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:51:29 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10aed276-10bd-45bc-8eca-d6a8be66f871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:51:29 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02057f41-7c4a-4bba-8cd7-05bf6ede0a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:51:29 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] Volume ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8', 'volume_size': 1, 'image_id': '9af8b46e-3f06-4165-9812-4f0470d72624', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9af8b46e-3f06-4165-9812-4f0470d72624', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '14269f30917742408b75240392484938', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9af8b46e-3f06-4165-9812-4f0470d72624', 'created_at': datetime.datetime(2026, 7, 8, 16, 25, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 25, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9af8b46e-3f06-4165-9812-4f0470d72624/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 18:51:29 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] Trying to clone ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8 from image 9af8b46e-3f06-4165-9812-4f0470d72624 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9af8b46e-3f06-4165-9812-4f0470d72624', 'metadata': {}}]). {{(pid=86873) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 18:51:29 devstack cinder-volume[86873]: DEBUG cinder.image.image_utils [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9af8b46e-3f06-4165-9812-4f0470d72624_8hklnydwdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86873) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 18:51:29 devstack cinder-volume[86873]: INFO cinder.image.image_utils [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] Image download 20.69 MB at 20.69 MB/s Jul 08 18:51:29 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc1af16-c601-4934-ac76-0d4b807a3b41]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:51:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9af8b46e-3f06-4165-9812-4f0470d72624_8hklnydwdevstack@QuobyteHD {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:51:30 devstack sudo[100746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9af8b46e-3f06-4165-9812-4f0470d72624_8hklnydwdevstack@QuobyteHD Jul 08 18:51:30 devstack sudo[100746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:51:30 devstack sudo[100746]: pam_unix(sudo:session): session closed for user root Jul 08 18:51:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9af8b46e-3f06-4165-9812-4f0470d72624_8hklnydwdevstack@QuobyteHD" returned: 0 in 0.753s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:51:30 devstack cinder-volume[86873]: DEBUG cinder.image.image_utils [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] Temporary image 9af8b46e-3f06-4165-9812-4f0470d72624 is fetched for user 9499d043088d4914a9758eb9cc190f3f. {{(pid=86873) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 18:51:30 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb1c876-4e3d-4331-8ca4-0346e8e1ee9d]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:51:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9af8b46e-3f06-4165-9812-4f0470d72624_8hklnydwdevstack@QuobyteHD {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:51:30 devstack sudo[100751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9af8b46e-3f06-4165-9812-4f0470d72624_8hklnydwdevstack@QuobyteHD Jul 08 18:51:30 devstack sudo[100751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:51:31 devstack sudo[100751]: pam_unix(sudo:session): session closed for user root Jul 08 18:51:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9af8b46e-3f06-4165-9812-4f0470d72624_8hklnydwdevstack@QuobyteHD" returned: 0 in 0.813s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:51:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:51:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:51:31 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:51:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1572563130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0888f28ffa844ec69e48f22ec266101a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:51:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:51:29Z,use_quota=True,user_id='9499d043088d4914a9758eb9cc190f3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:51:31 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] Creating volume ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:51:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:51:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:51:31 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:51:31 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:51:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:51:31 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:51:31 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:51:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:51:31 devstack sudo[100759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8 1073741824 Jul 08 18:51:31 devstack sudo[100759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:51:32 devstack sudo[100759]: pam_unix(sudo:session): session closed for user root Jul 08 18:51:32 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8 1073741824" returned: 0 in 0.862s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:51:32 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:51:32 devstack sudo[100766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8 Jul 08 18:51:32 devstack sudo[100766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:51:33 devstack sudo[100766]: pam_unix(sudo:session): session closed for user root Jul 08 18:51:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8" returned: 0 in 0.652s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:51:33 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] <== create_volume: return (1558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:51:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.561s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:51:33 devstack cinder-volume[86873]: DEBUG cinder.volume.volume_utils [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] Attempting download of 9af8b46e-3f06-4165-9812-4f0470d72624 ((None, [{'url': 'file:///opt/stack/data/glance/images/9af8b46e-3f06-4165-9812-4f0470d72624', 'metadata': {}}])) to volume ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8. {{(pid=86873) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 18:51:33 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7453142-2c3a-49d0-a6a1-4f32015fb1b4]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:51:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9af8b46e-3f06-4165-9812-4f0470d72624_e58f4cpb {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:51:33 devstack sudo[100769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9af8b46e-3f06-4165-9812-4f0470d72624_e58f4cpb Jul 08 18:51:33 devstack sudo[100769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:51:33 devstack sudo[100769]: pam_unix(sudo:session): session closed for user root Jul 08 18:51:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9af8b46e-3f06-4165-9812-4f0470d72624_e58f4cpb" returned: 0 in 0.760s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:51:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9af8b46e-3f06-4165-9812-4f0470d72624_e58f4cpb {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:51:34 devstack sudo[100773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9af8b46e-3f06-4165-9812-4f0470d72624_e58f4cpb Jul 08 18:51:34 devstack sudo[100773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:51:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-568f415d-6270-400b-8490-19157f4bd8ce req-9284dc3c-f9b8-4d6a-b715-8aa4bec771b0 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:51:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-568f415d-6270-400b-8490-19157f4bd8ce req-9284dc3c-f9b8-4d6a-b715-8aa4bec771b0 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:51:34 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[8938f8ac-24a7-4b8a-9cb5-df419a8e588e]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:51:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-568f415d-6270-400b-8490-19157f4bd8ce req-9284dc3c-f9b8-4d6a-b715-8aa4bec771b0 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3bd2ab0b-ba50-439d-b54f-cd6a9cb20556 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:51:34 devstack sudo[100783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3bd2ab0b-ba50-439d-b54f-cd6a9cb20556 Jul 08 18:51:34 devstack sudo[100783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:51:34 devstack sudo[100773]: pam_unix(sudo:session): session closed for user root Jul 08 18:51:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9af8b46e-3f06-4165-9812-4f0470d72624_e58f4cpb" returned: 1 in 0.755s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:51:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9af8b46e-3f06-4165-9812-4f0470d72624_e58f4cpb' failed. Not Retrying. {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:51:34 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7fcbac-e7f3-4333-8ec7-d2d422eb34be]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:51:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9af8b46e-3f06-4165-9812-4f0470d72624_8hklnydwdevstack@QuobyteHD {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:51:34 devstack sudo[100787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9af8b46e-3f06-4165-9812-4f0470d72624_8hklnydwdevstack@QuobyteHD Jul 08 18:51:34 devstack sudo[100787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:51:35 devstack sudo[100783]: pam_unix(sudo:session): session closed for user root Jul 08 18:51:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-568f415d-6270-400b-8490-19157f4bd8ce req-9284dc3c-f9b8-4d6a-b715-8aa4bec771b0 tempest-TestServerVolumeAttachmentScenario-1944532969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3bd2ab0b-ba50-439d-b54f-cd6a9cb20556" returned: 0 in 0.792s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:51:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-568f415d-6270-400b-8490-19157f4bd8ce req-9284dc3c-f9b8-4d6a-b715-8aa4bec771b0 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.812s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:51:35 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-568f415d-6270-400b-8490-19157f4bd8ce req-9284dc3c-f9b8-4d6a-b715-8aa4bec771b0 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2', 'name': 'volume-3bd2ab0b-ba50-439d-b54f-cd6a9cb20556', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '608246ec-501d-4039-a4b6-f9614af74e89', 'enforce_multipath': True} {{(pid=86873) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 18:51:35 devstack cinder-volume[86873]: INFO cinder.volume.manager [req-568f415d-6270-400b-8490-19157f4bd8ce req-9284dc3c-f9b8-4d6a-b715-8aa4bec771b0 tempest-TestServerVolumeAttachmentScenario-1944532969 None] attachment_update completed successfully. Jul 08 18:51:35 devstack sudo[100787]: pam_unix(sudo:session): session closed for user root Jul 08 18:51:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9af8b46e-3f06-4165-9812-4f0470d72624_8hklnydwdevstack@QuobyteHD" returned: 0 in 0.761s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:51:35 devstack cinder-volume[86873]: DEBUG cinder.image.image_utils [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] 9af8b46e-3f06-4165-9812-4f0470d72624 was qcow2, converting to raw {{(pid=86873) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 18:51:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9af8b46e-3f06-4165-9812-4f0470d72624_8hklnydwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:51:35 devstack sudo[100795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9af8b46e-3f06-4165-9812-4f0470d72624_8hklnydwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8 Jul 08 18:51:35 devstack sudo[100795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:51:37 devstack sudo[100795]: pam_unix(sudo:session): session closed for user root Jul 08 18:51:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9af8b46e-3f06-4165-9812-4f0470d72624_8hklnydwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8" returned: 0 in 1.805s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:51:37 devstack cinder-volume[86873]: DEBUG cinder.image.image_utils [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9af8b46e-3f06-4165-9812-4f0470d72624_8hklnydwdevstack@QuobyteHD, size 112.00 MB, duration 1.81 sec, destination /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8 {{(pid=86873) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:51:37 devstack cinder-volume[86873]: INFO cinder.image.image_utils [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] Converted 112.00 MB image at 61.99 MB/s Jul 08 18:51:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8 1G {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:51:37 devstack sudo[100810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8 1G Jul 08 18:51:37 devstack sudo[100810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:51:37 devstack sudo[100810]: pam_unix(sudo:session): session closed for user root Jul 08 18:51:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8 1G" returned: 0 in 0.681s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:51:37 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[617b63fc-6209-4ace-80bb-9b10a7b362ec]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:51:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:51:38 devstack sudo[100815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8 Jul 08 18:51:38 devstack sudo[100815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:51:38 devstack sudo[100815]: pam_unix(sudo:session): session closed for user root Jul 08 18:51:38 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8" returned: 0 in 0.775s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:51:38 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:51:38 devstack sudo[100819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8 Jul 08 18:51:38 devstack sudo[100819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:51:39 devstack sudo[100819]: pam_unix(sudo:session): session closed for user root Jul 08 18:51:39 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8" returned: 1 in 0.774s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:51:39 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8' failed. Not Retrying. {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:51:39 devstack cinder-volume[86873]: DEBUG cinder.volume.volume_utils [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] Downloaded image 9af8b46e-3f06-4165-9812-4f0470d72624 ((None, [{'url': 'file:///opt/stack/data/glance/images/9af8b46e-3f06-4165-9812-4f0470d72624', 'metadata': {}}])) to volume ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8 successfully. {{(pid=86873) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 18:51:39 devstack cinder-volume[86873]: DEBUG cinder.image.image_utils [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] Temporary image 9af8b46e-3f06-4165-9812-4f0470d72624 for user 9499d043088d4914a9758eb9cc190f3f is deleted. {{(pid=86873) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 18:51:39 devstack cinder-volume[86873]: DEBUG cinder.volume.volume_utils [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] Marking volume ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8 as bootable. {{(pid=86873) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 18:51:39 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] Copying metadata from image 9af8b46e-3f06-4165-9812-4f0470d72624 to ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8. {{(pid=86873) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 18:51:39 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] Creating volume glance metadata for volume ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8 backed by image 9af8b46e-3f06-4165-9812-4f0470d72624 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9af8b46e-3f06-4165-9812-4f0470d72624', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86873) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 18:51:39 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02057f41-7c4a-4bba-8cd7-05bf6ede0a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8', 'volume_size': 1, 'image_id': '9af8b46e-3f06-4165-9812-4f0470d72624', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9af8b46e-3f06-4165-9812-4f0470d72624', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '14269f30917742408b75240392484938', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9af8b46e-3f06-4165-9812-4f0470d72624', 'created_at': datetime.datetime(2026, 7, 8, 16, 25, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 25, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9af8b46e-3f06-4165-9812-4f0470d72624/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:51:39 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1da1cb5a-c688-4b2a-9ac5-3ad1550f0f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:51:39 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] Volume volume-ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8 (ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8): created successfully Jul 08 18:51:39 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1da1cb5a-c688-4b2a-9ac5-3ad1550f0f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:51:39 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] Flow 'volume_create_manager' (443cef39-98c5-492d-b238-ad605a0b4596) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:51:39 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-d86baa42-b200-407f-8d1c-f026d79088e9 tempest-TestShelveInstance-958690939 None] Created volume successfully. Jul 08 18:51:40 devstack cinder-volume[86873]: INFO cinder.volume.manager [req-af09c449-9fc2-420d-a98a-b0b7ecb67934 req-bf209a89-d969-4434-bb5e-346f3e892417 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Terminate volume connection completed successfully. Jul 08 18:51:40 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-af09c449-9fc2-420d-a98a-b0b7ecb67934 req-bf209a89-d969-4434-bb5e-346f3e892417 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Deleting attachment 608246ec-501d-4039-a4b6-f9614af74e89. {{(pid=86873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 18:51:44 devstack cinder-volume[86873]: INFO cinder.volume.manager [req-302eb415-5c0b-40c7-9b6f-f378e02748fe req-646c02a3-1bf8-4c7f-a03a-3f8f0eaec02e tempest-TestServerVolumeAttachmentScenario-1944532969 None] Terminate volume connection completed successfully. Jul 08 18:51:44 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-302eb415-5c0b-40c7-9b6f-f378e02748fe req-646c02a3-1bf8-4c7f-a03a-3f8f0eaec02e tempest-TestServerVolumeAttachmentScenario-1944532969 None] Deleting attachment ef5c18ff-aa9f-49ca-8164-70515dcf371e. {{(pid=86873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 18:51:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-c92f5fb6-e701-4a6a-9fde-db5fd533df9b req-498f205e-2fb9-4f94-b2b7-43fd9a58f3e4 tempest-TestShelveInstance-958690939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:51:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-c92f5fb6-e701-4a6a-9fde-db5fd533df9b req-498f205e-2fb9-4f94-b2b7-43fd9a58f3e4 tempest-TestShelveInstance-958690939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:51:47 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f067ccb-946b-45b9-9468-c27f76efbe67]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:51:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-c92f5fb6-e701-4a6a-9fde-db5fd533df9b req-498f205e-2fb9-4f94-b2b7-43fd9a58f3e4 tempest-TestShelveInstance-958690939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:51:48 devstack sudo[100866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8 Jul 08 18:51:48 devstack sudo[100866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:51:48 devstack cinder-volume[86873]: DEBUG oslo_service.periodic_task [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86873) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:51:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:51:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:51:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:51:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:51:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:51:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:51:48 devstack sudo[100873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:51:48 devstack sudo[100873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:51:48 devstack sudo[100866]: pam_unix(sudo:session): session closed for user root Jul 08 18:51:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-c92f5fb6-e701-4a6a-9fde-db5fd533df9b req-498f205e-2fb9-4f94-b2b7-43fd9a58f3e4 tempest-TestShelveInstance-958690939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8" returned: 0 in 0.951s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:51:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-c92f5fb6-e701-4a6a-9fde-db5fd533df9b req-498f205e-2fb9-4f94-b2b7-43fd9a58f3e4 tempest-TestShelveInstance-958690939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:51:48 devstack sudo[100891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8 Jul 08 18:51:48 devstack sudo[100891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:51:49 devstack sudo[100873]: pam_unix(sudo:session): session closed for user root Jul 08 18:51:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.949s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:51:49 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:51:49 devstack cinder-volume[86873]: DEBUG oslo_service.periodic_task [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running periodic task VolumeManager._thread_info {{(pid=86873) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:51:49 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] thread count: 29 {{(pid=86873) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:51:49 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] thread info: [<_MainThread(MainThread, started 138577734545536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86873) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:51:49 devstack sudo[100891]: pam_unix(sudo:session): session closed for user root Jul 08 18:51:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-c92f5fb6-e701-4a6a-9fde-db5fd533df9b req-498f205e-2fb9-4f94-b2b7-43fd9a58f3e4 tempest-TestShelveInstance-958690939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8" returned: 1 in 0.938s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:51:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-c92f5fb6-e701-4a6a-9fde-db5fd533df9b req-498f205e-2fb9-4f94-b2b7-43fd9a58f3e4 tempest-TestShelveInstance-958690939 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8' failed. Not Retrying. {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:51:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-c92f5fb6-e701-4a6a-9fde-db5fd533df9b req-498f205e-2fb9-4f94-b2b7-43fd9a58f3e4 tempest-TestShelveInstance-958690939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.928s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:51:49 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-c92f5fb6-e701-4a6a-9fde-db5fd533df9b req-498f205e-2fb9-4f94-b2b7-43fd9a58f3e4 tempest-TestShelveInstance-958690939 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2', 'name': 'volume-ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3f1a6df7-20e2-416e-a07e-058b27595a51', 'enforce_multipath': True} {{(pid=86873) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 18:51:49 devstack cinder-volume[86873]: INFO cinder.volume.manager [req-c92f5fb6-e701-4a6a-9fde-db5fd533df9b req-498f205e-2fb9-4f94-b2b7-43fd9a58f3e4 tempest-TestShelveInstance-958690939 None] attachment_update completed successfully. Jul 08 18:51:54 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-72310663-980c-4dee-a06b-c1b2ece51167 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Acquiring lock "cinder-3bd2ab0b-ba50-439d-b54f-cd6a9cb20556-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:51:55 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-72310663-980c-4dee-a06b-c1b2ece51167 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Lock "cinder-3bd2ab0b-ba50-439d-b54f-cd6a9cb20556-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:51:55 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-72310663-980c-4dee-a06b-c1b2ece51167 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Acquiring lock "cinder-quobyte-3bd2ab0b-ba50-439d-b54f-cd6a9cb20556" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:51:55 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-72310663-980c-4dee-a06b-c1b2ece51167 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Lock "cinder-quobyte-3bd2ab0b-ba50-439d-b54f-cd6a9cb20556" acquired by "delete_volume" :: waited 0.026s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:51:55 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f46966-7089-435b-9f82-5bfb7e6a5b2a]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:51:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-72310663-980c-4dee-a06b-c1b2ece51167 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3bd2ab0b-ba50-439d-b54f-cd6a9cb20556 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:51:55 devstack sudo[101024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3bd2ab0b-ba50-439d-b54f-cd6a9cb20556 Jul 08 18:51:55 devstack sudo[101024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:51:55 devstack sudo[101024]: pam_unix(sudo:session): session closed for user root Jul 08 18:51:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-72310663-980c-4dee-a06b-c1b2ece51167 tempest-TestServerVolumeAttachmentScenario-1944532969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3bd2ab0b-ba50-439d-b54f-cd6a9cb20556" returned: 0 in 0.807s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:51:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-72310663-980c-4dee-a06b-c1b2ece51167 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3bd2ab0b-ba50-439d-b54f-cd6a9cb20556 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:51:55 devstack sudo[101351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3bd2ab0b-ba50-439d-b54f-cd6a9cb20556 Jul 08 18:51:55 devstack sudo[101351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:51:56 devstack sudo[101351]: pam_unix(sudo:session): session closed for user root Jul 08 18:51:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-72310663-980c-4dee-a06b-c1b2ece51167 tempest-TestServerVolumeAttachmentScenario-1944532969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-3bd2ab0b-ba50-439d-b54f-cd6a9cb20556" returned: 0 in 0.690s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:51:56 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-72310663-980c-4dee-a06b-c1b2ece51167 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Lock "cinder-quobyte-3bd2ab0b-ba50-439d-b54f-cd6a9cb20556" released by "delete_volume" :: held 1.560s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:51:56 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-72310663-980c-4dee-a06b-c1b2ece51167 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Created reservations ['0c928d5c-85c8-466a-aae0-0297418e72cd', '76035f52-547f-44bd-a886-5761bd038515', '67cf6309-e5b5-49d8-afe1-01945bfd9b8e', 'f16cd903-4657-4070-9b03-ed52a9f81f07'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:51:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-72310663-980c-4dee-a06b-c1b2ece51167 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:51:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-72310663-980c-4dee-a06b-c1b2ece51167 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:51:56 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-72310663-980c-4dee-a06b-c1b2ece51167 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:51:56 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-72310663-980c-4dee-a06b-c1b2ece51167 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:51:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-72310663-980c-4dee-a06b-c1b2ece51167 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:51:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-72310663-980c-4dee-a06b-c1b2ece51167 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:51:56 devstack sudo[101356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:51:56 devstack sudo[101356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:51:57 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-002a47c2-3df0-4009-8885-00bc754a0912 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Acquiring lock "cinder-afd023d3-ed04-4aae-a99f-7b4f76fba828-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:51:57 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-002a47c2-3df0-4009-8885-00bc754a0912 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Lock "cinder-afd023d3-ed04-4aae-a99f-7b4f76fba828-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:51:57 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-002a47c2-3df0-4009-8885-00bc754a0912 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Acquiring lock "cinder-quobyte-afd023d3-ed04-4aae-a99f-7b4f76fba828" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:51:57 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-002a47c2-3df0-4009-8885-00bc754a0912 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Lock "cinder-quobyte-afd023d3-ed04-4aae-a99f-7b4f76fba828" acquired by "delete_volume" :: waited 0.018s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:51:57 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[626ca919-dca7-4ec4-835c-fc8dfce50eb7]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:51:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-002a47c2-3df0-4009-8885-00bc754a0912 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-afd023d3-ed04-4aae-a99f-7b4f76fba828 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:51:57 devstack sudo[101356]: pam_unix(sudo:session): session closed for user root Jul 08 18:51:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-72310663-980c-4dee-a06b-c1b2ece51167 tempest-TestServerVolumeAttachmentScenario-1944532969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.814s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:51:57 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-72310663-980c-4dee-a06b-c1b2ece51167 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:51:57 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-72310663-980c-4dee-a06b-c1b2ece51167 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Deleted volume successfully. Jul 08 18:51:57 devstack sudo[101359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-afd023d3-ed04-4aae-a99f-7b4f76fba828 Jul 08 18:51:57 devstack sudo[101359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:51:57 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-72310663-980c-4dee-a06b-c1b2ece51167 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Lock "cinder-3bd2ab0b-ba50-439d-b54f-cd6a9cb20556-delete_volume" released by "delete_volume" :: held 2.633s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:51:58 devstack sudo[101359]: pam_unix(sudo:session): session closed for user root Jul 08 18:51:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-002a47c2-3df0-4009-8885-00bc754a0912 tempest-TestServerVolumeAttachmentScenario-1944532969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-afd023d3-ed04-4aae-a99f-7b4f76fba828" returned: 0 in 0.943s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:51:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-002a47c2-3df0-4009-8885-00bc754a0912 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-afd023d3-ed04-4aae-a99f-7b4f76fba828 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:51:58 devstack sudo[101364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-afd023d3-ed04-4aae-a99f-7b4f76fba828 Jul 08 18:51:58 devstack sudo[101364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:51:59 devstack sudo[101364]: pam_unix(sudo:session): session closed for user root Jul 08 18:51:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-002a47c2-3df0-4009-8885-00bc754a0912 tempest-TestServerVolumeAttachmentScenario-1944532969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-afd023d3-ed04-4aae-a99f-7b4f76fba828" returned: 0 in 0.741s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:51:59 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-002a47c2-3df0-4009-8885-00bc754a0912 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Lock "cinder-quobyte-afd023d3-ed04-4aae-a99f-7b4f76fba828" released by "delete_volume" :: held 1.735s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:51:59 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-002a47c2-3df0-4009-8885-00bc754a0912 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Created reservations ['7cc7ab42-b4a8-4984-bf8b-4709c5cc124f', '9f894f51-adf9-416b-a23b-064d2f0b944f', '02668f67-c6af-44c3-b48e-c014faf80264', '00b24560-cdff-4263-b0fc-f8d58efa4e07'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:51:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-002a47c2-3df0-4009-8885-00bc754a0912 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:51:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-002a47c2-3df0-4009-8885-00bc754a0912 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:51:59 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-002a47c2-3df0-4009-8885-00bc754a0912 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:51:59 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-002a47c2-3df0-4009-8885-00bc754a0912 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:51:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-002a47c2-3df0-4009-8885-00bc754a0912 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:51:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-002a47c2-3df0-4009-8885-00bc754a0912 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:51:59 devstack sudo[101367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:51:59 devstack sudo[101367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:52:00 devstack sudo[101367]: pam_unix(sudo:session): session closed for user root Jul 08 18:52:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-002a47c2-3df0-4009-8885-00bc754a0912 tempest-TestServerVolumeAttachmentScenario-1944532969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.953s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:52:00 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-002a47c2-3df0-4009-8885-00bc754a0912 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:52:00 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-002a47c2-3df0-4009-8885-00bc754a0912 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Deleted volume successfully. Jul 08 18:52:00 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-002a47c2-3df0-4009-8885-00bc754a0912 tempest-TestServerVolumeAttachmentScenario-1944532969 None] Lock "cinder-afd023d3-ed04-4aae-a99f-7b4f76fba828-delete_volume" released by "delete_volume" :: held 2.954s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:52:09 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:SELECT=34,cinder:UPDATE=25,cinder:INSERT=13,cinder:DELETE=1 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:52:10 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:SELECT=42,cinder:UPDATE=25,cinder:INSERT=9,cinder:DELETE=2 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:52:28 devstack cinder-volume[86873]: INFO cinder.volume.manager [req-58c6359a-def7-4233-9dab-fc0c6ea7db63 req-b696b662-c46f-4e38-8dff-d4dd645a212e tempest-TestShelveInstance-958690939 None] Terminate volume connection completed successfully. Jul 08 18:52:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-58c6359a-def7-4233-9dab-fc0c6ea7db63 req-b696b662-c46f-4e38-8dff-d4dd645a212e tempest-TestShelveInstance-958690939 None] Deleting attachment 3f1a6df7-20e2-416e-a07e-058b27595a51. {{(pid=86873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 18:52:33 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-405ba7b8-5eac-47b4-8c49-33750b6d93bf tempest-TestStampPattern-552338204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:52:33 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-405ba7b8-5eac-47b4-8c49-33750b6d93bf tempest-TestStampPattern-552338204 None] Flow 'volume_create_manager' (79e5d290-64df-4951-9906-2258d429a31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:52:33 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-405ba7b8-5eac-47b4-8c49-33750b6d93bf tempest-TestStampPattern-552338204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcb1327b-a886-4f4b-a450-c1ff108c4086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:52:33 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-405ba7b8-5eac-47b4-8c49-33750b6d93bf tempest-TestStampPattern-552338204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcb1327b-a886-4f4b-a450-c1ff108c4086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:52:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2113672283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b4e9e68-62e7-443c-b629-b793ce31e961,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c22dc8bca8404502a44c381f7571c5ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:52:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:52:33Z,use_quota=True,user_id='b589a373a4394beea7326ecf1c932728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:52:33 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-405ba7b8-5eac-47b4-8c49-33750b6d93bf tempest-TestStampPattern-552338204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88aa6e92-c719-46ef-8514-d27d34d2e68c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:52:33 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-405ba7b8-5eac-47b4-8c49-33750b6d93bf tempest-TestStampPattern-552338204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88aa6e92-c719-46ef-8514-d27d34d2e68c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:52:33 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-405ba7b8-5eac-47b4-8c49-33750b6d93bf tempest-TestStampPattern-552338204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34c8fc57-72f9-4d86-b289-d7cef5d98a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:52:33 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-405ba7b8-5eac-47b4-8c49-33750b6d93bf tempest-TestStampPattern-552338204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34c8fc57-72f9-4d86-b289-d7cef5d98a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b4e9e68-62e7-443c-b629-b793ce31e961', 'volume_name': 'volume-9b4e9e68-62e7-443c-b629-b793ce31e961', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:52:33 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-405ba7b8-5eac-47b4-8c49-33750b6d93bf tempest-TestStampPattern-552338204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac74dba6-d0e5-4fea-a980-0f5a2ca37368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:52:33 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-405ba7b8-5eac-47b4-8c49-33750b6d93bf tempest-TestStampPattern-552338204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac74dba6-d0e5-4fea-a980-0f5a2ca37368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:52:33 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-405ba7b8-5eac-47b4-8c49-33750b6d93bf tempest-TestStampPattern-552338204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8669e15b-368e-44de-a019-cfe7f947429e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:52:33 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-405ba7b8-5eac-47b4-8c49-33750b6d93bf tempest-TestStampPattern-552338204 None] Volume 9b4e9e68-62e7-443c-b629-b793ce31e961: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b4e9e68-62e7-443c-b629-b793ce31e961', 'volume_size': 1} Jul 08 18:52:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-405ba7b8-5eac-47b4-8c49-33750b6d93bf tempest-TestStampPattern-552338204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:52:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-405ba7b8-5eac-47b4-8c49-33750b6d93bf tempest-TestStampPattern-552338204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:52:33 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-405ba7b8-5eac-47b4-8c49-33750b6d93bf tempest-TestStampPattern-552338204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:52:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2113672283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b4e9e68-62e7-443c-b629-b793ce31e961,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c22dc8bca8404502a44c381f7571c5ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:52:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:52:33Z,use_quota=True,user_id='b589a373a4394beea7326ecf1c932728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:52:33 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-405ba7b8-5eac-47b4-8c49-33750b6d93bf tempest-TestStampPattern-552338204 None] Creating volume 9b4e9e68-62e7-443c-b629-b793ce31e961 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:52:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-405ba7b8-5eac-47b4-8c49-33750b6d93bf tempest-TestStampPattern-552338204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:52:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-405ba7b8-5eac-47b4-8c49-33750b6d93bf tempest-TestStampPattern-552338204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:52:33 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-405ba7b8-5eac-47b4-8c49-33750b6d93bf tempest-TestStampPattern-552338204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:52:33 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-405ba7b8-5eac-47b4-8c49-33750b6d93bf tempest-TestStampPattern-552338204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:52:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-405ba7b8-5eac-47b4-8c49-33750b6d93bf tempest-TestStampPattern-552338204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:52:33 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-405ba7b8-5eac-47b4-8c49-33750b6d93bf tempest-TestStampPattern-552338204 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:52:33 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-405ba7b8-5eac-47b4-8c49-33750b6d93bf tempest-TestStampPattern-552338204 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:52:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-405ba7b8-5eac-47b4-8c49-33750b6d93bf tempest-TestStampPattern-552338204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:52:33 devstack sudo[101565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961 1073741824 Jul 08 18:52:33 devstack sudo[101565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:52:34 devstack sudo[101565]: pam_unix(sudo:session): session closed for user root Jul 08 18:52:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-405ba7b8-5eac-47b4-8c49-33750b6d93bf tempest-TestStampPattern-552338204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961 1073741824" returned: 0 in 0.894s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:52:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-405ba7b8-5eac-47b4-8c49-33750b6d93bf tempest-TestStampPattern-552338204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:52:34 devstack sudo[101574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961 Jul 08 18:52:34 devstack sudo[101574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:52:34 devstack sudo[101574]: pam_unix(sudo:session): session closed for user root Jul 08 18:52:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-405ba7b8-5eac-47b4-8c49-33750b6d93bf tempest-TestStampPattern-552338204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961" returned: 0 in 0.644s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:52:34 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-405ba7b8-5eac-47b4-8c49-33750b6d93bf tempest-TestStampPattern-552338204 None] <== create_volume: return (1576ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:52:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-405ba7b8-5eac-47b4-8c49-33750b6d93bf tempest-TestStampPattern-552338204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.579s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:52:34 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-405ba7b8-5eac-47b4-8c49-33750b6d93bf tempest-TestStampPattern-552338204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8669e15b-368e-44de-a019-cfe7f947429e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b4e9e68-62e7-443c-b629-b793ce31e961', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:52:34 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-405ba7b8-5eac-47b4-8c49-33750b6d93bf tempest-TestStampPattern-552338204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (032a0cf8-3b0f-4903-bc85-f4378bdacc05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:52:34 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-405ba7b8-5eac-47b4-8c49-33750b6d93bf tempest-TestStampPattern-552338204 None] Volume volume-9b4e9e68-62e7-443c-b629-b793ce31e961 (9b4e9e68-62e7-443c-b629-b793ce31e961): created successfully Jul 08 18:52:34 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-405ba7b8-5eac-47b4-8c49-33750b6d93bf tempest-TestStampPattern-552338204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (032a0cf8-3b0f-4903-bc85-f4378bdacc05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:52:34 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-405ba7b8-5eac-47b4-8c49-33750b6d93bf tempest-TestStampPattern-552338204 None] Flow 'volume_create_manager' (79e5d290-64df-4951-9906-2258d429a31d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:52:34 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-405ba7b8-5eac-47b4-8c49-33750b6d93bf tempest-TestStampPattern-552338204 None] Created volume successfully. Jul 08 18:52:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-47da15c4-0789-4854-9b7d-6ae263e1f5ac req-fbf73a18-60e6-46f5-982e-71a672f43f41 tempest-TestShelveInstance-958690939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:52:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-47da15c4-0789-4854-9b7d-6ae263e1f5ac req-fbf73a18-60e6-46f5-982e-71a672f43f41 tempest-TestShelveInstance-958690939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:52:35 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ba4952-d494-454f-ae4c-2b2a731637e3]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:52:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-47da15c4-0789-4854-9b7d-6ae263e1f5ac req-fbf73a18-60e6-46f5-982e-71a672f43f41 tempest-TestShelveInstance-958690939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:52:35 devstack sudo[101585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8 Jul 08 18:52:35 devstack sudo[101585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:52:36 devstack sudo[101585]: pam_unix(sudo:session): session closed for user root Jul 08 18:52:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-47da15c4-0789-4854-9b7d-6ae263e1f5ac req-fbf73a18-60e6-46f5-982e-71a672f43f41 tempest-TestShelveInstance-958690939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8" returned: 0 in 0.743s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:52:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-47da15c4-0789-4854-9b7d-6ae263e1f5ac req-fbf73a18-60e6-46f5-982e-71a672f43f41 tempest-TestShelveInstance-958690939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:52:36 devstack sudo[101589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8 Jul 08 18:52:36 devstack sudo[101589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:52:37 devstack sudo[101589]: pam_unix(sudo:session): session closed for user root Jul 08 18:52:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-47da15c4-0789-4854-9b7d-6ae263e1f5ac req-fbf73a18-60e6-46f5-982e-71a672f43f41 tempest-TestShelveInstance-958690939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8" returned: 1 in 0.765s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:52:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-47da15c4-0789-4854-9b7d-6ae263e1f5ac req-fbf73a18-60e6-46f5-982e-71a672f43f41 tempest-TestShelveInstance-958690939 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8' failed. Not Retrying. {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:52:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-47da15c4-0789-4854-9b7d-6ae263e1f5ac req-fbf73a18-60e6-46f5-982e-71a672f43f41 tempest-TestShelveInstance-958690939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.545s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:52:37 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-47da15c4-0789-4854-9b7d-6ae263e1f5ac req-fbf73a18-60e6-46f5-982e-71a672f43f41 tempest-TestShelveInstance-958690939 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2', 'name': 'volume-ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fef84a53-f3bc-4e52-8db8-974b739f53ab', 'enforce_multipath': True} {{(pid=86873) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 18:52:37 devstack cinder-volume[86873]: INFO cinder.volume.manager [req-47da15c4-0789-4854-9b7d-6ae263e1f5ac req-fbf73a18-60e6-46f5-982e-71a672f43f41 tempest-TestShelveInstance-958690939 None] attachment_update completed successfully. Jul 08 18:52:47 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:SELECT=10,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:52:47 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:52:48 devstack cinder-volume[86873]: DEBUG oslo_service.periodic_task [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86873) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:52:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:52:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:52:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:52:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:52:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:52:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:52:48 devstack sudo[102115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:52:48 devstack sudo[102115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:52:48 devstack sudo[102115]: pam_unix(sudo:session): session closed for user root Jul 08 18:52:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.723s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:52:48 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:52:48 devstack cinder-volume[86873]: DEBUG oslo_service.periodic_task [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running periodic task VolumeManager._thread_info {{(pid=86873) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:52:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] thread count: 29 {{(pid=86873) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:52:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] thread info: [<_MainThread(MainThread, started 138577734545536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86873) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:52:59 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:53:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-8248aec8-bbec-4493-b5cc-0f87c329dadb req-e8b3cf7b-7e02-4440-9b4d-c8a0c0dba009 tempest-TestStampPattern-552338204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:53:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-8248aec8-bbec-4493-b5cc-0f87c329dadb req-e8b3cf7b-7e02-4440-9b4d-c8a0c0dba009 tempest-TestStampPattern-552338204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:53:14 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[211b0334-05c7-457f-8abb-f20c19230bec]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:53:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-8248aec8-bbec-4493-b5cc-0f87c329dadb req-e8b3cf7b-7e02-4440-9b4d-c8a0c0dba009 tempest-TestStampPattern-552338204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:53:14 devstack sudo[102238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961 Jul 08 18:53:14 devstack sudo[102238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:53:15 devstack sudo[102238]: pam_unix(sudo:session): session closed for user root Jul 08 18:53:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-8248aec8-bbec-4493-b5cc-0f87c329dadb req-e8b3cf7b-7e02-4440-9b4d-c8a0c0dba009 tempest-TestStampPattern-552338204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961" returned: 0 in 0.790s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:53:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-8248aec8-bbec-4493-b5cc-0f87c329dadb req-e8b3cf7b-7e02-4440-9b4d-c8a0c0dba009 tempest-TestStampPattern-552338204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.807s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:53:15 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-8248aec8-bbec-4493-b5cc-0f87c329dadb req-e8b3cf7b-7e02-4440-9b4d-c8a0c0dba009 tempest-TestStampPattern-552338204 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2', 'name': 'volume-9b4e9e68-62e7-443c-b629-b793ce31e961', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '20c0dc90-9f0e-4290-88fe-091bc19730bb', 'enforce_multipath': True} {{(pid=86873) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 18:53:15 devstack cinder-volume[86873]: INFO cinder.volume.manager [req-8248aec8-bbec-4493-b5cc-0f87c329dadb req-e8b3cf7b-7e02-4440-9b4d-c8a0c0dba009 tempest-TestStampPattern-552338204 None] attachment_update completed successfully. Jul 08 18:53:23 devstack cinder-volume[86873]: INFO cinder.volume.manager [req-cc3b12e0-a3a9-4bb6-9ae6-a27a986d7ca0 req-55d5f222-2547-4baa-8553-cd310b8ecaf9 tempest-TestStampPattern-552338204 None] Terminate volume connection completed successfully. Jul 08 18:53:23 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-cc3b12e0-a3a9-4bb6-9ae6-a27a986d7ca0 req-55d5f222-2547-4baa-8553-cd310b8ecaf9 tempest-TestStampPattern-552338204 None] Deleting attachment 20c0dc90-9f0e-4290-88fe-091bc19730bb. {{(pid=86873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 18:53:25 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:53:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-73ed07b8-79a7-4de2-8306-9d8ef4a1eef6 tempest-TestStampPattern-552338204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:53:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-73ed07b8-79a7-4de2-8306-9d8ef4a1eef6 tempest-TestStampPattern-552338204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:53:25 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-73ed07b8-79a7-4de2-8306-9d8ef4a1eef6 tempest-TestStampPattern-552338204 None] Creating offline snapshot 9cfc8506-986e-4340-b40e-05612ae4a12a of volume 9b4e9e68-62e7-443c-b629-b793ce31e961 {{(pid=86873) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:53:25 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c98cd1e-7ead-4aee-865b-3c64152375e3]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:53:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-73ed07b8-79a7-4de2-8306-9d8ef4a1eef6 tempest-TestStampPattern-552338204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:53:26 devstack sudo[102275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961 Jul 08 18:53:26 devstack sudo[102275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:53:26 devstack sudo[102275]: pam_unix(sudo:session): session closed for user root Jul 08 18:53:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-73ed07b8-79a7-4de2-8306-9d8ef4a1eef6 tempest-TestStampPattern-552338204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961" returned: 0 in 0.826s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:53:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-73ed07b8-79a7-4de2-8306-9d8ef4a1eef6 tempest-TestStampPattern-552338204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961.9cfc8506-986e-4340-b40e-05612ae4a12a 1G {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:53:26 devstack sudo[102280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961.9cfc8506-986e-4340-b40e-05612ae4a12a 1G Jul 08 18:53:26 devstack sudo[102280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:53:27 devstack sudo[102280]: pam_unix(sudo:session): session closed for user root Jul 08 18:53:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-73ed07b8-79a7-4de2-8306-9d8ef4a1eef6 tempest-TestStampPattern-552338204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961.9cfc8506-986e-4340-b40e-05612ae4a12a 1G" returned: 0 in 0.855s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:53:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-73ed07b8-79a7-4de2-8306-9d8ef4a1eef6 tempest-TestStampPattern-552338204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b4e9e68-62e7-443c-b629-b793ce31e961 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961.9cfc8506-986e-4340-b40e-05612ae4a12a {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:53:27 devstack sudo[102290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b4e9e68-62e7-443c-b629-b793ce31e961 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961.9cfc8506-986e-4340-b40e-05612ae4a12a Jul 08 18:53:27 devstack sudo[102290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:53:28 devstack sudo[102290]: pam_unix(sudo:session): session closed for user root Jul 08 18:53:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-73ed07b8-79a7-4de2-8306-9d8ef4a1eef6 tempest-TestStampPattern-552338204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b4e9e68-62e7-443c-b629-b793ce31e961 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961.9cfc8506-986e-4340-b40e-05612ae4a12a" returned: 0 in 0.769s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:53:28 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-73ed07b8-79a7-4de2-8306-9d8ef4a1eef6 tempest-TestStampPattern-552338204 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961.9cfc8506-986e-4340-b40e-05612ae4a12a is being set with open permissions: ugo+rw Jul 08 18:53:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-73ed07b8-79a7-4de2-8306-9d8ef4a1eef6 tempest-TestStampPattern-552338204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961.9cfc8506-986e-4340-b40e-05612ae4a12a {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:53:28 devstack sudo[102298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961.9cfc8506-986e-4340-b40e-05612ae4a12a Jul 08 18:53:28 devstack sudo[102298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:53:29 devstack sudo[102298]: pam_unix(sudo:session): session closed for user root Jul 08 18:53:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-73ed07b8-79a7-4de2-8306-9d8ef4a1eef6 tempest-TestStampPattern-552338204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961.9cfc8506-986e-4340-b40e-05612ae4a12a" returned: 0 in 0.690s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:53:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-73ed07b8-79a7-4de2-8306-9d8ef4a1eef6 tempest-TestStampPattern-552338204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:53:29 devstack sudo[102302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961.info Jul 08 18:53:29 devstack sudo[102302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:53:29 devstack sudo[102302]: pam_unix(sudo:session): session closed for user root Jul 08 18:53:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-73ed07b8-79a7-4de2-8306-9d8ef4a1eef6 tempest-TestStampPattern-552338204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961.info" returned: 0 in 0.672s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:53:29 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-73ed07b8-79a7-4de2-8306-9d8ef4a1eef6 tempest-TestStampPattern-552338204 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961.info is being set with open permissions: ugo+rw Jul 08 18:53:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-73ed07b8-79a7-4de2-8306-9d8ef4a1eef6 tempest-TestStampPattern-552338204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:53:29 devstack sudo[102308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961.info Jul 08 18:53:29 devstack sudo[102308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:53:30 devstack sudo[102308]: pam_unix(sudo:session): session closed for user root Jul 08 18:53:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-73ed07b8-79a7-4de2-8306-9d8ef4a1eef6 tempest-TestStampPattern-552338204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961.info" returned: 0 in 0.837s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:53:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-73ed07b8-79a7-4de2-8306-9d8ef4a1eef6 tempest-TestStampPattern-552338204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.759s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:53:30 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-73ed07b8-79a7-4de2-8306-9d8ef4a1eef6 tempest-TestStampPattern-552338204 None] Create snapshot completed successfully Jul 08 18:53:32 devstack cinder-volume[86873]: INFO cinder.volume.manager [req-5d3f9d3f-462c-4a43-b3b1-e741b4c6d20c req-a01600a8-a7c8-41c6-a3da-60927112bd8b tempest-TestShelveInstance-958690939 None] Terminate volume connection completed successfully. Jul 08 18:53:32 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-5d3f9d3f-462c-4a43-b3b1-e741b4c6d20c req-a01600a8-a7c8-41c6-a3da-60927112bd8b tempest-TestShelveInstance-958690939 None] Deleting attachment fef84a53-f3bc-4e52-8db8-974b739f53ab. {{(pid=86873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 18:53:32 devstack cinder-volume[86873]: DEBUG cinder.coordination [req-5d3f9d3f-462c-4a43-b3b1-e741b4c6d20c req-110280bb-39cf-427d-a656-0579d04a95dc tempest-TestShelveInstance-958690939 None] Acquiring lock "cinder-ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:53:32 devstack cinder-volume[86873]: DEBUG cinder.coordination [req-5d3f9d3f-462c-4a43-b3b1-e741b4c6d20c req-110280bb-39cf-427d-a656-0579d04a95dc tempest-TestShelveInstance-958690939 None] Lock "cinder-ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:53:32 devstack cinder-volume[86873]: DEBUG cinder.coordination [req-5d3f9d3f-462c-4a43-b3b1-e741b4c6d20c req-110280bb-39cf-427d-a656-0579d04a95dc tempest-TestShelveInstance-958690939 None] Acquiring lock "cinder-quobyte-ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:53:32 devstack cinder-volume[86873]: DEBUG cinder.coordination [req-5d3f9d3f-462c-4a43-b3b1-e741b4c6d20c req-110280bb-39cf-427d-a656-0579d04a95dc tempest-TestShelveInstance-958690939 None] Lock "cinder-quobyte-ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8" acquired by "delete_volume" :: waited 0.015s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:53:32 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[2581425c-da22-429d-8289-e7a324ae0958]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:53:32 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-5d3f9d3f-462c-4a43-b3b1-e741b4c6d20c req-110280bb-39cf-427d-a656-0579d04a95dc tempest-TestShelveInstance-958690939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:53:32 devstack sudo[102331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8 Jul 08 18:53:32 devstack sudo[102331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:53:33 devstack sudo[102331]: pam_unix(sudo:session): session closed for user root Jul 08 18:53:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-5d3f9d3f-462c-4a43-b3b1-e741b4c6d20c req-110280bb-39cf-427d-a656-0579d04a95dc tempest-TestShelveInstance-958690939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8" returned: 0 in 0.774s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:53:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-5d3f9d3f-462c-4a43-b3b1-e741b4c6d20c req-110280bb-39cf-427d-a656-0579d04a95dc tempest-TestShelveInstance-958690939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:53:33 devstack sudo[102335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8 Jul 08 18:53:33 devstack sudo[102335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:53:34 devstack sudo[102335]: pam_unix(sudo:session): session closed for user root Jul 08 18:53:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-5d3f9d3f-462c-4a43-b3b1-e741b4c6d20c req-110280bb-39cf-427d-a656-0579d04a95dc tempest-TestShelveInstance-958690939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8" returned: 1 in 0.768s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:53:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-5d3f9d3f-462c-4a43-b3b1-e741b4c6d20c req-110280bb-39cf-427d-a656-0579d04a95dc tempest-TestShelveInstance-958690939 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8' failed. Not Retrying. {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:53:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-5d3f9d3f-462c-4a43-b3b1-e741b4c6d20c req-110280bb-39cf-427d-a656-0579d04a95dc tempest-TestShelveInstance-958690939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:53:34 devstack sudo[102340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8 Jul 08 18:53:34 devstack sudo[102340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:53:34 devstack sudo[102340]: pam_unix(sudo:session): session closed for user root Jul 08 18:53:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-5d3f9d3f-462c-4a43-b3b1-e741b4c6d20c req-110280bb-39cf-427d-a656-0579d04a95dc tempest-TestShelveInstance-958690939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8" returned: 0 in 0.648s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:53:34 devstack cinder-volume[86873]: DEBUG cinder.coordination [req-5d3f9d3f-462c-4a43-b3b1-e741b4c6d20c req-110280bb-39cf-427d-a656-0579d04a95dc tempest-TestShelveInstance-958690939 None] Lock "cinder-quobyte-ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8" released by "delete_volume" :: held 2.251s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:53:35 devstack cinder-volume[86873]: DEBUG cinder.quota [req-5d3f9d3f-462c-4a43-b3b1-e741b4c6d20c req-110280bb-39cf-427d-a656-0579d04a95dc tempest-TestShelveInstance-958690939 None] Created reservations ['ad536f36-11af-4ce5-8385-071f6ed3d190', '85734b1c-e470-479d-a843-d812668ddf38', '04216e6a-9075-4807-8606-6389ae2dc51a', 'ac50d61d-2da5-4d7e-ad86-e0d7d71b04c2'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:53:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-5d3f9d3f-462c-4a43-b3b1-e741b4c6d20c req-110280bb-39cf-427d-a656-0579d04a95dc tempest-TestShelveInstance-958690939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:53:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-5d3f9d3f-462c-4a43-b3b1-e741b4c6d20c req-110280bb-39cf-427d-a656-0579d04a95dc tempest-TestShelveInstance-958690939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:53:35 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [req-5d3f9d3f-462c-4a43-b3b1-e741b4c6d20c req-110280bb-39cf-427d-a656-0579d04a95dc tempest-TestShelveInstance-958690939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:53:35 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [req-5d3f9d3f-462c-4a43-b3b1-e741b4c6d20c req-110280bb-39cf-427d-a656-0579d04a95dc tempest-TestShelveInstance-958690939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:53:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-5d3f9d3f-462c-4a43-b3b1-e741b4c6d20c req-110280bb-39cf-427d-a656-0579d04a95dc tempest-TestShelveInstance-958690939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:53:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-5d3f9d3f-462c-4a43-b3b1-e741b4c6d20c req-110280bb-39cf-427d-a656-0579d04a95dc tempest-TestShelveInstance-958690939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:53:35 devstack sudo[102343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:53:35 devstack sudo[102343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:53:35 devstack sudo[102343]: pam_unix(sudo:session): session closed for user root Jul 08 18:53:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-5d3f9d3f-462c-4a43-b3b1-e741b4c6d20c req-110280bb-39cf-427d-a656-0579d04a95dc tempest-TestShelveInstance-958690939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.732s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:53:35 devstack cinder-volume[86873]: DEBUG cinder.manager [req-5d3f9d3f-462c-4a43-b3b1-e741b4c6d20c req-110280bb-39cf-427d-a656-0579d04a95dc tempest-TestShelveInstance-958690939 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:53:35 devstack cinder-volume[86873]: INFO cinder.volume.manager [req-5d3f9d3f-462c-4a43-b3b1-e741b4c6d20c req-110280bb-39cf-427d-a656-0579d04a95dc tempest-TestShelveInstance-958690939 None] Deleted volume successfully. Jul 08 18:53:35 devstack cinder-volume[86873]: DEBUG cinder.coordination [req-5d3f9d3f-462c-4a43-b3b1-e741b4c6d20c req-110280bb-39cf-427d-a656-0579d04a95dc tempest-TestShelveInstance-958690939 None] Lock "cinder-ee2a7f4d-6b1b-4bc4-bac6-4f08fc0899a8-delete_volume" released by "delete_volume" :: held 3.211s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:53:41 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-8abb473a-2082-4670-8a7b-dc7f64ad39b2 tempest-TestStampPattern-552338204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:53:41 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-8abb473a-2082-4670-8a7b-dc7f64ad39b2 tempest-TestStampPattern-552338204 None] Flow 'volume_create_manager' (222a10f0-cf6c-4a3b-97f7-304b9aedc1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:53:41 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-8abb473a-2082-4670-8a7b-dc7f64ad39b2 tempest-TestStampPattern-552338204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21ae9f18-7b50-4e65-8a4e-6a1017f7f71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:53:41 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-8abb473a-2082-4670-8a7b-dc7f64ad39b2 tempest-TestStampPattern-552338204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21ae9f18-7b50-4e65-8a4e-6a1017f7f71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:53:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-565069627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48a4fbb0-6f9d-43db-a344-d9848388f786,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c22dc8bca8404502a44c381f7571c5ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:53:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9cfc8506-986e-4340-b40e-05612ae4a12a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:53:41Z,use_quota=True,user_id='b589a373a4394beea7326ecf1c932728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:53:41 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-8abb473a-2082-4670-8a7b-dc7f64ad39b2 tempest-TestStampPattern-552338204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0de9a0af-8572-448d-a354-8b1ca045dfef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:53:41 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-8abb473a-2082-4670-8a7b-dc7f64ad39b2 tempest-TestStampPattern-552338204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0de9a0af-8572-448d-a354-8b1ca045dfef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:53:41 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-8abb473a-2082-4670-8a7b-dc7f64ad39b2 tempest-TestStampPattern-552338204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26a07b3b-ce5d-4a8b-a227-d011a07fc55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:53:41 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-8abb473a-2082-4670-8a7b-dc7f64ad39b2 tempest-TestStampPattern-552338204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26a07b3b-ce5d-4a8b-a227-d011a07fc55b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '48a4fbb0-6f9d-43db-a344-d9848388f786', 'volume_name': 'volume-48a4fbb0-6f9d-43db-a344-d9848388f786', 'volume_size': 1, 'snapshot_id': '9cfc8506-986e-4340-b40e-05612ae4a12a'}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:53:41 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-8abb473a-2082-4670-8a7b-dc7f64ad39b2 tempest-TestStampPattern-552338204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d1bad0e-c067-4750-9229-a198376fce96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:53:41 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-8abb473a-2082-4670-8a7b-dc7f64ad39b2 tempest-TestStampPattern-552338204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d1bad0e-c067-4750-9229-a198376fce96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:53:41 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-8abb473a-2082-4670-8a7b-dc7f64ad39b2 tempest-TestStampPattern-552338204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26d994cf-4ad1-4622-9d3b-855f081eda1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:53:41 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-8abb473a-2082-4670-8a7b-dc7f64ad39b2 tempest-TestStampPattern-552338204 None] Volume 48a4fbb0-6f9d-43db-a344-d9848388f786: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-48a4fbb0-6f9d-43db-a344-d9848388f786', 'volume_size': 1, 'snapshot_id': '9cfc8506-986e-4340-b40e-05612ae4a12a'} Jul 08 18:53:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-8abb473a-2082-4670-8a7b-dc7f64ad39b2 tempest-TestStampPattern-552338204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:53:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-8abb473a-2082-4670-8a7b-dc7f64ad39b2 tempest-TestStampPattern-552338204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:53:41 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-8abb473a-2082-4670-8a7b-dc7f64ad39b2 tempest-TestStampPattern-552338204 None] Acquiring lock "cinder-quobyte-9cfc8506-986e-4340-b40e-05612ae4a12a-48a4fbb0-6f9d-43db-a344-d9848388f786" by "_create_volume_from_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:53:41 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-8abb473a-2082-4670-8a7b-dc7f64ad39b2 tempest-TestStampPattern-552338204 None] Lock "cinder-quobyte-9cfc8506-986e-4340-b40e-05612ae4a12a-48a4fbb0-6f9d-43db-a344-d9848388f786" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:53:41 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-8abb473a-2082-4670-8a7b-dc7f64ad39b2 tempest-TestStampPattern-552338204 None] Creating volume 48a4fbb0-6f9d-43db-a344-d9848388f786 from snapshot 9cfc8506-986e-4340-b40e-05612ae4a12a {{(pid=86873) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 18:53:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-8abb473a-2082-4670-8a7b-dc7f64ad39b2 tempest-TestStampPattern-552338204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:53:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-8abb473a-2082-4670-8a7b-dc7f64ad39b2 tempest-TestStampPattern-552338204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:53:41 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-8abb473a-2082-4670-8a7b-dc7f64ad39b2 tempest-TestStampPattern-552338204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:53:41 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-8abb473a-2082-4670-8a7b-dc7f64ad39b2 tempest-TestStampPattern-552338204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:53:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-8abb473a-2082-4670-8a7b-dc7f64ad39b2 tempest-TestStampPattern-552338204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:53:41 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-8abb473a-2082-4670-8a7b-dc7f64ad39b2 tempest-TestStampPattern-552338204 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:53:41 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-8abb473a-2082-4670-8a7b-dc7f64ad39b2 tempest-TestStampPattern-552338204 None] Acquiring lock "cinder-quobyte-48a4fbb0-6f9d-43db-a344-d9848388f786" by "_copy_volume_from_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:53:41 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-8abb473a-2082-4670-8a7b-dc7f64ad39b2 tempest-TestStampPattern-552338204 None] Lock "cinder-quobyte-48a4fbb0-6f9d-43db-a344-d9848388f786" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:53:41 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-8abb473a-2082-4670-8a7b-dc7f64ad39b2 tempest-TestStampPattern-552338204 None] snapshot: 9cfc8506-986e-4340-b40e-05612ae4a12a, volume: 48a4fbb0-6f9d-43db-a344-d9848388f786, {{(pid=86873) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 18:53:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-8abb473a-2082-4670-8a7b-dc7f64ad39b2 tempest-TestStampPattern-552338204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:53:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-8abb473a-2082-4670-8a7b-dc7f64ad39b2 tempest-TestStampPattern-552338204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:53:41 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-8abb473a-2082-4670-8a7b-dc7f64ad39b2 tempest-TestStampPattern-552338204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:53:41 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-8abb473a-2082-4670-8a7b-dc7f64ad39b2 tempest-TestStampPattern-552338204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:53:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-8abb473a-2082-4670-8a7b-dc7f64ad39b2 tempest-TestStampPattern-552338204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:53:41 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d65194-c95f-45cb-b095-66a4d1959988]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:53:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8abb473a-2082-4670-8a7b-dc7f64ad39b2 tempest-TestStampPattern-552338204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961.9cfc8506-986e-4340-b40e-05612ae4a12a {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:53:41 devstack sudo[102394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961.9cfc8506-986e-4340-b40e-05612ae4a12a Jul 08 18:53:41 devstack sudo[102394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:53:42 devstack sudo[102394]: pam_unix(sudo:session): session closed for user root Jul 08 18:53:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8abb473a-2082-4670-8a7b-dc7f64ad39b2 tempest-TestStampPattern-552338204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961.9cfc8506-986e-4340-b40e-05612ae4a12a" returned: 0 in 0.882s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:53:42 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-8abb473a-2082-4670-8a7b-dc7f64ad39b2 tempest-TestStampPattern-552338204 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b4e9e68-62e7-443c-b629-b793ce31e961(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:53:42 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-8abb473a-2082-4670-8a7b-dc7f64ad39b2 tempest-TestStampPattern-552338204 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961 {{(pid=86873) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 18:53:42 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-8abb473a-2082-4670-8a7b-dc7f64ad39b2 tempest-TestStampPattern-552338204 None] Creating direct copy from snapshot {{(pid=86873) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 18:53:42 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f357d5-a634-447d-81bc-572d579c5cce]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:53:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8abb473a-2082-4670-8a7b-dc7f64ad39b2 tempest-TestStampPattern-552338204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:53:42 devstack sudo[102404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961 Jul 08 18:53:42 devstack sudo[102404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:53:43 devstack sudo[102404]: pam_unix(sudo:session): session closed for user root Jul 08 18:53:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8abb473a-2082-4670-8a7b-dc7f64ad39b2 tempest-TestStampPattern-552338204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961" returned: 0 in 0.901s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:53:43 devstack cinder-volume[86873]: DEBUG cinder.utils [None req-8abb473a-2082-4670-8a7b-dc7f64ad39b2 tempest-TestStampPattern-552338204 None] Path /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-48a4fbb0-6f9d-43db-a344-d9848388f786 not found in is_blk_device check {{(pid=86873) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 18:53:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8abb473a-2082-4670-8a7b-dc7f64ad39b2 tempest-TestStampPattern-552338204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-48a4fbb0-6f9d-43db-a344-d9848388f786 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:53:43 devstack sudo[102410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-48a4fbb0-6f9d-43db-a344-d9848388f786 Jul 08 18:53:43 devstack sudo[102410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:53:48 devstack cinder-volume[86873]: DEBUG oslo_service.periodic_task [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86873) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:53:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:53:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:53:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:53:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:53:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:53:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:53:48 devstack sudo[102424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:53:48 devstack sudo[102424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:53:49 devstack sudo[102424]: pam_unix(sudo:session): session closed for user root Jul 08 18:53:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 1.766s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:53:50 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:53:50 devstack cinder-volume[86873]: DEBUG oslo_service.periodic_task [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running periodic task VolumeManager._thread_info {{(pid=86873) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:53:50 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] thread count: 29 {{(pid=86873) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:53:50 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] thread info: [<_MainThread(MainThread, started 138577734545536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86873) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:53:50 devstack sudo[102410]: pam_unix(sudo:session): session closed for user root Jul 08 18:53:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8abb473a-2082-4670-8a7b-dc7f64ad39b2 tempest-TestStampPattern-552338204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-48a4fbb0-6f9d-43db-a344-d9848388f786" returned: 0 in 6.876s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:53:50 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5dd7ba9-5ec7-46d6-9abd-4f9ba300e1c8]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:53:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8abb473a-2082-4670-8a7b-dc7f64ad39b2 tempest-TestStampPattern-552338204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:53:50 devstack sudo[102427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961 Jul 08 18:53:50 devstack sudo[102427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:53:51 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:UPDATE=10,cinder:SELECT=12,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:53:51 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:SELECT=16,cinder:UPDATE=12,cinder:DELETE=1,cinder:INSERT=3 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:53:51 devstack sudo[102427]: pam_unix(sudo:session): session closed for user root Jul 08 18:53:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8abb473a-2082-4670-8a7b-dc7f64ad39b2 tempest-TestStampPattern-552338204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961" returned: 0 in 1.357s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:53:51 devstack cinder-volume[86873]: DEBUG cinder.image.image_utils [None req-8abb473a-2082-4670-8a7b-dc7f64ad39b2 tempest-TestStampPattern-552338204 None] Image conversion details: src /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961, size 1024.00 MB, duration 6.88 sec, destination /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-48a4fbb0-6f9d-43db-a344-d9848388f786 {{(pid=86873) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:53:51 devstack cinder-volume[86873]: INFO cinder.image.image_utils [None req-8abb473a-2082-4670-8a7b-dc7f64ad39b2 tempest-TestStampPattern-552338204 None] Converted 1024.00 MB image at 148.87 MB/s Jul 08 18:53:51 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-8abb473a-2082-4670-8a7b-dc7f64ad39b2 tempest-TestStampPattern-552338204 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-48a4fbb0-6f9d-43db-a344-d9848388f786 is being set with open permissions: ugo+rw Jul 08 18:53:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8abb473a-2082-4670-8a7b-dc7f64ad39b2 tempest-TestStampPattern-552338204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-48a4fbb0-6f9d-43db-a344-d9848388f786 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:53:51 devstack sudo[102433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-48a4fbb0-6f9d-43db-a344-d9848388f786 Jul 08 18:53:51 devstack sudo[102433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:53:52 devstack sudo[102433]: pam_unix(sudo:session): session closed for user root Jul 08 18:53:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8abb473a-2082-4670-8a7b-dc7f64ad39b2 tempest-TestStampPattern-552338204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-48a4fbb0-6f9d-43db-a344-d9848388f786" returned: 0 in 0.765s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:53:52 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-8abb473a-2082-4670-8a7b-dc7f64ad39b2 tempest-TestStampPattern-552338204 None] Lock "cinder-quobyte-48a4fbb0-6f9d-43db-a344-d9848388f786" released by "_copy_volume_from_snapshot" :: held 10.933s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:53:52 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-8abb473a-2082-4670-8a7b-dc7f64ad39b2 tempest-TestStampPattern-552338204 None] Lock "cinder-quobyte-9cfc8506-986e-4340-b40e-05612ae4a12a-48a4fbb0-6f9d-43db-a344-d9848388f786" released by "_create_volume_from_snapshot" :: held 10.974s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:53:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-8abb473a-2082-4670-8a7b-dc7f64ad39b2 tempest-TestStampPattern-552338204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.996s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:53:52 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-8abb473a-2082-4670-8a7b-dc7f64ad39b2 tempest-TestStampPattern-552338204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26d994cf-4ad1-4622-9d3b-855f081eda1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48a4fbb0-6f9d-43db-a344-d9848388f786', 'volume_size': 1, 'snapshot_id': '9cfc8506-986e-4340-b40e-05612ae4a12a'}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:53:52 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-8abb473a-2082-4670-8a7b-dc7f64ad39b2 tempest-TestStampPattern-552338204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c78b1f70-4f43-4865-80aa-1df897264665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:53:52 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-8abb473a-2082-4670-8a7b-dc7f64ad39b2 tempest-TestStampPattern-552338204 None] Volume volume-48a4fbb0-6f9d-43db-a344-d9848388f786 (48a4fbb0-6f9d-43db-a344-d9848388f786): created successfully Jul 08 18:53:52 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-8abb473a-2082-4670-8a7b-dc7f64ad39b2 tempest-TestStampPattern-552338204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c78b1f70-4f43-4865-80aa-1df897264665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:53:52 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-8abb473a-2082-4670-8a7b-dc7f64ad39b2 tempest-TestStampPattern-552338204 None] Flow 'volume_create_manager' (222a10f0-cf6c-4a3b-97f7-304b9aedc1f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:53:52 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-8abb473a-2082-4670-8a7b-dc7f64ad39b2 tempest-TestStampPattern-552338204 None] Created volume successfully. Jul 08 18:53:52 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e7a28be-78eb-4008-b28d-4fb4ea74b19f tempest-CreateVolumesFromSnapshotTest-263089513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:53:52 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3e7a28be-78eb-4008-b28d-4fb4ea74b19f tempest-CreateVolumesFromSnapshotTest-263089513 None] Flow 'volume_create_manager' (013c6013-62e2-49d3-93fb-20a8164bafc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:53:52 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3e7a28be-78eb-4008-b28d-4fb4ea74b19f tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b7b50c6-d2c9-488b-9726-0fa0fd7801d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:53:52 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3e7a28be-78eb-4008-b28d-4fb4ea74b19f tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b7b50c6-d2c9-488b-9726-0fa0fd7801d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-908503891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90c8b569-59ab-4319-bf82-91559fd82133,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06e3bf046aaa419f9c849c5916630245',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:53:52Z,use_quota=True,user_id='8bd6cfb0628d49caa757396d1b8a0458',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:53:52 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3e7a28be-78eb-4008-b28d-4fb4ea74b19f tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8637a438-61a3-4e97-90d3-fe42bddef3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:53:52 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3e7a28be-78eb-4008-b28d-4fb4ea74b19f tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8637a438-61a3-4e97-90d3-fe42bddef3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:53:52 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3e7a28be-78eb-4008-b28d-4fb4ea74b19f tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef85275d-7042-4910-bde5-1b2f9c77b4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:53:52 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3e7a28be-78eb-4008-b28d-4fb4ea74b19f tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef85275d-7042-4910-bde5-1b2f9c77b4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90c8b569-59ab-4319-bf82-91559fd82133', 'volume_name': 'volume-90c8b569-59ab-4319-bf82-91559fd82133', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:53:52 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3e7a28be-78eb-4008-b28d-4fb4ea74b19f tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13db5856-bea2-44e3-978c-e2217600e12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:53:52 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3e7a28be-78eb-4008-b28d-4fb4ea74b19f tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13db5856-bea2-44e3-978c-e2217600e12a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:53:52 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3e7a28be-78eb-4008-b28d-4fb4ea74b19f tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (481151be-b57b-42a1-8cc1-2600b93c0f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:53:52 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-3e7a28be-78eb-4008-b28d-4fb4ea74b19f tempest-CreateVolumesFromSnapshotTest-263089513 None] Volume 90c8b569-59ab-4319-bf82-91559fd82133: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90c8b569-59ab-4319-bf82-91559fd82133', 'volume_size': 1} Jul 08 18:53:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3e7a28be-78eb-4008-b28d-4fb4ea74b19f tempest-CreateVolumesFromSnapshotTest-263089513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:53:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3e7a28be-78eb-4008-b28d-4fb4ea74b19f tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:53:52 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-3e7a28be-78eb-4008-b28d-4fb4ea74b19f tempest-CreateVolumesFromSnapshotTest-263089513 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-908503891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90c8b569-59ab-4319-bf82-91559fd82133,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06e3bf046aaa419f9c849c5916630245',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:53:52Z,use_quota=True,user_id='8bd6cfb0628d49caa757396d1b8a0458',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:53:52 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-3e7a28be-78eb-4008-b28d-4fb4ea74b19f tempest-CreateVolumesFromSnapshotTest-263089513 None] Creating volume 90c8b569-59ab-4319-bf82-91559fd82133 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:53:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3e7a28be-78eb-4008-b28d-4fb4ea74b19f tempest-CreateVolumesFromSnapshotTest-263089513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:53:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3e7a28be-78eb-4008-b28d-4fb4ea74b19f tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:53:52 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-3e7a28be-78eb-4008-b28d-4fb4ea74b19f tempest-CreateVolumesFromSnapshotTest-263089513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:53:52 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-3e7a28be-78eb-4008-b28d-4fb4ea74b19f tempest-CreateVolumesFromSnapshotTest-263089513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:53:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3e7a28be-78eb-4008-b28d-4fb4ea74b19f tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:53:52 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-3e7a28be-78eb-4008-b28d-4fb4ea74b19f tempest-CreateVolumesFromSnapshotTest-263089513 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:53:52 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-3e7a28be-78eb-4008-b28d-4fb4ea74b19f tempest-CreateVolumesFromSnapshotTest-263089513 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:53:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3e7a28be-78eb-4008-b28d-4fb4ea74b19f tempest-CreateVolumesFromSnapshotTest-263089513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-90c8b569-59ab-4319-bf82-91559fd82133 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:53:52 devstack sudo[102463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-90c8b569-59ab-4319-bf82-91559fd82133 1073741824 Jul 08 18:53:52 devstack sudo[102463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:53:53 devstack sudo[102463]: pam_unix(sudo:session): session closed for user root Jul 08 18:53:53 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3e7a28be-78eb-4008-b28d-4fb4ea74b19f tempest-CreateVolumesFromSnapshotTest-263089513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-90c8b569-59ab-4319-bf82-91559fd82133 1073741824" returned: 0 in 0.880s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:53:53 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3e7a28be-78eb-4008-b28d-4fb4ea74b19f tempest-CreateVolumesFromSnapshotTest-263089513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-90c8b569-59ab-4319-bf82-91559fd82133 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:53:53 devstack sudo[102471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-90c8b569-59ab-4319-bf82-91559fd82133 Jul 08 18:53:53 devstack sudo[102471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:53:54 devstack sudo[102471]: pam_unix(sudo:session): session closed for user root Jul 08 18:53:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3e7a28be-78eb-4008-b28d-4fb4ea74b19f tempest-CreateVolumesFromSnapshotTest-263089513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-90c8b569-59ab-4319-bf82-91559fd82133" returned: 0 in 0.692s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:53:54 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-3e7a28be-78eb-4008-b28d-4fb4ea74b19f tempest-CreateVolumesFromSnapshotTest-263089513 None] <== create_volume: return (1618ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:53:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3e7a28be-78eb-4008-b28d-4fb4ea74b19f tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.621s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:53:54 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3e7a28be-78eb-4008-b28d-4fb4ea74b19f tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (481151be-b57b-42a1-8cc1-2600b93c0f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90c8b569-59ab-4319-bf82-91559fd82133', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:53:54 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3e7a28be-78eb-4008-b28d-4fb4ea74b19f tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1018f4a-a259-4129-aa4a-9890036fc4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:53:54 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-3e7a28be-78eb-4008-b28d-4fb4ea74b19f tempest-CreateVolumesFromSnapshotTest-263089513 None] Volume volume-90c8b569-59ab-4319-bf82-91559fd82133 (90c8b569-59ab-4319-bf82-91559fd82133): created successfully Jul 08 18:53:54 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3e7a28be-78eb-4008-b28d-4fb4ea74b19f tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1018f4a-a259-4129-aa4a-9890036fc4ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:53:54 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3e7a28be-78eb-4008-b28d-4fb4ea74b19f tempest-CreateVolumesFromSnapshotTest-263089513 None] Flow 'volume_create_manager' (013c6013-62e2-49d3-93fb-20a8164bafc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:53:54 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-3e7a28be-78eb-4008-b28d-4fb4ea74b19f tempest-CreateVolumesFromSnapshotTest-263089513 None] Created volume successfully. Jul 08 18:53:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-be7f8d37-aa78-46d9-bc54-dbfa288fe581 tempest-CreateVolumesFromSnapshotTest-263089513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:53:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-be7f8d37-aa78-46d9-bc54-dbfa288fe581 tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:53:54 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-be7f8d37-aa78-46d9-bc54-dbfa288fe581 tempest-CreateVolumesFromSnapshotTest-263089513 None] Creating offline snapshot 3d825930-85b3-469a-a39b-4f28f368c488 of volume 90c8b569-59ab-4319-bf82-91559fd82133 {{(pid=86873) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:53:54 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[d848a65a-b1bb-4e8c-ba54-aed54cf855f6]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:53:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-be7f8d37-aa78-46d9-bc54-dbfa288fe581 tempest-CreateVolumesFromSnapshotTest-263089513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-90c8b569-59ab-4319-bf82-91559fd82133 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:53:55 devstack sudo[102487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-90c8b569-59ab-4319-bf82-91559fd82133 Jul 08 18:53:55 devstack sudo[102487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:53:55 devstack sudo[102487]: pam_unix(sudo:session): session closed for user root Jul 08 18:53:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-be7f8d37-aa78-46d9-bc54-dbfa288fe581 tempest-CreateVolumesFromSnapshotTest-263089513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-90c8b569-59ab-4319-bf82-91559fd82133" returned: 0 in 0.804s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:53:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-be7f8d37-aa78-46d9-bc54-dbfa288fe581 tempest-CreateVolumesFromSnapshotTest-263089513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-90c8b569-59ab-4319-bf82-91559fd82133,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-90c8b569-59ab-4319-bf82-91559fd82133.3d825930-85b3-469a-a39b-4f28f368c488 1G {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:53:55 devstack sudo[102500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-90c8b569-59ab-4319-bf82-91559fd82133,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-90c8b569-59ab-4319-bf82-91559fd82133.3d825930-85b3-469a-a39b-4f28f368c488 1G Jul 08 18:53:55 devstack sudo[102500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:53:56 devstack sudo[102500]: pam_unix(sudo:session): session closed for user root Jul 08 18:53:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-be7f8d37-aa78-46d9-bc54-dbfa288fe581 tempest-CreateVolumesFromSnapshotTest-263089513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-90c8b569-59ab-4319-bf82-91559fd82133,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-90c8b569-59ab-4319-bf82-91559fd82133.3d825930-85b3-469a-a39b-4f28f368c488 1G" returned: 0 in 0.839s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:53:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-be7f8d37-aa78-46d9-bc54-dbfa288fe581 tempest-CreateVolumesFromSnapshotTest-263089513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90c8b569-59ab-4319-bf82-91559fd82133 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-90c8b569-59ab-4319-bf82-91559fd82133.3d825930-85b3-469a-a39b-4f28f368c488 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:53:56 devstack sudo[102523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90c8b569-59ab-4319-bf82-91559fd82133 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-90c8b569-59ab-4319-bf82-91559fd82133.3d825930-85b3-469a-a39b-4f28f368c488 Jul 08 18:53:56 devstack sudo[102523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:53:57 devstack sudo[102523]: pam_unix(sudo:session): session closed for user root Jul 08 18:53:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-be7f8d37-aa78-46d9-bc54-dbfa288fe581 tempest-CreateVolumesFromSnapshotTest-263089513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90c8b569-59ab-4319-bf82-91559fd82133 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-90c8b569-59ab-4319-bf82-91559fd82133.3d825930-85b3-469a-a39b-4f28f368c488" returned: 0 in 0.739s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:53:57 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-be7f8d37-aa78-46d9-bc54-dbfa288fe581 tempest-CreateVolumesFromSnapshotTest-263089513 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-90c8b569-59ab-4319-bf82-91559fd82133.3d825930-85b3-469a-a39b-4f28f368c488 is being set with open permissions: ugo+rw Jul 08 18:53:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-be7f8d37-aa78-46d9-bc54-dbfa288fe581 tempest-CreateVolumesFromSnapshotTest-263089513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-90c8b569-59ab-4319-bf82-91559fd82133.3d825930-85b3-469a-a39b-4f28f368c488 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:53:57 devstack sudo[102531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-90c8b569-59ab-4319-bf82-91559fd82133.3d825930-85b3-469a-a39b-4f28f368c488 Jul 08 18:53:57 devstack sudo[102531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:53:58 devstack sudo[102531]: pam_unix(sudo:session): session closed for user root Jul 08 18:53:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-be7f8d37-aa78-46d9-bc54-dbfa288fe581 tempest-CreateVolumesFromSnapshotTest-263089513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-90c8b569-59ab-4319-bf82-91559fd82133.3d825930-85b3-469a-a39b-4f28f368c488" returned: 0 in 0.730s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:53:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-be7f8d37-aa78-46d9-bc54-dbfa288fe581 tempest-CreateVolumesFromSnapshotTest-263089513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-90c8b569-59ab-4319-bf82-91559fd82133.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:53:58 devstack sudo[102536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-90c8b569-59ab-4319-bf82-91559fd82133.info Jul 08 18:53:58 devstack sudo[102536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:53:58 devstack sudo[102536]: pam_unix(sudo:session): session closed for user root Jul 08 18:53:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-be7f8d37-aa78-46d9-bc54-dbfa288fe581 tempest-CreateVolumesFromSnapshotTest-263089513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-90c8b569-59ab-4319-bf82-91559fd82133.info" returned: 0 in 0.741s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:53:58 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-be7f8d37-aa78-46d9-bc54-dbfa288fe581 tempest-CreateVolumesFromSnapshotTest-263089513 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-90c8b569-59ab-4319-bf82-91559fd82133.info is being set with open permissions: ugo+rw Jul 08 18:53:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-be7f8d37-aa78-46d9-bc54-dbfa288fe581 tempest-CreateVolumesFromSnapshotTest-263089513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-90c8b569-59ab-4319-bf82-91559fd82133.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:53:58 devstack sudo[102539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-90c8b569-59ab-4319-bf82-91559fd82133.info Jul 08 18:53:58 devstack sudo[102539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:53:59 devstack sudo[102539]: pam_unix(sudo:session): session closed for user root Jul 08 18:53:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-be7f8d37-aa78-46d9-bc54-dbfa288fe581 tempest-CreateVolumesFromSnapshotTest-263089513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-90c8b569-59ab-4319-bf82-91559fd82133.info" returned: 0 in 0.703s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:53:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-be7f8d37-aa78-46d9-bc54-dbfa288fe581 tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.696s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:53:59 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-be7f8d37-aa78-46d9-bc54-dbfa288fe581 tempest-CreateVolumesFromSnapshotTest-263089513 None] Create snapshot completed successfully Jul 08 18:54:00 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b79569b-c63e-4058-a3ff-1510fdd8d5c9 tempest-CreateVolumesFromSnapshotTest-263089513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:54:00 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2b79569b-c63e-4058-a3ff-1510fdd8d5c9 tempest-CreateVolumesFromSnapshotTest-263089513 None] Flow 'volume_create_manager' (d7bdbf98-99fe-4868-b2f2-2606dd61d8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:54:00 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2b79569b-c63e-4058-a3ff-1510fdd8d5c9 tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7be54b7-e6e3-4092-add2-54b6a35bff56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:00 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2b79569b-c63e-4058-a3ff-1510fdd8d5c9 tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7be54b7-e6e3-4092-add2-54b6a35bff56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:54:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-775059185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aca87f71-67c3-4ba1-b652-b28d2f035d47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06e3bf046aaa419f9c849c5916630245',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:54:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:54:01Z,use_quota=True,user_id='8bd6cfb0628d49caa757396d1b8a0458',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:01 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2b79569b-c63e-4058-a3ff-1510fdd8d5c9 tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (780f3109-b865-410a-ab7c-2affd2ce1e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:01 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2b79569b-c63e-4058-a3ff-1510fdd8d5c9 tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (780f3109-b865-410a-ab7c-2affd2ce1e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:01 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2b79569b-c63e-4058-a3ff-1510fdd8d5c9 tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75d08ab7-226c-41b5-b8aa-8e247180c645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:01 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2b79569b-c63e-4058-a3ff-1510fdd8d5c9 tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75d08ab7-226c-41b5-b8aa-8e247180c645) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aca87f71-67c3-4ba1-b652-b28d2f035d47', 'volume_name': 'volume-aca87f71-67c3-4ba1-b652-b28d2f035d47', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:01 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2b79569b-c63e-4058-a3ff-1510fdd8d5c9 tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7fb7fab-e2c3-4b28-862e-ecd14e56bda9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:01 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2b79569b-c63e-4058-a3ff-1510fdd8d5c9 tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7fb7fab-e2c3-4b28-862e-ecd14e56bda9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:01 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2b79569b-c63e-4058-a3ff-1510fdd8d5c9 tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f7ac89b-b563-4574-b774-3224b5c03ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:01 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-2b79569b-c63e-4058-a3ff-1510fdd8d5c9 tempest-CreateVolumesFromSnapshotTest-263089513 None] Volume aca87f71-67c3-4ba1-b652-b28d2f035d47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aca87f71-67c3-4ba1-b652-b28d2f035d47', 'volume_size': 1} Jul 08 18:54:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-2b79569b-c63e-4058-a3ff-1510fdd8d5c9 tempest-CreateVolumesFromSnapshotTest-263089513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:54:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-2b79569b-c63e-4058-a3ff-1510fdd8d5c9 tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:54:01 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-2b79569b-c63e-4058-a3ff-1510fdd8d5c9 tempest-CreateVolumesFromSnapshotTest-263089513 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:54:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-775059185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aca87f71-67c3-4ba1-b652-b28d2f035d47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06e3bf046aaa419f9c849c5916630245',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:54:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:54:01Z,use_quota=True,user_id='8bd6cfb0628d49caa757396d1b8a0458',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:54:01 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-2b79569b-c63e-4058-a3ff-1510fdd8d5c9 tempest-CreateVolumesFromSnapshotTest-263089513 None] Creating volume aca87f71-67c3-4ba1-b652-b28d2f035d47 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:54:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-2b79569b-c63e-4058-a3ff-1510fdd8d5c9 tempest-CreateVolumesFromSnapshotTest-263089513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:54:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-2b79569b-c63e-4058-a3ff-1510fdd8d5c9 tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:54:01 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-2b79569b-c63e-4058-a3ff-1510fdd8d5c9 tempest-CreateVolumesFromSnapshotTest-263089513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:54:01 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-2b79569b-c63e-4058-a3ff-1510fdd8d5c9 tempest-CreateVolumesFromSnapshotTest-263089513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:54:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-2b79569b-c63e-4058-a3ff-1510fdd8d5c9 tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:54:01 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-2b79569b-c63e-4058-a3ff-1510fdd8d5c9 tempest-CreateVolumesFromSnapshotTest-263089513 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:54:01 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-2b79569b-c63e-4058-a3ff-1510fdd8d5c9 tempest-CreateVolumesFromSnapshotTest-263089513 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:54:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2b79569b-c63e-4058-a3ff-1510fdd8d5c9 tempest-CreateVolumesFromSnapshotTest-263089513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aca87f71-67c3-4ba1-b652-b28d2f035d47 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:01 devstack sudo[102543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aca87f71-67c3-4ba1-b652-b28d2f035d47 1073741824 Jul 08 18:54:01 devstack sudo[102543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:01 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-76c80102-ecee-4ea3-add1-3081b469f74f tempest-CreateVolumesFromSnapshotTest-263089513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:54:01 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-76c80102-ecee-4ea3-add1-3081b469f74f tempest-CreateVolumesFromSnapshotTest-263089513 None] Flow 'volume_create_manager' (d1025e2a-d12a-4683-933f-d4f2c67f644d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:54:01 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-76c80102-ecee-4ea3-add1-3081b469f74f tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21c4c923-fe95-4c99-9ac5-4fd383e1f0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:01 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-76c80102-ecee-4ea3-add1-3081b469f74f tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21c4c923-fe95-4c99-9ac5-4fd383e1f0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1112461621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e30c5250-e4fa-4c88-929d-c55692d5ed21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06e3bf046aaa419f9c849c5916630245',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:54:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:54:01Z,use_quota=True,user_id='8bd6cfb0628d49caa757396d1b8a0458',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:01 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-76c80102-ecee-4ea3-add1-3081b469f74f tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc6222b6-b0d2-4a52-b0b4-2719080dd0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:01 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-76c80102-ecee-4ea3-add1-3081b469f74f tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc6222b6-b0d2-4a52-b0b4-2719080dd0b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:01 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-76c80102-ecee-4ea3-add1-3081b469f74f tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcc7b550-dda7-4f0d-b9d5-663646343bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:01 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-76c80102-ecee-4ea3-add1-3081b469f74f tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcc7b550-dda7-4f0d-b9d5-663646343bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e30c5250-e4fa-4c88-929d-c55692d5ed21', 'volume_name': 'volume-e30c5250-e4fa-4c88-929d-c55692d5ed21', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:01 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-76c80102-ecee-4ea3-add1-3081b469f74f tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eec3a6da-c2ba-4ced-a2d4-b60d9a322023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:01 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-76c80102-ecee-4ea3-add1-3081b469f74f tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eec3a6da-c2ba-4ced-a2d4-b60d9a322023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:01 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-76c80102-ecee-4ea3-add1-3081b469f74f tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2285ab6-c2e6-46a6-9a54-5eb8869a27b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:01 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-76c80102-ecee-4ea3-add1-3081b469f74f tempest-CreateVolumesFromSnapshotTest-263089513 None] Volume e30c5250-e4fa-4c88-929d-c55692d5ed21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e30c5250-e4fa-4c88-929d-c55692d5ed21', 'volume_size': 1} Jul 08 18:54:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-76c80102-ecee-4ea3-add1-3081b469f74f tempest-CreateVolumesFromSnapshotTest-263089513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:54:02 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-65f9c19c-c7d7-4253-9918-58c6fb6caf68 tempest-CreateVolumesFromSnapshotTest-263089513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:54:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-65f9c19c-c7d7-4253-9918-58c6fb6caf68 tempest-CreateVolumesFromSnapshotTest-263089513 None] Flow 'volume_create_manager' (ea931651-14ab-4e03-968a-ff3a195e5f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:54:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-65f9c19c-c7d7-4253-9918-58c6fb6caf68 tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ae72960-e1d5-4749-90ab-4ecedffcf611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-65f9c19c-c7d7-4253-9918-58c6fb6caf68 tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ae72960-e1d5-4749-90ab-4ecedffcf611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-473442400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a484746-2c66-42a5-9cc9-8efc68caff15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06e3bf046aaa419f9c849c5916630245',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:54:02Z,use_quota=True,user_id='8bd6cfb0628d49caa757396d1b8a0458',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-65f9c19c-c7d7-4253-9918-58c6fb6caf68 tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0580be84-c737-41a6-8206-e8557728c0f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-65f9c19c-c7d7-4253-9918-58c6fb6caf68 tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0580be84-c737-41a6-8206-e8557728c0f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-65f9c19c-c7d7-4253-9918-58c6fb6caf68 tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a57f0361-dd2d-4670-b4a0-dbeb127f16fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-65f9c19c-c7d7-4253-9918-58c6fb6caf68 tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a57f0361-dd2d-4670-b4a0-dbeb127f16fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a484746-2c66-42a5-9cc9-8efc68caff15', 'volume_name': 'volume-5a484746-2c66-42a5-9cc9-8efc68caff15', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-65f9c19c-c7d7-4253-9918-58c6fb6caf68 tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bbe5108-2f91-4a3f-b07d-9c9755c05a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-65f9c19c-c7d7-4253-9918-58c6fb6caf68 tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bbe5108-2f91-4a3f-b07d-9c9755c05a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-65f9c19c-c7d7-4253-9918-58c6fb6caf68 tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93a3e709-b8ca-4f3f-b33f-66903359f555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:02 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-65f9c19c-c7d7-4253-9918-58c6fb6caf68 tempest-CreateVolumesFromSnapshotTest-263089513 None] Volume 5a484746-2c66-42a5-9cc9-8efc68caff15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a484746-2c66-42a5-9cc9-8efc68caff15', 'volume_size': 1} Jul 08 18:54:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-65f9c19c-c7d7-4253-9918-58c6fb6caf68 tempest-CreateVolumesFromSnapshotTest-263089513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:54:02 devstack sudo[102543]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2b79569b-c63e-4058-a3ff-1510fdd8d5c9 tempest-CreateVolumesFromSnapshotTest-263089513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aca87f71-67c3-4ba1-b652-b28d2f035d47 1073741824" returned: 0 in 1.347s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:02 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9456cff-d4ed-4f13-b34f-f1c491dad1f7 tempest-CreateVolumesFromSnapshotTest-263089513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:54:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c9456cff-d4ed-4f13-b34f-f1c491dad1f7 tempest-CreateVolumesFromSnapshotTest-263089513 None] Flow 'volume_create_manager' (6dd19197-216f-4d8e-84d1-26712261eecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:54:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c9456cff-d4ed-4f13-b34f-f1c491dad1f7 tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6065dbef-a7b1-4417-831d-884f0a6711b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c9456cff-d4ed-4f13-b34f-f1c491dad1f7 tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6065dbef-a7b1-4417-831d-884f0a6711b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1043849063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cc0b44c-0b24-41d4-b31f-108cb5636b01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06e3bf046aaa419f9c849c5916630245',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:54:02Z,use_quota=True,user_id='8bd6cfb0628d49caa757396d1b8a0458',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c9456cff-d4ed-4f13-b34f-f1c491dad1f7 tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (527c9233-9ac6-474a-ab8c-90779aa1d35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c9456cff-d4ed-4f13-b34f-f1c491dad1f7 tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (527c9233-9ac6-474a-ab8c-90779aa1d35e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c9456cff-d4ed-4f13-b34f-f1c491dad1f7 tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99be5da8-44d5-4d30-916e-56c1eac886d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c9456cff-d4ed-4f13-b34f-f1c491dad1f7 tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99be5da8-44d5-4d30-916e-56c1eac886d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cc0b44c-0b24-41d4-b31f-108cb5636b01', 'volume_name': 'volume-1cc0b44c-0b24-41d4-b31f-108cb5636b01', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c9456cff-d4ed-4f13-b34f-f1c491dad1f7 tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed062930-e3a2-4166-9b36-6628f6f96b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c9456cff-d4ed-4f13-b34f-f1c491dad1f7 tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed062930-e3a2-4166-9b36-6628f6f96b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c9456cff-d4ed-4f13-b34f-f1c491dad1f7 tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e6cbd17-5e6f-4ef9-9ff0-e4efac660f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:02 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-c9456cff-d4ed-4f13-b34f-f1c491dad1f7 tempest-CreateVolumesFromSnapshotTest-263089513 None] Volume 1cc0b44c-0b24-41d4-b31f-108cb5636b01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cc0b44c-0b24-41d4-b31f-108cb5636b01', 'volume_size': 1} Jul 08 18:54:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c9456cff-d4ed-4f13-b34f-f1c491dad1f7 tempest-CreateVolumesFromSnapshotTest-263089513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:54:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2b79569b-c63e-4058-a3ff-1510fdd8d5c9 tempest-CreateVolumesFromSnapshotTest-263089513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aca87f71-67c3-4ba1-b652-b28d2f035d47 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:02 devstack sudo[102554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aca87f71-67c3-4ba1-b652-b28d2f035d47 Jul 08 18:54:02 devstack sudo[102554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:03 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-82d61c35-81fe-42c1-aefc-36d631f2379d tempest-CreateVolumesFromSnapshotTest-263089513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:54:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-82d61c35-81fe-42c1-aefc-36d631f2379d tempest-CreateVolumesFromSnapshotTest-263089513 None] Flow 'volume_create_manager' (722b5717-a4cb-4f5c-815e-cb2de594cec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:54:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-82d61c35-81fe-42c1-aefc-36d631f2379d tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f02076e-d73b-4e98-95c0-98a5d7e1031d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-82d61c35-81fe-42c1-aefc-36d631f2379d tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f02076e-d73b-4e98-95c0-98a5d7e1031d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1422128828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfc8c405-e243-413a-b7c0-85fa1b93c948,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06e3bf046aaa419f9c849c5916630245',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:54:03Z,use_quota=True,user_id='8bd6cfb0628d49caa757396d1b8a0458',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-82d61c35-81fe-42c1-aefc-36d631f2379d tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d9f373f-3f64-4950-a993-afe6b2e21d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-82d61c35-81fe-42c1-aefc-36d631f2379d tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d9f373f-3f64-4950-a993-afe6b2e21d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-82d61c35-81fe-42c1-aefc-36d631f2379d tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39d2f9ee-f0e9-41ff-8218-964b633610e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-82d61c35-81fe-42c1-aefc-36d631f2379d tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39d2f9ee-f0e9-41ff-8218-964b633610e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfc8c405-e243-413a-b7c0-85fa1b93c948', 'volume_name': 'volume-dfc8c405-e243-413a-b7c0-85fa1b93c948', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-82d61c35-81fe-42c1-aefc-36d631f2379d tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d371c711-1718-435d-a61c-f5ca39083c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-82d61c35-81fe-42c1-aefc-36d631f2379d tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d371c711-1718-435d-a61c-f5ca39083c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-82d61c35-81fe-42c1-aefc-36d631f2379d tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2063bdda-5a8c-4b80-a077-97cd077bb9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:03 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-82d61c35-81fe-42c1-aefc-36d631f2379d tempest-CreateVolumesFromSnapshotTest-263089513 None] Volume dfc8c405-e243-413a-b7c0-85fa1b93c948: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfc8c405-e243-413a-b7c0-85fa1b93c948', 'volume_size': 1} Jul 08 18:54:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-82d61c35-81fe-42c1-aefc-36d631f2379d tempest-CreateVolumesFromSnapshotTest-263089513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:54:03 devstack sudo[102554]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2b79569b-c63e-4058-a3ff-1510fdd8d5c9 tempest-CreateVolumesFromSnapshotTest-263089513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aca87f71-67c3-4ba1-b652-b28d2f035d47" returned: 0 in 0.840s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:03 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-2b79569b-c63e-4058-a3ff-1510fdd8d5c9 tempest-CreateVolumesFromSnapshotTest-263089513 None] <== create_volume: return (2346ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:54:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-2b79569b-c63e-4058-a3ff-1510fdd8d5c9 tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.350s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:54:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-76c80102-ecee-4ea3-add1-3081b469f74f tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.986s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:54:03 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-76c80102-ecee-4ea3-add1-3081b469f74f tempest-CreateVolumesFromSnapshotTest-263089513 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1112461621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e30c5250-e4fa-4c88-929d-c55692d5ed21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06e3bf046aaa419f9c849c5916630245',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:54:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:54:01Z,use_quota=True,user_id='8bd6cfb0628d49caa757396d1b8a0458',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:54:03 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-76c80102-ecee-4ea3-add1-3081b469f74f tempest-CreateVolumesFromSnapshotTest-263089513 None] Creating volume e30c5250-e4fa-4c88-929d-c55692d5ed21 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:54:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-76c80102-ecee-4ea3-add1-3081b469f74f tempest-CreateVolumesFromSnapshotTest-263089513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:54:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-76c80102-ecee-4ea3-add1-3081b469f74f tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:54:03 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-76c80102-ecee-4ea3-add1-3081b469f74f tempest-CreateVolumesFromSnapshotTest-263089513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:54:03 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-76c80102-ecee-4ea3-add1-3081b469f74f tempest-CreateVolumesFromSnapshotTest-263089513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:54:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-76c80102-ecee-4ea3-add1-3081b469f74f tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:54:03 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-76c80102-ecee-4ea3-add1-3081b469f74f tempest-CreateVolumesFromSnapshotTest-263089513 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:54:03 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-76c80102-ecee-4ea3-add1-3081b469f74f tempest-CreateVolumesFromSnapshotTest-263089513 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:54:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-76c80102-ecee-4ea3-add1-3081b469f74f tempest-CreateVolumesFromSnapshotTest-263089513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e30c5250-e4fa-4c88-929d-c55692d5ed21 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2b79569b-c63e-4058-a3ff-1510fdd8d5c9 tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f7ac89b-b563-4574-b774-3224b5c03ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aca87f71-67c3-4ba1-b652-b28d2f035d47', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:03 devstack sudo[102557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e30c5250-e4fa-4c88-929d-c55692d5ed21 1073741824 Jul 08 18:54:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2b79569b-c63e-4058-a3ff-1510fdd8d5c9 tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03937741-44f4-4784-9f83-eb347f4afa16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:03 devstack sudo[102557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:03 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-2b79569b-c63e-4058-a3ff-1510fdd8d5c9 tempest-CreateVolumesFromSnapshotTest-263089513 None] Volume volume-aca87f71-67c3-4ba1-b652-b28d2f035d47 (aca87f71-67c3-4ba1-b652-b28d2f035d47): created successfully Jul 08 18:54:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2b79569b-c63e-4058-a3ff-1510fdd8d5c9 tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03937741-44f4-4784-9f83-eb347f4afa16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2b79569b-c63e-4058-a3ff-1510fdd8d5c9 tempest-CreateVolumesFromSnapshotTest-263089513 None] Flow 'volume_create_manager' (d7bdbf98-99fe-4868-b2f2-2606dd61d8a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:54:03 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-2b79569b-c63e-4058-a3ff-1510fdd8d5c9 tempest-CreateVolumesFromSnapshotTest-263089513 None] Created volume successfully. Jul 08 18:54:04 devstack sudo[102557]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-76c80102-ecee-4ea3-add1-3081b469f74f tempest-CreateVolumesFromSnapshotTest-263089513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e30c5250-e4fa-4c88-929d-c55692d5ed21 1073741824" returned: 0 in 0.863s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-76c80102-ecee-4ea3-add1-3081b469f74f tempest-CreateVolumesFromSnapshotTest-263089513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e30c5250-e4fa-4c88-929d-c55692d5ed21 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:04 devstack sudo[102562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e30c5250-e4fa-4c88-929d-c55692d5ed21 Jul 08 18:54:04 devstack sudo[102562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:05 devstack sudo[102562]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-76c80102-ecee-4ea3-add1-3081b469f74f tempest-CreateVolumesFromSnapshotTest-263089513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e30c5250-e4fa-4c88-929d-c55692d5ed21" returned: 0 in 0.757s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:05 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-76c80102-ecee-4ea3-add1-3081b469f74f tempest-CreateVolumesFromSnapshotTest-263089513 None] <== create_volume: return (1668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:54:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-76c80102-ecee-4ea3-add1-3081b469f74f tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.671s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:54:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-65f9c19c-c7d7-4253-9918-58c6fb6caf68 tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.028s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:54:05 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-65f9c19c-c7d7-4253-9918-58c6fb6caf68 tempest-CreateVolumesFromSnapshotTest-263089513 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-473442400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a484746-2c66-42a5-9cc9-8efc68caff15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06e3bf046aaa419f9c849c5916630245',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:54:02Z,use_quota=True,user_id='8bd6cfb0628d49caa757396d1b8a0458',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:54:05 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-65f9c19c-c7d7-4253-9918-58c6fb6caf68 tempest-CreateVolumesFromSnapshotTest-263089513 None] Creating volume 5a484746-2c66-42a5-9cc9-8efc68caff15 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:54:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-65f9c19c-c7d7-4253-9918-58c6fb6caf68 tempest-CreateVolumesFromSnapshotTest-263089513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:54:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-65f9c19c-c7d7-4253-9918-58c6fb6caf68 tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:54:05 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-65f9c19c-c7d7-4253-9918-58c6fb6caf68 tempest-CreateVolumesFromSnapshotTest-263089513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:54:05 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-65f9c19c-c7d7-4253-9918-58c6fb6caf68 tempest-CreateVolumesFromSnapshotTest-263089513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:54:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-65f9c19c-c7d7-4253-9918-58c6fb6caf68 tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:54:05 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-65f9c19c-c7d7-4253-9918-58c6fb6caf68 tempest-CreateVolumesFromSnapshotTest-263089513 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:54:05 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-65f9c19c-c7d7-4253-9918-58c6fb6caf68 tempest-CreateVolumesFromSnapshotTest-263089513 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:54:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-65f9c19c-c7d7-4253-9918-58c6fb6caf68 tempest-CreateVolumesFromSnapshotTest-263089513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a484746-2c66-42a5-9cc9-8efc68caff15 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:05 devstack sudo[102601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a484746-2c66-42a5-9cc9-8efc68caff15 1073741824 Jul 08 18:54:05 devstack sudo[102601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:05 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-76c80102-ecee-4ea3-add1-3081b469f74f tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2285ab6-c2e6-46a6-9a54-5eb8869a27b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e30c5250-e4fa-4c88-929d-c55692d5ed21', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:05 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-76c80102-ecee-4ea3-add1-3081b469f74f tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (963023ca-2b53-484c-9e2b-243c45516bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:05 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-76c80102-ecee-4ea3-add1-3081b469f74f tempest-CreateVolumesFromSnapshotTest-263089513 None] Volume volume-e30c5250-e4fa-4c88-929d-c55692d5ed21 (e30c5250-e4fa-4c88-929d-c55692d5ed21): created successfully Jul 08 18:54:05 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-76c80102-ecee-4ea3-add1-3081b469f74f tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (963023ca-2b53-484c-9e2b-243c45516bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:05 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-76c80102-ecee-4ea3-add1-3081b469f74f tempest-CreateVolumesFromSnapshotTest-263089513 None] Flow 'volume_create_manager' (d1025e2a-d12a-4683-933f-d4f2c67f644d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:54:05 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-76c80102-ecee-4ea3-add1-3081b469f74f tempest-CreateVolumesFromSnapshotTest-263089513 None] Created volume successfully. Jul 08 18:54:05 devstack sudo[102601]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-65f9c19c-c7d7-4253-9918-58c6fb6caf68 tempest-CreateVolumesFromSnapshotTest-263089513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a484746-2c66-42a5-9cc9-8efc68caff15 1073741824" returned: 0 in 0.829s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-65f9c19c-c7d7-4253-9918-58c6fb6caf68 tempest-CreateVolumesFromSnapshotTest-263089513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a484746-2c66-42a5-9cc9-8efc68caff15 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:06 devstack sudo[102607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a484746-2c66-42a5-9cc9-8efc68caff15 Jul 08 18:54:06 devstack sudo[102607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:06 devstack sudo[102607]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-65f9c19c-c7d7-4253-9918-58c6fb6caf68 tempest-CreateVolumesFromSnapshotTest-263089513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a484746-2c66-42a5-9cc9-8efc68caff15" returned: 0 in 0.673s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:06 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-65f9c19c-c7d7-4253-9918-58c6fb6caf68 tempest-CreateVolumesFromSnapshotTest-263089513 None] <== create_volume: return (1556ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:54:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-65f9c19c-c7d7-4253-9918-58c6fb6caf68 tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.562s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:54:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c9456cff-d4ed-4f13-b34f-f1c491dad1f7 tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.090s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:54:06 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c9456cff-d4ed-4f13-b34f-f1c491dad1f7 tempest-CreateVolumesFromSnapshotTest-263089513 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1043849063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cc0b44c-0b24-41d4-b31f-108cb5636b01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06e3bf046aaa419f9c849c5916630245',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:54:02Z,use_quota=True,user_id='8bd6cfb0628d49caa757396d1b8a0458',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:54:06 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-c9456cff-d4ed-4f13-b34f-f1c491dad1f7 tempest-CreateVolumesFromSnapshotTest-263089513 None] Creating volume 1cc0b44c-0b24-41d4-b31f-108cb5636b01 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:54:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c9456cff-d4ed-4f13-b34f-f1c491dad1f7 tempest-CreateVolumesFromSnapshotTest-263089513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:54:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c9456cff-d4ed-4f13-b34f-f1c491dad1f7 tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:54:06 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c9456cff-d4ed-4f13-b34f-f1c491dad1f7 tempest-CreateVolumesFromSnapshotTest-263089513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:54:06 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c9456cff-d4ed-4f13-b34f-f1c491dad1f7 tempest-CreateVolumesFromSnapshotTest-263089513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:54:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c9456cff-d4ed-4f13-b34f-f1c491dad1f7 tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:54:06 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c9456cff-d4ed-4f13-b34f-f1c491dad1f7 tempest-CreateVolumesFromSnapshotTest-263089513 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:54:06 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-c9456cff-d4ed-4f13-b34f-f1c491dad1f7 tempest-CreateVolumesFromSnapshotTest-263089513 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:54:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c9456cff-d4ed-4f13-b34f-f1c491dad1f7 tempest-CreateVolumesFromSnapshotTest-263089513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-1cc0b44c-0b24-41d4-b31f-108cb5636b01 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:06 devstack sudo[102611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-1cc0b44c-0b24-41d4-b31f-108cb5636b01 1073741824 Jul 08 18:54:06 devstack sudo[102611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:06 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-65f9c19c-c7d7-4253-9918-58c6fb6caf68 tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93a3e709-b8ca-4f3f-b33f-66903359f555) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a484746-2c66-42a5-9cc9-8efc68caff15', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:06 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-65f9c19c-c7d7-4253-9918-58c6fb6caf68 tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0acc384e-40bf-4e52-b97d-72a3d0426cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:06 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-65f9c19c-c7d7-4253-9918-58c6fb6caf68 tempest-CreateVolumesFromSnapshotTest-263089513 None] Volume volume-5a484746-2c66-42a5-9cc9-8efc68caff15 (5a484746-2c66-42a5-9cc9-8efc68caff15): created successfully Jul 08 18:54:06 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-65f9c19c-c7d7-4253-9918-58c6fb6caf68 tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0acc384e-40bf-4e52-b97d-72a3d0426cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:06 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-65f9c19c-c7d7-4253-9918-58c6fb6caf68 tempest-CreateVolumesFromSnapshotTest-263089513 None] Flow 'volume_create_manager' (ea931651-14ab-4e03-968a-ff3a195e5f13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:54:06 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-65f9c19c-c7d7-4253-9918-58c6fb6caf68 tempest-CreateVolumesFromSnapshotTest-263089513 None] Created volume successfully. Jul 08 18:54:07 devstack sudo[102611]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c9456cff-d4ed-4f13-b34f-f1c491dad1f7 tempest-CreateVolumesFromSnapshotTest-263089513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-1cc0b44c-0b24-41d4-b31f-108cb5636b01 1073741824" returned: 0 in 0.840s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c9456cff-d4ed-4f13-b34f-f1c491dad1f7 tempest-CreateVolumesFromSnapshotTest-263089513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-1cc0b44c-0b24-41d4-b31f-108cb5636b01 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:07 devstack sudo[102624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-1cc0b44c-0b24-41d4-b31f-108cb5636b01 Jul 08 18:54:07 devstack sudo[102624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:08 devstack sudo[102624]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c9456cff-d4ed-4f13-b34f-f1c491dad1f7 tempest-CreateVolumesFromSnapshotTest-263089513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-1cc0b44c-0b24-41d4-b31f-108cb5636b01" returned: 0 in 0.644s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:08 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c9456cff-d4ed-4f13-b34f-f1c491dad1f7 tempest-CreateVolumesFromSnapshotTest-263089513 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:54:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c9456cff-d4ed-4f13-b34f-f1c491dad1f7 tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.537s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:54:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-82d61c35-81fe-42c1-aefc-36d631f2379d tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.037s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:54:08 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-82d61c35-81fe-42c1-aefc-36d631f2379d tempest-CreateVolumesFromSnapshotTest-263089513 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1422128828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfc8c405-e243-413a-b7c0-85fa1b93c948,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06e3bf046aaa419f9c849c5916630245',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:54:03Z,use_quota=True,user_id='8bd6cfb0628d49caa757396d1b8a0458',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:54:08 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-82d61c35-81fe-42c1-aefc-36d631f2379d tempest-CreateVolumesFromSnapshotTest-263089513 None] Creating volume dfc8c405-e243-413a-b7c0-85fa1b93c948 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:54:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-82d61c35-81fe-42c1-aefc-36d631f2379d tempest-CreateVolumesFromSnapshotTest-263089513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:54:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-82d61c35-81fe-42c1-aefc-36d631f2379d tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:54:08 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-82d61c35-81fe-42c1-aefc-36d631f2379d tempest-CreateVolumesFromSnapshotTest-263089513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:54:08 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-82d61c35-81fe-42c1-aefc-36d631f2379d tempest-CreateVolumesFromSnapshotTest-263089513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:54:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-82d61c35-81fe-42c1-aefc-36d631f2379d tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:54:08 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-82d61c35-81fe-42c1-aefc-36d631f2379d tempest-CreateVolumesFromSnapshotTest-263089513 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:54:08 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-82d61c35-81fe-42c1-aefc-36d631f2379d tempest-CreateVolumesFromSnapshotTest-263089513 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:54:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-82d61c35-81fe-42c1-aefc-36d631f2379d tempest-CreateVolumesFromSnapshotTest-263089513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-dfc8c405-e243-413a-b7c0-85fa1b93c948 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:08 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c9456cff-d4ed-4f13-b34f-f1c491dad1f7 tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e6cbd17-5e6f-4ef9-9ff0-e4efac660f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cc0b44c-0b24-41d4-b31f-108cb5636b01', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:08 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c9456cff-d4ed-4f13-b34f-f1c491dad1f7 tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c5d5aa6-b224-4262-80d5-1cff6c177fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:08 devstack sudo[102633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-dfc8c405-e243-413a-b7c0-85fa1b93c948 1073741824 Jul 08 18:54:08 devstack sudo[102633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:08 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-c9456cff-d4ed-4f13-b34f-f1c491dad1f7 tempest-CreateVolumesFromSnapshotTest-263089513 None] Volume volume-1cc0b44c-0b24-41d4-b31f-108cb5636b01 (1cc0b44c-0b24-41d4-b31f-108cb5636b01): created successfully Jul 08 18:54:08 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c9456cff-d4ed-4f13-b34f-f1c491dad1f7 tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c5d5aa6-b224-4262-80d5-1cff6c177fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:08 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c9456cff-d4ed-4f13-b34f-f1c491dad1f7 tempest-CreateVolumesFromSnapshotTest-263089513 None] Flow 'volume_create_manager' (6dd19197-216f-4d8e-84d1-26712261eecb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:54:08 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-c9456cff-d4ed-4f13-b34f-f1c491dad1f7 tempest-CreateVolumesFromSnapshotTest-263089513 None] Created volume successfully. Jul 08 18:54:09 devstack sudo[102633]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-82d61c35-81fe-42c1-aefc-36d631f2379d tempest-CreateVolumesFromSnapshotTest-263089513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-dfc8c405-e243-413a-b7c0-85fa1b93c948 1073741824" returned: 0 in 0.891s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-82d61c35-81fe-42c1-aefc-36d631f2379d tempest-CreateVolumesFromSnapshotTest-263089513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-dfc8c405-e243-413a-b7c0-85fa1b93c948 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:09 devstack sudo[102638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-dfc8c405-e243-413a-b7c0-85fa1b93c948 Jul 08 18:54:09 devstack sudo[102638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:09 devstack sudo[102638]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-82d61c35-81fe-42c1-aefc-36d631f2379d tempest-CreateVolumesFromSnapshotTest-263089513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-dfc8c405-e243-413a-b7c0-85fa1b93c948" returned: 0 in 0.724s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:09 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-82d61c35-81fe-42c1-aefc-36d631f2379d tempest-CreateVolumesFromSnapshotTest-263089513 None] <== create_volume: return (1675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:54:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-82d61c35-81fe-42c1-aefc-36d631f2379d tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.680s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:54:09 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-82d61c35-81fe-42c1-aefc-36d631f2379d tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2063bdda-5a8c-4b80-a077-97cd077bb9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfc8c405-e243-413a-b7c0-85fa1b93c948', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:09 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-82d61c35-81fe-42c1-aefc-36d631f2379d tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2af1472-7a5f-40c5-9aae-2c16695a5a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:09 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-82d61c35-81fe-42c1-aefc-36d631f2379d tempest-CreateVolumesFromSnapshotTest-263089513 None] Volume volume-dfc8c405-e243-413a-b7c0-85fa1b93c948 (dfc8c405-e243-413a-b7c0-85fa1b93c948): created successfully Jul 08 18:54:09 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-82d61c35-81fe-42c1-aefc-36d631f2379d tempest-CreateVolumesFromSnapshotTest-263089513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2af1472-7a5f-40c5-9aae-2c16695a5a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:09 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-82d61c35-81fe-42c1-aefc-36d631f2379d tempest-CreateVolumesFromSnapshotTest-263089513 None] Flow 'volume_create_manager' (722b5717-a4cb-4f5c-815e-cb2de594cec2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:54:10 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-82d61c35-81fe-42c1-aefc-36d631f2379d tempest-CreateVolumesFromSnapshotTest-263089513 None] Created volume successfully. Jul 08 18:54:10 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-a5057ba7-b935-4af8-b094-4cbb5941cf31 tempest-CreateVolumesFromSnapshotTest-263089513 None] Acquiring lock "cinder-dfc8c405-e243-413a-b7c0-85fa1b93c948-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:54:10 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-a5057ba7-b935-4af8-b094-4cbb5941cf31 tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "cinder-dfc8c405-e243-413a-b7c0-85fa1b93c948-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:54:10 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-a5057ba7-b935-4af8-b094-4cbb5941cf31 tempest-CreateVolumesFromSnapshotTest-263089513 None] Acquiring lock "cinder-quobyte-dfc8c405-e243-413a-b7c0-85fa1b93c948" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:54:10 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-a5057ba7-b935-4af8-b094-4cbb5941cf31 tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "cinder-quobyte-dfc8c405-e243-413a-b7c0-85fa1b93c948" acquired by "delete_volume" :: waited 0.015s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:54:10 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbdc8812-4bcc-492e-ae04-f20a7340a0f0]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:54:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-a5057ba7-b935-4af8-b094-4cbb5941cf31 tempest-CreateVolumesFromSnapshotTest-263089513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-dfc8c405-e243-413a-b7c0-85fa1b93c948 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:10 devstack sudo[102653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-dfc8c405-e243-413a-b7c0-85fa1b93c948 Jul 08 18:54:10 devstack sudo[102653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:11 devstack sudo[102653]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-a5057ba7-b935-4af8-b094-4cbb5941cf31 tempest-CreateVolumesFromSnapshotTest-263089513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-dfc8c405-e243-413a-b7c0-85fa1b93c948" returned: 0 in 0.763s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-a5057ba7-b935-4af8-b094-4cbb5941cf31 tempest-CreateVolumesFromSnapshotTest-263089513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-dfc8c405-e243-413a-b7c0-85fa1b93c948 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:11 devstack sudo[102658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-dfc8c405-e243-413a-b7c0-85fa1b93c948 Jul 08 18:54:11 devstack sudo[102658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:12 devstack sudo[102658]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-a5057ba7-b935-4af8-b094-4cbb5941cf31 tempest-CreateVolumesFromSnapshotTest-263089513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-dfc8c405-e243-413a-b7c0-85fa1b93c948" returned: 0 in 0.667s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:12 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-a5057ba7-b935-4af8-b094-4cbb5941cf31 tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "cinder-quobyte-dfc8c405-e243-413a-b7c0-85fa1b93c948" released by "delete_volume" :: held 1.469s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:54:12 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-a5057ba7-b935-4af8-b094-4cbb5941cf31 tempest-CreateVolumesFromSnapshotTest-263089513 None] Created reservations ['46c0c26f-a17c-4e1c-bf3c-1eab4e80000d', '4a39ba42-d6da-4493-99b1-044617b4be85', '33989e53-dd68-4d0c-8017-7f3df66f06a9', '0961d7ad-997a-4375-994f-b43994316e52'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:54:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-a5057ba7-b935-4af8-b094-4cbb5941cf31 tempest-CreateVolumesFromSnapshotTest-263089513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:54:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-a5057ba7-b935-4af8-b094-4cbb5941cf31 tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:54:12 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-a5057ba7-b935-4af8-b094-4cbb5941cf31 tempest-CreateVolumesFromSnapshotTest-263089513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:54:12 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-a5057ba7-b935-4af8-b094-4cbb5941cf31 tempest-CreateVolumesFromSnapshotTest-263089513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:54:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-a5057ba7-b935-4af8-b094-4cbb5941cf31 tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:54:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-a5057ba7-b935-4af8-b094-4cbb5941cf31 tempest-CreateVolumesFromSnapshotTest-263089513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:12 devstack sudo[102661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:54:12 devstack sudo[102661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:12 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-84d96c2a-fb46-4d0b-be3d-26ac611e9f22 tempest-CreateVolumesFromSnapshotTest-263089513 None] Acquiring lock "cinder-1cc0b44c-0b24-41d4-b31f-108cb5636b01-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:54:12 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-84d96c2a-fb46-4d0b-be3d-26ac611e9f22 tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "cinder-1cc0b44c-0b24-41d4-b31f-108cb5636b01-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:54:12 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-84d96c2a-fb46-4d0b-be3d-26ac611e9f22 tempest-CreateVolumesFromSnapshotTest-263089513 None] Acquiring lock "cinder-quobyte-1cc0b44c-0b24-41d4-b31f-108cb5636b01" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:54:12 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-84d96c2a-fb46-4d0b-be3d-26ac611e9f22 tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "cinder-quobyte-1cc0b44c-0b24-41d4-b31f-108cb5636b01" acquired by "delete_volume" :: waited 0.018s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:54:12 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb6a3f3-62fb-450c-956d-cb02f24bc26a]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:54:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-84d96c2a-fb46-4d0b-be3d-26ac611e9f22 tempest-CreateVolumesFromSnapshotTest-263089513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-1cc0b44c-0b24-41d4-b31f-108cb5636b01 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:13 devstack sudo[102661]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-a5057ba7-b935-4af8-b094-4cbb5941cf31 tempest-CreateVolumesFromSnapshotTest-263089513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.737s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:13 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-a5057ba7-b935-4af8-b094-4cbb5941cf31 tempest-CreateVolumesFromSnapshotTest-263089513 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:54:13 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-a5057ba7-b935-4af8-b094-4cbb5941cf31 tempest-CreateVolumesFromSnapshotTest-263089513 None] Deleted volume successfully. Jul 08 18:54:13 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-a5057ba7-b935-4af8-b094-4cbb5941cf31 tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "cinder-dfc8c405-e243-413a-b7c0-85fa1b93c948-delete_volume" released by "delete_volume" :: held 2.401s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:54:13 devstack sudo[102665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-1cc0b44c-0b24-41d4-b31f-108cb5636b01 Jul 08 18:54:13 devstack sudo[102665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:13 devstack sudo[102665]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-84d96c2a-fb46-4d0b-be3d-26ac611e9f22 tempest-CreateVolumesFromSnapshotTest-263089513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-1cc0b44c-0b24-41d4-b31f-108cb5636b01" returned: 0 in 0.776s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-84d96c2a-fb46-4d0b-be3d-26ac611e9f22 tempest-CreateVolumesFromSnapshotTest-263089513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-1cc0b44c-0b24-41d4-b31f-108cb5636b01 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:13 devstack sudo[102670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-1cc0b44c-0b24-41d4-b31f-108cb5636b01 Jul 08 18:54:13 devstack sudo[102670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:14 devstack sudo[102670]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-84d96c2a-fb46-4d0b-be3d-26ac611e9f22 tempest-CreateVolumesFromSnapshotTest-263089513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-1cc0b44c-0b24-41d4-b31f-108cb5636b01" returned: 0 in 0.708s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:14 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-84d96c2a-fb46-4d0b-be3d-26ac611e9f22 tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "cinder-quobyte-1cc0b44c-0b24-41d4-b31f-108cb5636b01" released by "delete_volume" :: held 1.527s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:54:14 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-84d96c2a-fb46-4d0b-be3d-26ac611e9f22 tempest-CreateVolumesFromSnapshotTest-263089513 None] Created reservations ['ba561a24-2134-49d5-8d0b-7c62b356b710', '2e5fdc94-502e-426e-802b-f3d7a58dcf16', '2965c609-a783-4b11-b3d2-8d2441a285d4', 'ff826629-5f15-4aa4-9b39-54e32d02bf46'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:54:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-84d96c2a-fb46-4d0b-be3d-26ac611e9f22 tempest-CreateVolumesFromSnapshotTest-263089513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:54:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-84d96c2a-fb46-4d0b-be3d-26ac611e9f22 tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:54:14 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-84d96c2a-fb46-4d0b-be3d-26ac611e9f22 tempest-CreateVolumesFromSnapshotTest-263089513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:54:14 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-84d96c2a-fb46-4d0b-be3d-26ac611e9f22 tempest-CreateVolumesFromSnapshotTest-263089513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:54:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-84d96c2a-fb46-4d0b-be3d-26ac611e9f22 tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:54:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-84d96c2a-fb46-4d0b-be3d-26ac611e9f22 tempest-CreateVolumesFromSnapshotTest-263089513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:14 devstack sudo[102673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:54:14 devstack sudo[102673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:15 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-39dc566b-3736-4e89-a52b-fafb0b749f1e tempest-CreateVolumesFromSnapshotTest-263089513 None] Acquiring lock "cinder-5a484746-2c66-42a5-9cc9-8efc68caff15-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:54:15 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-39dc566b-3736-4e89-a52b-fafb0b749f1e tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "cinder-5a484746-2c66-42a5-9cc9-8efc68caff15-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:54:15 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-39dc566b-3736-4e89-a52b-fafb0b749f1e tempest-CreateVolumesFromSnapshotTest-263089513 None] Acquiring lock "cinder-quobyte-5a484746-2c66-42a5-9cc9-8efc68caff15" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:54:15 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-39dc566b-3736-4e89-a52b-fafb0b749f1e tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "cinder-quobyte-5a484746-2c66-42a5-9cc9-8efc68caff15" acquired by "delete_volume" :: waited 0.015s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:54:15 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b79109e-554f-4500-85d5-e58a491da7dd]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:54:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-39dc566b-3736-4e89-a52b-fafb0b749f1e tempest-CreateVolumesFromSnapshotTest-263089513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a484746-2c66-42a5-9cc9-8efc68caff15 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:15 devstack sudo[102673]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-84d96c2a-fb46-4d0b-be3d-26ac611e9f22 tempest-CreateVolumesFromSnapshotTest-263089513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.699s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:15 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-84d96c2a-fb46-4d0b-be3d-26ac611e9f22 tempest-CreateVolumesFromSnapshotTest-263089513 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:54:15 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-84d96c2a-fb46-4d0b-be3d-26ac611e9f22 tempest-CreateVolumesFromSnapshotTest-263089513 None] Deleted volume successfully. Jul 08 18:54:15 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-84d96c2a-fb46-4d0b-be3d-26ac611e9f22 tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "cinder-1cc0b44c-0b24-41d4-b31f-108cb5636b01-delete_volume" released by "delete_volume" :: held 2.425s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:54:15 devstack sudo[102676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a484746-2c66-42a5-9cc9-8efc68caff15 Jul 08 18:54:15 devstack sudo[102676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:16 devstack sudo[102676]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-39dc566b-3736-4e89-a52b-fafb0b749f1e tempest-CreateVolumesFromSnapshotTest-263089513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a484746-2c66-42a5-9cc9-8efc68caff15" returned: 0 in 0.757s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-39dc566b-3736-4e89-a52b-fafb0b749f1e tempest-CreateVolumesFromSnapshotTest-263089513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a484746-2c66-42a5-9cc9-8efc68caff15 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:16 devstack sudo[102681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a484746-2c66-42a5-9cc9-8efc68caff15 Jul 08 18:54:16 devstack sudo[102681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:16 devstack sudo[102681]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-39dc566b-3736-4e89-a52b-fafb0b749f1e tempest-CreateVolumesFromSnapshotTest-263089513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a484746-2c66-42a5-9cc9-8efc68caff15" returned: 0 in 0.664s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:16 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-39dc566b-3736-4e89-a52b-fafb0b749f1e tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "cinder-quobyte-5a484746-2c66-42a5-9cc9-8efc68caff15" released by "delete_volume" :: held 1.462s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:54:16 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-39dc566b-3736-4e89-a52b-fafb0b749f1e tempest-CreateVolumesFromSnapshotTest-263089513 None] Created reservations ['221bc0fc-e89e-45b7-b39f-461c97979d8c', 'cf664e1d-87f3-4c96-9581-318fc8df35be', '383b231f-0ed6-4615-b631-a3e00424cf8a', 'a1a4692d-1d62-4945-a537-53cae2ca189b'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:54:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-39dc566b-3736-4e89-a52b-fafb0b749f1e tempest-CreateVolumesFromSnapshotTest-263089513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:54:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-39dc566b-3736-4e89-a52b-fafb0b749f1e tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:54:16 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-39dc566b-3736-4e89-a52b-fafb0b749f1e tempest-CreateVolumesFromSnapshotTest-263089513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:54:16 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-39dc566b-3736-4e89-a52b-fafb0b749f1e tempest-CreateVolumesFromSnapshotTest-263089513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:54:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-39dc566b-3736-4e89-a52b-fafb0b749f1e tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:54:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-39dc566b-3736-4e89-a52b-fafb0b749f1e tempest-CreateVolumesFromSnapshotTest-263089513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:16 devstack sudo[102690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:54:16 devstack sudo[102690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:17 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-d69e5220-ad08-49e1-8b54-08c27eace83a tempest-CreateVolumesFromSnapshotTest-263089513 None] Acquiring lock "cinder-e30c5250-e4fa-4c88-929d-c55692d5ed21-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:54:17 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-d69e5220-ad08-49e1-8b54-08c27eace83a tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "cinder-e30c5250-e4fa-4c88-929d-c55692d5ed21-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:54:17 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-d69e5220-ad08-49e1-8b54-08c27eace83a tempest-CreateVolumesFromSnapshotTest-263089513 None] Acquiring lock "cinder-quobyte-e30c5250-e4fa-4c88-929d-c55692d5ed21" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:54:17 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-d69e5220-ad08-49e1-8b54-08c27eace83a tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "cinder-quobyte-e30c5250-e4fa-4c88-929d-c55692d5ed21" acquired by "delete_volume" :: waited 0.014s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:54:17 devstack sudo[102690]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-39dc566b-3736-4e89-a52b-fafb0b749f1e tempest-CreateVolumesFromSnapshotTest-263089513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.695s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:17 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-39dc566b-3736-4e89-a52b-fafb0b749f1e tempest-CreateVolumesFromSnapshotTest-263089513 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:54:17 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d4e470-d44c-4b66-8f68-25a21c85d626]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:54:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d69e5220-ad08-49e1-8b54-08c27eace83a tempest-CreateVolumesFromSnapshotTest-263089513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e30c5250-e4fa-4c88-929d-c55692d5ed21 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:17 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-39dc566b-3736-4e89-a52b-fafb0b749f1e tempest-CreateVolumesFromSnapshotTest-263089513 None] Deleted volume successfully. Jul 08 18:54:17 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-39dc566b-3736-4e89-a52b-fafb0b749f1e tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "cinder-5a484746-2c66-42a5-9cc9-8efc68caff15-delete_volume" released by "delete_volume" :: held 2.362s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:54:17 devstack sudo[102693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e30c5250-e4fa-4c88-929d-c55692d5ed21 Jul 08 18:54:17 devstack sudo[102693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:18 devstack sudo[102693]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d69e5220-ad08-49e1-8b54-08c27eace83a tempest-CreateVolumesFromSnapshotTest-263089513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e30c5250-e4fa-4c88-929d-c55692d5ed21" returned: 0 in 0.784s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d69e5220-ad08-49e1-8b54-08c27eace83a tempest-CreateVolumesFromSnapshotTest-263089513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e30c5250-e4fa-4c88-929d-c55692d5ed21 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:18 devstack sudo[102700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e30c5250-e4fa-4c88-929d-c55692d5ed21 Jul 08 18:54:18 devstack sudo[102700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:18 devstack sudo[102700]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d69e5220-ad08-49e1-8b54-08c27eace83a tempest-CreateVolumesFromSnapshotTest-263089513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e30c5250-e4fa-4c88-929d-c55692d5ed21" returned: 0 in 0.651s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:18 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-d69e5220-ad08-49e1-8b54-08c27eace83a tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "cinder-quobyte-e30c5250-e4fa-4c88-929d-c55692d5ed21" released by "delete_volume" :: held 1.477s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:54:18 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-d69e5220-ad08-49e1-8b54-08c27eace83a tempest-CreateVolumesFromSnapshotTest-263089513 None] Created reservations ['e995e9ff-7e3f-431c-bd01-55c5f64477cb', '137056b0-b4f1-4873-9a37-4f6e22742ae9', 'b573e9e1-ca11-49b1-b423-c728e5e3f583', '718291cb-cd29-41f2-a222-3f92da8b2abe'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:54:19 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-d69e5220-ad08-49e1-8b54-08c27eace83a tempest-CreateVolumesFromSnapshotTest-263089513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:54:19 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-d69e5220-ad08-49e1-8b54-08c27eace83a tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:54:19 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-d69e5220-ad08-49e1-8b54-08c27eace83a tempest-CreateVolumesFromSnapshotTest-263089513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:54:19 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-d69e5220-ad08-49e1-8b54-08c27eace83a tempest-CreateVolumesFromSnapshotTest-263089513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:54:19 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-d69e5220-ad08-49e1-8b54-08c27eace83a tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:54:19 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d69e5220-ad08-49e1-8b54-08c27eace83a tempest-CreateVolumesFromSnapshotTest-263089513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:19 devstack sudo[102703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:54:19 devstack sudo[102703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:19 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-1afef198-0d4c-49b8-8654-ec82709daf24 tempest-CreateVolumesFromSnapshotTest-263089513 None] Acquiring lock "cinder-aca87f71-67c3-4ba1-b652-b28d2f035d47-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:54:19 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-1afef198-0d4c-49b8-8654-ec82709daf24 tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "cinder-aca87f71-67c3-4ba1-b652-b28d2f035d47-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:54:19 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-1afef198-0d4c-49b8-8654-ec82709daf24 tempest-CreateVolumesFromSnapshotTest-263089513 None] Acquiring lock "cinder-quobyte-aca87f71-67c3-4ba1-b652-b28d2f035d47" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:54:19 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-1afef198-0d4c-49b8-8654-ec82709daf24 tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "cinder-quobyte-aca87f71-67c3-4ba1-b652-b28d2f035d47" acquired by "delete_volume" :: waited 0.016s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:54:19 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[69545548-c79d-4e44-9892-9529efff5963]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:54:19 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1afef198-0d4c-49b8-8654-ec82709daf24 tempest-CreateVolumesFromSnapshotTest-263089513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aca87f71-67c3-4ba1-b652-b28d2f035d47 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:19 devstack sudo[102703]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:19 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d69e5220-ad08-49e1-8b54-08c27eace83a tempest-CreateVolumesFromSnapshotTest-263089513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.660s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:19 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-d69e5220-ad08-49e1-8b54-08c27eace83a tempest-CreateVolumesFromSnapshotTest-263089513 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:54:19 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-d69e5220-ad08-49e1-8b54-08c27eace83a tempest-CreateVolumesFromSnapshotTest-263089513 None] Deleted volume successfully. Jul 08 18:54:19 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-d69e5220-ad08-49e1-8b54-08c27eace83a tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "cinder-e30c5250-e4fa-4c88-929d-c55692d5ed21-delete_volume" released by "delete_volume" :: held 2.345s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:54:19 devstack sudo[102707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aca87f71-67c3-4ba1-b652-b28d2f035d47 Jul 08 18:54:19 devstack sudo[102707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:20 devstack sudo[102707]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1afef198-0d4c-49b8-8654-ec82709daf24 tempest-CreateVolumesFromSnapshotTest-263089513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aca87f71-67c3-4ba1-b652-b28d2f035d47" returned: 0 in 0.755s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1afef198-0d4c-49b8-8654-ec82709daf24 tempest-CreateVolumesFromSnapshotTest-263089513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aca87f71-67c3-4ba1-b652-b28d2f035d47 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:20 devstack sudo[102712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aca87f71-67c3-4ba1-b652-b28d2f035d47 Jul 08 18:54:20 devstack sudo[102712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:21 devstack sudo[102712]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1afef198-0d4c-49b8-8654-ec82709daf24 tempest-CreateVolumesFromSnapshotTest-263089513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-aca87f71-67c3-4ba1-b652-b28d2f035d47" returned: 0 in 0.655s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:21 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-1afef198-0d4c-49b8-8654-ec82709daf24 tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "cinder-quobyte-aca87f71-67c3-4ba1-b652-b28d2f035d47" released by "delete_volume" :: held 1.460s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:54:21 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-1afef198-0d4c-49b8-8654-ec82709daf24 tempest-CreateVolumesFromSnapshotTest-263089513 None] Created reservations ['2c155a65-7a9f-4b59-9292-2d5103b11e8a', '20c4c1aa-ee34-459e-81e4-3ab57a3c4b2b', '55d592b8-1164-49fa-a6e9-9f47ce2b34a9', '1aea6d54-e277-4748-b388-2d2f04a8998e'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:54:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1afef198-0d4c-49b8-8654-ec82709daf24 tempest-CreateVolumesFromSnapshotTest-263089513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:54:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1afef198-0d4c-49b8-8654-ec82709daf24 tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:54:21 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-1afef198-0d4c-49b8-8654-ec82709daf24 tempest-CreateVolumesFromSnapshotTest-263089513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:54:21 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-1afef198-0d4c-49b8-8654-ec82709daf24 tempest-CreateVolumesFromSnapshotTest-263089513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:54:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1afef198-0d4c-49b8-8654-ec82709daf24 tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:54:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1afef198-0d4c-49b8-8654-ec82709daf24 tempest-CreateVolumesFromSnapshotTest-263089513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:21 devstack sudo[102715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:54:21 devstack sudo[102715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:21 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ad50c3a2-41c3-4c9f-8a0b-eade892aea9f tempest-CreateVolumesFromSnapshotTest-263089513 None] Acquiring lock "cinder-3d825930-85b3-469a-a39b-4f28f368c488-delete_snapshot" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:54:21 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ad50c3a2-41c3-4c9f-8a0b-eade892aea9f tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "cinder-3d825930-85b3-469a-a39b-4f28f368c488-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:54:21 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ad50c3a2-41c3-4c9f-8a0b-eade892aea9f tempest-CreateVolumesFromSnapshotTest-263089513 None] Acquiring lock "cinder-quobyte-90c8b569-59ab-4319-bf82-91559fd82133" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:54:21 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ad50c3a2-41c3-4c9f-8a0b-eade892aea9f tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "cinder-quobyte-90c8b569-59ab-4319-bf82-91559fd82133" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:54:21 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ad50c3a2-41c3-4c9f-8a0b-eade892aea9f tempest-CreateVolumesFromSnapshotTest-263089513 None] Acquiring lock "cinder-quobyte-3d825930-85b3-469a-a39b-4f28f368c488" by "_delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:54:21 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ad50c3a2-41c3-4c9f-8a0b-eade892aea9f tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "cinder-quobyte-3d825930-85b3-469a-a39b-4f28f368c488" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:54:21 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-ad50c3a2-41c3-4c9f-8a0b-eade892aea9f tempest-CreateVolumesFromSnapshotTest-263089513 None] Deleting offline snapshot 3d825930-85b3-469a-a39b-4f28f368c488 of volume 90c8b569-59ab-4319-bf82-91559fd82133 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:54:21 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-ad50c3a2-41c3-4c9f-8a0b-eade892aea9f tempest-CreateVolumesFromSnapshotTest-263089513 None] snapshot_file for this snap is: volume-90c8b569-59ab-4319-bf82-91559fd82133.3d825930-85b3-469a-a39b-4f28f368c488 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:54:21 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[1272a410-3275-434a-ba28-d24539d0ff81]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:54:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ad50c3a2-41c3-4c9f-8a0b-eade892aea9f tempest-CreateVolumesFromSnapshotTest-263089513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-90c8b569-59ab-4319-bf82-91559fd82133.3d825930-85b3-469a-a39b-4f28f368c488 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:22 devstack sudo[102715]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1afef198-0d4c-49b8-8654-ec82709daf24 tempest-CreateVolumesFromSnapshotTest-263089513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.741s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:22 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-1afef198-0d4c-49b8-8654-ec82709daf24 tempest-CreateVolumesFromSnapshotTest-263089513 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:54:22 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-1afef198-0d4c-49b8-8654-ec82709daf24 tempest-CreateVolumesFromSnapshotTest-263089513 None] Deleted volume successfully. Jul 08 18:54:22 devstack sudo[102718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-90c8b569-59ab-4319-bf82-91559fd82133.3d825930-85b3-469a-a39b-4f28f368c488 Jul 08 18:54:22 devstack sudo[102718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:22 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-1afef198-0d4c-49b8-8654-ec82709daf24 tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "cinder-aca87f71-67c3-4ba1-b652-b28d2f035d47-delete_volume" released by "delete_volume" :: held 2.434s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:54:22 devstack sudo[102718]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ad50c3a2-41c3-4c9f-8a0b-eade892aea9f tempest-CreateVolumesFromSnapshotTest-263089513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-90c8b569-59ab-4319-bf82-91559fd82133.3d825930-85b3-469a-a39b-4f28f368c488" returned: 0 in 0.790s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:22 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-ad50c3a2-41c3-4c9f-8a0b-eade892aea9f tempest-CreateVolumesFromSnapshotTest-263089513 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90c8b569-59ab-4319-bf82-91559fd82133(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:54:22 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[940900a8-fa81-4cc8-ad08-13d4b58bf666]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:54:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ad50c3a2-41c3-4c9f-8a0b-eade892aea9f tempest-CreateVolumesFromSnapshotTest-263089513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-90c8b569-59ab-4319-bf82-91559fd82133 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:22 devstack sudo[102724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-90c8b569-59ab-4319-bf82-91559fd82133 Jul 08 18:54:22 devstack sudo[102724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:23 devstack sudo[102724]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ad50c3a2-41c3-4c9f-8a0b-eade892aea9f tempest-CreateVolumesFromSnapshotTest-263089513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-90c8b569-59ab-4319-bf82-91559fd82133" returned: 0 in 0.744s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ad50c3a2-41c3-4c9f-8a0b-eade892aea9f tempest-CreateVolumesFromSnapshotTest-263089513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-90c8b569-59ab-4319-bf82-91559fd82133.3d825930-85b3-469a-a39b-4f28f368c488 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:23 devstack sudo[102730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-90c8b569-59ab-4319-bf82-91559fd82133.3d825930-85b3-469a-a39b-4f28f368c488 Jul 08 18:54:23 devstack sudo[102730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:24 devstack sudo[102730]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ad50c3a2-41c3-4c9f-8a0b-eade892aea9f tempest-CreateVolumesFromSnapshotTest-263089513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-90c8b569-59ab-4319-bf82-91559fd82133.3d825930-85b3-469a-a39b-4f28f368c488" returned: 0 in 0.734s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ad50c3a2-41c3-4c9f-8a0b-eade892aea9f tempest-CreateVolumesFromSnapshotTest-263089513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-90c8b569-59ab-4319-bf82-91559fd82133.3d825930-85b3-469a-a39b-4f28f368c488 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:24 devstack sudo[102739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-90c8b569-59ab-4319-bf82-91559fd82133.3d825930-85b3-469a-a39b-4f28f368c488 Jul 08 18:54:24 devstack sudo[102739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:24 devstack sudo[102739]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ad50c3a2-41c3-4c9f-8a0b-eade892aea9f tempest-CreateVolumesFromSnapshotTest-263089513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-90c8b569-59ab-4319-bf82-91559fd82133.3d825930-85b3-469a-a39b-4f28f368c488" returned: 0 in 0.644s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:24 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ad50c3a2-41c3-4c9f-8a0b-eade892aea9f tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "cinder-quobyte-3d825930-85b3-469a-a39b-4f28f368c488" released by "_delete_snapshot" :: held 3.018s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:54:24 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ad50c3a2-41c3-4c9f-8a0b-eade892aea9f tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "cinder-quobyte-90c8b569-59ab-4319-bf82-91559fd82133" released by "delete_snapshot" :: held 3.042s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:54:24 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-ad50c3a2-41c3-4c9f-8a0b-eade892aea9f tempest-CreateVolumesFromSnapshotTest-263089513 None] Created reservations ['326c1408-b44e-44ce-a76b-f0678189dc78', '033e8e4a-f25f-425c-af43-88290019ff47', 'af900f3e-35d4-4426-ae74-315edde96ede', '915b4cb5-7d2c-4e45-acf0-5394c3b90f99'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:54:25 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-ad50c3a2-41c3-4c9f-8a0b-eade892aea9f tempest-CreateVolumesFromSnapshotTest-263089513 None] Delete snapshot completed successfully. Jul 08 18:54:25 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ad50c3a2-41c3-4c9f-8a0b-eade892aea9f tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "cinder-3d825930-85b3-469a-a39b-4f28f368c488-delete_snapshot" released by "delete_snapshot" :: held 3.175s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:54:26 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-48ac5200-5ef7-4630-bf14-f899ed4a11a8 tempest-CreateVolumesFromSnapshotTest-263089513 None] Acquiring lock "cinder-90c8b569-59ab-4319-bf82-91559fd82133-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:54:26 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-48ac5200-5ef7-4630-bf14-f899ed4a11a8 tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "cinder-90c8b569-59ab-4319-bf82-91559fd82133-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:54:26 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-48ac5200-5ef7-4630-bf14-f899ed4a11a8 tempest-CreateVolumesFromSnapshotTest-263089513 None] Acquiring lock "cinder-quobyte-90c8b569-59ab-4319-bf82-91559fd82133" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:54:26 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-48ac5200-5ef7-4630-bf14-f899ed4a11a8 tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "cinder-quobyte-90c8b569-59ab-4319-bf82-91559fd82133" acquired by "delete_volume" :: waited 0.013s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:54:26 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[977ffdc2-364d-4aea-8db7-79f68432791c]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:54:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-48ac5200-5ef7-4630-bf14-f899ed4a11a8 tempest-CreateVolumesFromSnapshotTest-263089513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-90c8b569-59ab-4319-bf82-91559fd82133 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:26 devstack sudo[102745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-90c8b569-59ab-4319-bf82-91559fd82133 Jul 08 18:54:26 devstack sudo[102745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:26 devstack sudo[102745]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-48ac5200-5ef7-4630-bf14-f899ed4a11a8 tempest-CreateVolumesFromSnapshotTest-263089513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-90c8b569-59ab-4319-bf82-91559fd82133" returned: 0 in 0.767s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-48ac5200-5ef7-4630-bf14-f899ed4a11a8 tempest-CreateVolumesFromSnapshotTest-263089513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-90c8b569-59ab-4319-bf82-91559fd82133 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:26 devstack sudo[102750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-90c8b569-59ab-4319-bf82-91559fd82133 Jul 08 18:54:26 devstack sudo[102750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:27 devstack sudo[102750]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-48ac5200-5ef7-4630-bf14-f899ed4a11a8 tempest-CreateVolumesFromSnapshotTest-263089513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-90c8b569-59ab-4319-bf82-91559fd82133" returned: 0 in 0.679s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:27 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-48ac5200-5ef7-4630-bf14-f899ed4a11a8 tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "cinder-quobyte-90c8b569-59ab-4319-bf82-91559fd82133" released by "delete_volume" :: held 1.519s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:54:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-7f98fff8-be83-4459-8360-f5425e2f8eb9 req-db1bf8ad-493e-47e4-b119-6f1164c7177c tempest-TestStampPattern-552338204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:54:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-7f98fff8-be83-4459-8360-f5425e2f8eb9 req-db1bf8ad-493e-47e4-b119-6f1164c7177c tempest-TestStampPattern-552338204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:54:27 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9507cc0-d39c-4acd-8d2c-9090d03c6e5e]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:54:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-7f98fff8-be83-4459-8360-f5425e2f8eb9 req-db1bf8ad-493e-47e4-b119-6f1164c7177c tempest-TestStampPattern-552338204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-48a4fbb0-6f9d-43db-a344-d9848388f786 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:27 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-48ac5200-5ef7-4630-bf14-f899ed4a11a8 tempest-CreateVolumesFromSnapshotTest-263089513 None] Created reservations ['990a2b0e-5fdd-4377-b303-33e406092953', '2fcb9108-73ad-48a9-96f6-a34a37e247af', 'fec9acc0-f0ed-44de-a6b8-2e6c30c39985', '4237d204-d666-4555-88d6-3afb6c6102d8'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:54:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-48ac5200-5ef7-4630-bf14-f899ed4a11a8 tempest-CreateVolumesFromSnapshotTest-263089513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:54:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-48ac5200-5ef7-4630-bf14-f899ed4a11a8 tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:54:27 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-48ac5200-5ef7-4630-bf14-f899ed4a11a8 tempest-CreateVolumesFromSnapshotTest-263089513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:54:27 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-48ac5200-5ef7-4630-bf14-f899ed4a11a8 tempest-CreateVolumesFromSnapshotTest-263089513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:54:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-48ac5200-5ef7-4630-bf14-f899ed4a11a8 tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:54:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-48ac5200-5ef7-4630-bf14-f899ed4a11a8 tempest-CreateVolumesFromSnapshotTest-263089513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:27 devstack sudo[102761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-48a4fbb0-6f9d-43db-a344-d9848388f786 Jul 08 18:54:27 devstack sudo[102761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:27 devstack sudo[102762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:54:27 devstack sudo[102762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:28 devstack sudo[102762]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-48ac5200-5ef7-4630-bf14-f899ed4a11a8 tempest-CreateVolumesFromSnapshotTest-263089513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.670s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:28 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-48ac5200-5ef7-4630-bf14-f899ed4a11a8 tempest-CreateVolumesFromSnapshotTest-263089513 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:54:28 devstack sudo[102761]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:28 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-48ac5200-5ef7-4630-bf14-f899ed4a11a8 tempest-CreateVolumesFromSnapshotTest-263089513 None] Deleted volume successfully. Jul 08 18:54:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [req-7f98fff8-be83-4459-8360-f5425e2f8eb9 req-db1bf8ad-493e-47e4-b119-6f1164c7177c tempest-TestStampPattern-552338204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-48a4fbb0-6f9d-43db-a344-d9848388f786" returned: 0 in 0.794s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [req-7f98fff8-be83-4459-8360-f5425e2f8eb9 req-db1bf8ad-493e-47e4-b119-6f1164c7177c tempest-TestStampPattern-552338204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.814s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:54:28 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-48ac5200-5ef7-4630-bf14-f899ed4a11a8 tempest-CreateVolumesFromSnapshotTest-263089513 None] Lock "cinder-90c8b569-59ab-4319-bf82-91559fd82133-delete_volume" released by "delete_volume" :: held 2.420s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:54:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-7f98fff8-be83-4459-8360-f5425e2f8eb9 req-db1bf8ad-493e-47e4-b119-6f1164c7177c tempest-TestStampPattern-552338204 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2', 'name': 'volume-48a4fbb0-6f9d-43db-a344-d9848388f786', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bf5605b4-a3af-4d83-a477-2f203fea655f', 'enforce_multipath': True} {{(pid=86873) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 18:54:28 devstack cinder-volume[86873]: INFO cinder.volume.manager [req-7f98fff8-be83-4459-8360-f5425e2f8eb9 req-db1bf8ad-493e-47e4-b119-6f1164c7177c tempest-TestStampPattern-552338204 None] attachment_update completed successfully. Jul 08 18:54:34 devstack cinder-volume[86873]: INFO cinder.volume.manager [req-7cd053f7-8064-4ef7-96e0-29b8d2dde4cd req-b0c5cf4f-d14f-4bc8-baef-16afac2718a3 tempest-TestStampPattern-552338204 None] Terminate volume connection completed successfully. Jul 08 18:54:34 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [req-7cd053f7-8064-4ef7-96e0-29b8d2dde4cd req-b0c5cf4f-d14f-4bc8-baef-16afac2718a3 tempest-TestStampPattern-552338204 None] Deleting attachment bf5605b4-a3af-4d83-a477-2f203fea655f. {{(pid=86873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 18:54:36 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cdbf2ef-b86b-4c7a-9076-19a1808b6a43 tempest-ProjectReaderTests-1380058734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:54:36 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-9cdbf2ef-b86b-4c7a-9076-19a1808b6a43 tempest-ProjectReaderTests-1380058734 None] Flow 'volume_create_manager' (b23015f1-69df-4fef-ac57-77369e167f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:54:36 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-9cdbf2ef-b86b-4c7a-9076-19a1808b6a43 tempest-ProjectReaderTests-1380058734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d847595-f324-4346-a2b0-dc37f17c8625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:36 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-9cdbf2ef-b86b-4c7a-9076-19a1808b6a43 tempest-ProjectReaderTests-1380058734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d847595-f324-4346-a2b0-dc37f17c8625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:54:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2029869835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=901b163d-c4dc-42b0-a68b-22e5a11eee27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2586ce51ba8e4d2a841171043bf35203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:54:36Z,use_quota=True,user_id='a0febf8f52ee49618facf3dadb0085c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:36 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-9cdbf2ef-b86b-4c7a-9076-19a1808b6a43 tempest-ProjectReaderTests-1380058734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07bf0f27-22a1-47b2-8466-f9a1bb5e0d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:36 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-9cdbf2ef-b86b-4c7a-9076-19a1808b6a43 tempest-ProjectReaderTests-1380058734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07bf0f27-22a1-47b2-8466-f9a1bb5e0d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:36 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-9cdbf2ef-b86b-4c7a-9076-19a1808b6a43 tempest-ProjectReaderTests-1380058734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d34dfd5-4466-4bd1-98f3-1dbe685ee272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:36 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-9cdbf2ef-b86b-4c7a-9076-19a1808b6a43 tempest-ProjectReaderTests-1380058734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d34dfd5-4466-4bd1-98f3-1dbe685ee272) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '901b163d-c4dc-42b0-a68b-22e5a11eee27', 'volume_name': 'volume-901b163d-c4dc-42b0-a68b-22e5a11eee27', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:36 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-9cdbf2ef-b86b-4c7a-9076-19a1808b6a43 tempest-ProjectReaderTests-1380058734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87838624-5904-4fb4-9bec-731a9eae9ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:36 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-9cdbf2ef-b86b-4c7a-9076-19a1808b6a43 tempest-ProjectReaderTests-1380058734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87838624-5904-4fb4-9bec-731a9eae9ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:36 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-9cdbf2ef-b86b-4c7a-9076-19a1808b6a43 tempest-ProjectReaderTests-1380058734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b65e1a9b-d809-4151-ae3c-5c5b33dffb39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:36 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-9cdbf2ef-b86b-4c7a-9076-19a1808b6a43 tempest-ProjectReaderTests-1380058734 None] Volume 901b163d-c4dc-42b0-a68b-22e5a11eee27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-901b163d-c4dc-42b0-a68b-22e5a11eee27', 'volume_size': 1} Jul 08 18:54:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-9cdbf2ef-b86b-4c7a-9076-19a1808b6a43 tempest-ProjectReaderTests-1380058734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:54:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-9cdbf2ef-b86b-4c7a-9076-19a1808b6a43 tempest-ProjectReaderTests-1380058734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:54:36 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-9cdbf2ef-b86b-4c7a-9076-19a1808b6a43 tempest-ProjectReaderTests-1380058734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:54:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2029869835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=901b163d-c4dc-42b0-a68b-22e5a11eee27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2586ce51ba8e4d2a841171043bf35203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:54:36Z,use_quota=True,user_id='a0febf8f52ee49618facf3dadb0085c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:54:36 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-9cdbf2ef-b86b-4c7a-9076-19a1808b6a43 tempest-ProjectReaderTests-1380058734 None] Creating volume 901b163d-c4dc-42b0-a68b-22e5a11eee27 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:54:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-9cdbf2ef-b86b-4c7a-9076-19a1808b6a43 tempest-ProjectReaderTests-1380058734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:54:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-9cdbf2ef-b86b-4c7a-9076-19a1808b6a43 tempest-ProjectReaderTests-1380058734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:54:36 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-9cdbf2ef-b86b-4c7a-9076-19a1808b6a43 tempest-ProjectReaderTests-1380058734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:54:36 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-9cdbf2ef-b86b-4c7a-9076-19a1808b6a43 tempest-ProjectReaderTests-1380058734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:54:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-9cdbf2ef-b86b-4c7a-9076-19a1808b6a43 tempest-ProjectReaderTests-1380058734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:54:36 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-9cdbf2ef-b86b-4c7a-9076-19a1808b6a43 tempest-ProjectReaderTests-1380058734 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:54:36 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-9cdbf2ef-b86b-4c7a-9076-19a1808b6a43 tempest-ProjectReaderTests-1380058734 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:54:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9cdbf2ef-b86b-4c7a-9076-19a1808b6a43 tempest-ProjectReaderTests-1380058734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-901b163d-c4dc-42b0-a68b-22e5a11eee27 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:36 devstack sudo[103197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-901b163d-c4dc-42b0-a68b-22e5a11eee27 1073741824 Jul 08 18:54:36 devstack sudo[103197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:37 devstack sudo[103197]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9cdbf2ef-b86b-4c7a-9076-19a1808b6a43 tempest-ProjectReaderTests-1380058734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-901b163d-c4dc-42b0-a68b-22e5a11eee27 1073741824" returned: 0 in 0.860s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9cdbf2ef-b86b-4c7a-9076-19a1808b6a43 tempest-ProjectReaderTests-1380058734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-901b163d-c4dc-42b0-a68b-22e5a11eee27 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:37 devstack sudo[103203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-901b163d-c4dc-42b0-a68b-22e5a11eee27 Jul 08 18:54:37 devstack sudo[103203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:37 devstack sudo[103203]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9cdbf2ef-b86b-4c7a-9076-19a1808b6a43 tempest-ProjectReaderTests-1380058734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-901b163d-c4dc-42b0-a68b-22e5a11eee27" returned: 0 in 0.734s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:37 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-9cdbf2ef-b86b-4c7a-9076-19a1808b6a43 tempest-ProjectReaderTests-1380058734 None] <== create_volume: return (1640ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:54:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-9cdbf2ef-b86b-4c7a-9076-19a1808b6a43 tempest-ProjectReaderTests-1380058734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.644s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:54:37 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-9cdbf2ef-b86b-4c7a-9076-19a1808b6a43 tempest-ProjectReaderTests-1380058734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b65e1a9b-d809-4151-ae3c-5c5b33dffb39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-901b163d-c4dc-42b0-a68b-22e5a11eee27', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:37 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-9cdbf2ef-b86b-4c7a-9076-19a1808b6a43 tempest-ProjectReaderTests-1380058734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3db379a4-c5cd-4edf-8c62-48a9c70902b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:37 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-9cdbf2ef-b86b-4c7a-9076-19a1808b6a43 tempest-ProjectReaderTests-1380058734 None] Volume volume-901b163d-c4dc-42b0-a68b-22e5a11eee27 (901b163d-c4dc-42b0-a68b-22e5a11eee27): created successfully Jul 08 18:54:37 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-9cdbf2ef-b86b-4c7a-9076-19a1808b6a43 tempest-ProjectReaderTests-1380058734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3db379a4-c5cd-4edf-8c62-48a9c70902b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:37 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-9cdbf2ef-b86b-4c7a-9076-19a1808b6a43 tempest-ProjectReaderTests-1380058734 None] Flow 'volume_create_manager' (b23015f1-69df-4fef-ac57-77369e167f81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:54:37 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-9cdbf2ef-b86b-4c7a-9076-19a1808b6a43 tempest-ProjectReaderTests-1380058734 None] Created volume successfully. Jul 08 18:54:38 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6a0257d7-2977-4574-8232-48f2955f0a02 tempest-ProjectReaderTests-1380058734 None] Acquiring lock "cinder-901b163d-c4dc-42b0-a68b-22e5a11eee27-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:54:38 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6a0257d7-2977-4574-8232-48f2955f0a02 tempest-ProjectReaderTests-1380058734 None] Lock "cinder-901b163d-c4dc-42b0-a68b-22e5a11eee27-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:54:38 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6a0257d7-2977-4574-8232-48f2955f0a02 tempest-ProjectReaderTests-1380058734 None] Acquiring lock "cinder-quobyte-901b163d-c4dc-42b0-a68b-22e5a11eee27" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:54:38 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6a0257d7-2977-4574-8232-48f2955f0a02 tempest-ProjectReaderTests-1380058734 None] Lock "cinder-quobyte-901b163d-c4dc-42b0-a68b-22e5a11eee27" acquired by "delete_volume" :: waited 0.020s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:54:38 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb98d51c-d9c2-4237-92f9-c7528e8405ed]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:54:38 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6a0257d7-2977-4574-8232-48f2955f0a02 tempest-ProjectReaderTests-1380058734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-901b163d-c4dc-42b0-a68b-22e5a11eee27 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:38 devstack sudo[103208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-901b163d-c4dc-42b0-a68b-22e5a11eee27 Jul 08 18:54:38 devstack sudo[103208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:39 devstack sudo[103208]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:39 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6a0257d7-2977-4574-8232-48f2955f0a02 tempest-ProjectReaderTests-1380058734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-901b163d-c4dc-42b0-a68b-22e5a11eee27" returned: 0 in 0.808s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:39 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6a0257d7-2977-4574-8232-48f2955f0a02 tempest-ProjectReaderTests-1380058734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-901b163d-c4dc-42b0-a68b-22e5a11eee27 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:39 devstack sudo[103218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-901b163d-c4dc-42b0-a68b-22e5a11eee27 Jul 08 18:54:39 devstack sudo[103218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:40 devstack sudo[103218]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6a0257d7-2977-4574-8232-48f2955f0a02 tempest-ProjectReaderTests-1380058734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-901b163d-c4dc-42b0-a68b-22e5a11eee27" returned: 0 in 0.814s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:40 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6a0257d7-2977-4574-8232-48f2955f0a02 tempest-ProjectReaderTests-1380058734 None] Lock "cinder-quobyte-901b163d-c4dc-42b0-a68b-22e5a11eee27" released by "delete_volume" :: held 1.669s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:54:40 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-6a0257d7-2977-4574-8232-48f2955f0a02 tempest-ProjectReaderTests-1380058734 None] Created reservations ['5a2fbbeb-813f-43e9-b04a-7d8dff87621e', '1a23808c-da1f-4990-adef-92f44a4fc09c', 'fb78ccbf-28fa-4631-b8d1-f1e155787c2b', '5c63bd74-298d-44ff-9f4e-fd956bb65823'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:54:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6a0257d7-2977-4574-8232-48f2955f0a02 tempest-ProjectReaderTests-1380058734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:54:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6a0257d7-2977-4574-8232-48f2955f0a02 tempest-ProjectReaderTests-1380058734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:54:40 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-6a0257d7-2977-4574-8232-48f2955f0a02 tempest-ProjectReaderTests-1380058734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:54:40 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-6a0257d7-2977-4574-8232-48f2955f0a02 tempest-ProjectReaderTests-1380058734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:54:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6a0257d7-2977-4574-8232-48f2955f0a02 tempest-ProjectReaderTests-1380058734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:54:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6a0257d7-2977-4574-8232-48f2955f0a02 tempest-ProjectReaderTests-1380058734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:40 devstack sudo[103241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:54:40 devstack sudo[103241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:41 devstack sudo[103241]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6a0257d7-2977-4574-8232-48f2955f0a02 tempest-ProjectReaderTests-1380058734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.789s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:41 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-6a0257d7-2977-4574-8232-48f2955f0a02 tempest-ProjectReaderTests-1380058734 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:54:41 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-6a0257d7-2977-4574-8232-48f2955f0a02 tempest-ProjectReaderTests-1380058734 None] Deleted volume successfully. Jul 08 18:54:41 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6a0257d7-2977-4574-8232-48f2955f0a02 tempest-ProjectReaderTests-1380058734 None] Lock "cinder-901b163d-c4dc-42b0-a68b-22e5a11eee27-delete_volume" released by "delete_volume" :: held 2.716s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:54:41 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-79e324fe-8b14-4fcf-83c3-1e59d4b5a372 tempest-ProjectReaderTests-1380058734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:54:41 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-79e324fe-8b14-4fcf-83c3-1e59d4b5a372 tempest-ProjectReaderTests-1380058734 None] Flow 'volume_create_manager' (cf7653a1-f721-45cb-bfee-9f94d812902a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:54:41 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-79e324fe-8b14-4fcf-83c3-1e59d4b5a372 tempest-ProjectReaderTests-1380058734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f39fc34a-c46a-4f8b-b046-732212bf296d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:41 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-79e324fe-8b14-4fcf-83c3-1e59d4b5a372 tempest-ProjectReaderTests-1380058734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f39fc34a-c46a-4f8b-b046-732212bf296d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:54:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1447218137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a11bb129-9213-4146-95b8-2c08dd76afdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2586ce51ba8e4d2a841171043bf35203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:54:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:54:41Z,use_quota=True,user_id='a0febf8f52ee49618facf3dadb0085c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:41 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-79e324fe-8b14-4fcf-83c3-1e59d4b5a372 tempest-ProjectReaderTests-1380058734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43e120ea-397b-4d8f-8164-d3f7c0577e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:41 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-79e324fe-8b14-4fcf-83c3-1e59d4b5a372 tempest-ProjectReaderTests-1380058734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43e120ea-397b-4d8f-8164-d3f7c0577e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:41 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-79e324fe-8b14-4fcf-83c3-1e59d4b5a372 tempest-ProjectReaderTests-1380058734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c573690f-edf6-48a2-8dfb-2da7e7b97462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:41 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-79e324fe-8b14-4fcf-83c3-1e59d4b5a372 tempest-ProjectReaderTests-1380058734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c573690f-edf6-48a2-8dfb-2da7e7b97462) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a11bb129-9213-4146-95b8-2c08dd76afdb', 'volume_name': 'volume-a11bb129-9213-4146-95b8-2c08dd76afdb', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:41 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-79e324fe-8b14-4fcf-83c3-1e59d4b5a372 tempest-ProjectReaderTests-1380058734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71fe22bc-9da8-4cb0-a6a8-089912d2401c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:41 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-79e324fe-8b14-4fcf-83c3-1e59d4b5a372 tempest-ProjectReaderTests-1380058734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71fe22bc-9da8-4cb0-a6a8-089912d2401c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:41 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-79e324fe-8b14-4fcf-83c3-1e59d4b5a372 tempest-ProjectReaderTests-1380058734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (347317b9-18a6-490f-b342-3c07b7fbf30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:41 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-79e324fe-8b14-4fcf-83c3-1e59d4b5a372 tempest-ProjectReaderTests-1380058734 None] Volume a11bb129-9213-4146-95b8-2c08dd76afdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a11bb129-9213-4146-95b8-2c08dd76afdb', 'volume_size': 1} Jul 08 18:54:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-79e324fe-8b14-4fcf-83c3-1e59d4b5a372 tempest-ProjectReaderTests-1380058734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:54:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-79e324fe-8b14-4fcf-83c3-1e59d4b5a372 tempest-ProjectReaderTests-1380058734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:54:41 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-79e324fe-8b14-4fcf-83c3-1e59d4b5a372 tempest-ProjectReaderTests-1380058734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:54:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1447218137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a11bb129-9213-4146-95b8-2c08dd76afdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2586ce51ba8e4d2a841171043bf35203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:54:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:54:41Z,use_quota=True,user_id='a0febf8f52ee49618facf3dadb0085c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:54:41 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-79e324fe-8b14-4fcf-83c3-1e59d4b5a372 tempest-ProjectReaderTests-1380058734 None] Creating volume a11bb129-9213-4146-95b8-2c08dd76afdb {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:54:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-79e324fe-8b14-4fcf-83c3-1e59d4b5a372 tempest-ProjectReaderTests-1380058734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:54:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-79e324fe-8b14-4fcf-83c3-1e59d4b5a372 tempest-ProjectReaderTests-1380058734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:54:41 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-79e324fe-8b14-4fcf-83c3-1e59d4b5a372 tempest-ProjectReaderTests-1380058734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:54:41 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-79e324fe-8b14-4fcf-83c3-1e59d4b5a372 tempest-ProjectReaderTests-1380058734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:54:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-79e324fe-8b14-4fcf-83c3-1e59d4b5a372 tempest-ProjectReaderTests-1380058734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:54:41 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-79e324fe-8b14-4fcf-83c3-1e59d4b5a372 tempest-ProjectReaderTests-1380058734 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:54:41 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-79e324fe-8b14-4fcf-83c3-1e59d4b5a372 tempest-ProjectReaderTests-1380058734 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:54:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-79e324fe-8b14-4fcf-83c3-1e59d4b5a372 tempest-ProjectReaderTests-1380058734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-a11bb129-9213-4146-95b8-2c08dd76afdb 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:41 devstack sudo[103245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-a11bb129-9213-4146-95b8-2c08dd76afdb 1073741824 Jul 08 18:54:41 devstack sudo[103245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:42 devstack sudo[103245]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-79e324fe-8b14-4fcf-83c3-1e59d4b5a372 tempest-ProjectReaderTests-1380058734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-a11bb129-9213-4146-95b8-2c08dd76afdb 1073741824" returned: 0 in 0.855s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-79e324fe-8b14-4fcf-83c3-1e59d4b5a372 tempest-ProjectReaderTests-1380058734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-a11bb129-9213-4146-95b8-2c08dd76afdb {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:42 devstack sudo[103251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-a11bb129-9213-4146-95b8-2c08dd76afdb Jul 08 18:54:42 devstack sudo[103251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:42 devstack sudo[103251]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-79e324fe-8b14-4fcf-83c3-1e59d4b5a372 tempest-ProjectReaderTests-1380058734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-a11bb129-9213-4146-95b8-2c08dd76afdb" returned: 0 in 0.662s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:42 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-79e324fe-8b14-4fcf-83c3-1e59d4b5a372 tempest-ProjectReaderTests-1380058734 None] <== create_volume: return (1554ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:54:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-79e324fe-8b14-4fcf-83c3-1e59d4b5a372 tempest-ProjectReaderTests-1380058734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.557s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:54:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-79e324fe-8b14-4fcf-83c3-1e59d4b5a372 tempest-ProjectReaderTests-1380058734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (347317b9-18a6-490f-b342-3c07b7fbf30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a11bb129-9213-4146-95b8-2c08dd76afdb', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-79e324fe-8b14-4fcf-83c3-1e59d4b5a372 tempest-ProjectReaderTests-1380058734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a609dc7a-2a85-4ffc-b257-f42fc1a5cc2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:42 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-79e324fe-8b14-4fcf-83c3-1e59d4b5a372 tempest-ProjectReaderTests-1380058734 None] Volume volume-a11bb129-9213-4146-95b8-2c08dd76afdb (a11bb129-9213-4146-95b8-2c08dd76afdb): created successfully Jul 08 18:54:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-79e324fe-8b14-4fcf-83c3-1e59d4b5a372 tempest-ProjectReaderTests-1380058734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a609dc7a-2a85-4ffc-b257-f42fc1a5cc2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-79e324fe-8b14-4fcf-83c3-1e59d4b5a372 tempest-ProjectReaderTests-1380058734 None] Flow 'volume_create_manager' (cf7653a1-f721-45cb-bfee-9f94d812902a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:54:42 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-79e324fe-8b14-4fcf-83c3-1e59d4b5a372 tempest-ProjectReaderTests-1380058734 None] Created volume successfully. Jul 08 18:54:43 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-99587027-fa99-4d97-8925-26cabcb50ad4 tempest-ProjectReaderTests-1380058734 None] Acquiring lock "cinder-a11bb129-9213-4146-95b8-2c08dd76afdb-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:54:43 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-99587027-fa99-4d97-8925-26cabcb50ad4 tempest-ProjectReaderTests-1380058734 None] Lock "cinder-a11bb129-9213-4146-95b8-2c08dd76afdb-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:54:43 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-99587027-fa99-4d97-8925-26cabcb50ad4 tempest-ProjectReaderTests-1380058734 None] Acquiring lock "cinder-quobyte-a11bb129-9213-4146-95b8-2c08dd76afdb" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:54:43 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-99587027-fa99-4d97-8925-26cabcb50ad4 tempest-ProjectReaderTests-1380058734 None] Lock "cinder-quobyte-a11bb129-9213-4146-95b8-2c08dd76afdb" acquired by "delete_volume" :: waited 0.017s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:54:43 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f48c03-09f1-4d09-b5a7-61813b2be175]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:54:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-99587027-fa99-4d97-8925-26cabcb50ad4 tempest-ProjectReaderTests-1380058734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-a11bb129-9213-4146-95b8-2c08dd76afdb {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:43 devstack sudo[103255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-a11bb129-9213-4146-95b8-2c08dd76afdb Jul 08 18:54:43 devstack sudo[103255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:44 devstack sudo[103255]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-99587027-fa99-4d97-8925-26cabcb50ad4 tempest-ProjectReaderTests-1380058734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-a11bb129-9213-4146-95b8-2c08dd76afdb" returned: 0 in 0.809s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-99587027-fa99-4d97-8925-26cabcb50ad4 tempest-ProjectReaderTests-1380058734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-a11bb129-9213-4146-95b8-2c08dd76afdb {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:44 devstack sudo[103261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-a11bb129-9213-4146-95b8-2c08dd76afdb Jul 08 18:54:44 devstack sudo[103261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:44 devstack sudo[103261]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-99587027-fa99-4d97-8925-26cabcb50ad4 tempest-ProjectReaderTests-1380058734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-a11bb129-9213-4146-95b8-2c08dd76afdb" returned: 0 in 0.651s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:44 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-99587027-fa99-4d97-8925-26cabcb50ad4 tempest-ProjectReaderTests-1380058734 None] Lock "cinder-quobyte-a11bb129-9213-4146-95b8-2c08dd76afdb" released by "delete_volume" :: held 1.511s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:54:44 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-99587027-fa99-4d97-8925-26cabcb50ad4 tempest-ProjectReaderTests-1380058734 None] Created reservations ['7fc92da9-fdc7-44ae-9e8e-cb73ce59224a', 'c81de4b6-da19-4c28-8cef-a1e0ce1efb9b', 'c9b3cf13-2355-4753-a83e-17aad8c9022c', 'a52e8ecd-4c00-4e17-a8a2-be9497a841cc'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:54:45 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-50a4c94a-d2e1-42f4-a20b-5aaaf7172495 tempest-TestStampPattern-552338204 None] Acquiring lock "cinder-48a4fbb0-6f9d-43db-a344-d9848388f786-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:54:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-99587027-fa99-4d97-8925-26cabcb50ad4 tempest-ProjectReaderTests-1380058734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:54:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-99587027-fa99-4d97-8925-26cabcb50ad4 tempest-ProjectReaderTests-1380058734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:54:45 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-99587027-fa99-4d97-8925-26cabcb50ad4 tempest-ProjectReaderTests-1380058734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:54:45 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-99587027-fa99-4d97-8925-26cabcb50ad4 tempest-ProjectReaderTests-1380058734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:54:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-99587027-fa99-4d97-8925-26cabcb50ad4 tempest-ProjectReaderTests-1380058734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:54:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-99587027-fa99-4d97-8925-26cabcb50ad4 tempest-ProjectReaderTests-1380058734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:45 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-50a4c94a-d2e1-42f4-a20b-5aaaf7172495 tempest-TestStampPattern-552338204 None] Lock "cinder-48a4fbb0-6f9d-43db-a344-d9848388f786-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:54:45 devstack sudo[103264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:54:45 devstack sudo[103264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:45 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-50a4c94a-d2e1-42f4-a20b-5aaaf7172495 tempest-TestStampPattern-552338204 None] Acquiring lock "cinder-quobyte-48a4fbb0-6f9d-43db-a344-d9848388f786" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:54:45 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-50a4c94a-d2e1-42f4-a20b-5aaaf7172495 tempest-TestStampPattern-552338204 None] Lock "cinder-quobyte-48a4fbb0-6f9d-43db-a344-d9848388f786" acquired by "delete_volume" :: waited 0.015s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:54:45 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9fdf88-5fcb-4fa5-bb1d-1117002beca3]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:54:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-50a4c94a-d2e1-42f4-a20b-5aaaf7172495 tempest-TestStampPattern-552338204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-48a4fbb0-6f9d-43db-a344-d9848388f786 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:45 devstack sudo[103266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-48a4fbb0-6f9d-43db-a344-d9848388f786 Jul 08 18:54:45 devstack sudo[103266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:45 devstack sudo[103264]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-99587027-fa99-4d97-8925-26cabcb50ad4 tempest-ProjectReaderTests-1380058734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.675s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:45 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-99587027-fa99-4d97-8925-26cabcb50ad4 tempest-ProjectReaderTests-1380058734 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:54:45 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-99587027-fa99-4d97-8925-26cabcb50ad4 tempest-ProjectReaderTests-1380058734 None] Deleted volume successfully. Jul 08 18:54:45 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-99587027-fa99-4d97-8925-26cabcb50ad4 tempest-ProjectReaderTests-1380058734 None] Lock "cinder-a11bb129-9213-4146-95b8-2c08dd76afdb-delete_volume" released by "delete_volume" :: held 2.412s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:54:45 devstack sudo[103266]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-50a4c94a-d2e1-42f4-a20b-5aaaf7172495 tempest-TestStampPattern-552338204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-48a4fbb0-6f9d-43db-a344-d9848388f786" returned: 0 in 0.811s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-50a4c94a-d2e1-42f4-a20b-5aaaf7172495 tempest-TestStampPattern-552338204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-48a4fbb0-6f9d-43db-a344-d9848388f786 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:45 devstack sudo[103272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-48a4fbb0-6f9d-43db-a344-d9848388f786 Jul 08 18:54:45 devstack sudo[103272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:46 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4a1e732-daed-4900-ac09-b4172d4a8475 tempest-ProjectReaderTests-1380058734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:54:46 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c4a1e732-daed-4900-ac09-b4172d4a8475 tempest-ProjectReaderTests-1380058734 None] Flow 'volume_create_manager' (5c457230-074b-462c-8f5e-ded0e83dfc44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:54:46 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c4a1e732-daed-4900-ac09-b4172d4a8475 tempest-ProjectReaderTests-1380058734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db640b0b-9b5c-4ee3-8bcd-e9e787e95a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:46 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c4a1e732-daed-4900-ac09-b4172d4a8475 tempest-ProjectReaderTests-1380058734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db640b0b-9b5c-4ee3-8bcd-e9e787e95a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-728130442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20ea0e55-529c-4fb7-ba7c-136ca38506c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2586ce51ba8e4d2a841171043bf35203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:54:46Z,use_quota=True,user_id='a0febf8f52ee49618facf3dadb0085c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:46 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c4a1e732-daed-4900-ac09-b4172d4a8475 tempest-ProjectReaderTests-1380058734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46a5aa73-53a2-46cc-9cc8-75eca8955bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:46 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c4a1e732-daed-4900-ac09-b4172d4a8475 tempest-ProjectReaderTests-1380058734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46a5aa73-53a2-46cc-9cc8-75eca8955bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:46 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c4a1e732-daed-4900-ac09-b4172d4a8475 tempest-ProjectReaderTests-1380058734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30dbf727-6c84-4df9-a233-fa166901ee37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:46 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c4a1e732-daed-4900-ac09-b4172d4a8475 tempest-ProjectReaderTests-1380058734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30dbf727-6c84-4df9-a233-fa166901ee37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20ea0e55-529c-4fb7-ba7c-136ca38506c5', 'volume_name': 'volume-20ea0e55-529c-4fb7-ba7c-136ca38506c5', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:46 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c4a1e732-daed-4900-ac09-b4172d4a8475 tempest-ProjectReaderTests-1380058734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75070595-ac1f-4fef-88fa-91fe55ed7061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:46 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c4a1e732-daed-4900-ac09-b4172d4a8475 tempest-ProjectReaderTests-1380058734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75070595-ac1f-4fef-88fa-91fe55ed7061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:46 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c4a1e732-daed-4900-ac09-b4172d4a8475 tempest-ProjectReaderTests-1380058734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (052bb484-4f80-4c40-bc75-fc4f9323e1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:46 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-c4a1e732-daed-4900-ac09-b4172d4a8475 tempest-ProjectReaderTests-1380058734 None] Volume 20ea0e55-529c-4fb7-ba7c-136ca38506c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20ea0e55-529c-4fb7-ba7c-136ca38506c5', 'volume_size': 1} Jul 08 18:54:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c4a1e732-daed-4900-ac09-b4172d4a8475 tempest-ProjectReaderTests-1380058734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:54:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c4a1e732-daed-4900-ac09-b4172d4a8475 tempest-ProjectReaderTests-1380058734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:54:46 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c4a1e732-daed-4900-ac09-b4172d4a8475 tempest-ProjectReaderTests-1380058734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-728130442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20ea0e55-529c-4fb7-ba7c-136ca38506c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2586ce51ba8e4d2a841171043bf35203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:54:46Z,use_quota=True,user_id='a0febf8f52ee49618facf3dadb0085c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:54:46 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-c4a1e732-daed-4900-ac09-b4172d4a8475 tempest-ProjectReaderTests-1380058734 None] Creating volume 20ea0e55-529c-4fb7-ba7c-136ca38506c5 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:54:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c4a1e732-daed-4900-ac09-b4172d4a8475 tempest-ProjectReaderTests-1380058734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:54:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c4a1e732-daed-4900-ac09-b4172d4a8475 tempest-ProjectReaderTests-1380058734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:54:46 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c4a1e732-daed-4900-ac09-b4172d4a8475 tempest-ProjectReaderTests-1380058734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:54:46 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c4a1e732-daed-4900-ac09-b4172d4a8475 tempest-ProjectReaderTests-1380058734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:54:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c4a1e732-daed-4900-ac09-b4172d4a8475 tempest-ProjectReaderTests-1380058734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:54:46 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c4a1e732-daed-4900-ac09-b4172d4a8475 tempest-ProjectReaderTests-1380058734 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:54:46 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-c4a1e732-daed-4900-ac09-b4172d4a8475 tempest-ProjectReaderTests-1380058734 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:54:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c4a1e732-daed-4900-ac09-b4172d4a8475 tempest-ProjectReaderTests-1380058734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-20ea0e55-529c-4fb7-ba7c-136ca38506c5 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:46 devstack sudo[103274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-20ea0e55-529c-4fb7-ba7c-136ca38506c5 1073741824 Jul 08 18:54:46 devstack sudo[103274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:46 devstack sudo[103272]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-50a4c94a-d2e1-42f4-a20b-5aaaf7172495 tempest-TestStampPattern-552338204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-48a4fbb0-6f9d-43db-a344-d9848388f786" returned: 0 in 0.653s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:46 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-50a4c94a-d2e1-42f4-a20b-5aaaf7172495 tempest-TestStampPattern-552338204 None] Lock "cinder-quobyte-48a4fbb0-6f9d-43db-a344-d9848388f786" released by "delete_volume" :: held 1.514s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:54:46 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-50a4c94a-d2e1-42f4-a20b-5aaaf7172495 tempest-TestStampPattern-552338204 None] Created reservations ['5c51682c-5be9-44e5-a696-16087aa56073', 'e2146da7-7f8a-440e-99c9-9755ead7d06d', '8a54d6f5-bdea-4cd0-bba5-385c041303c3', 'be169491-1316-488e-a2e8-ab7d6ef45448'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:54:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-50a4c94a-d2e1-42f4-a20b-5aaaf7172495 tempest-TestStampPattern-552338204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:54:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-50a4c94a-d2e1-42f4-a20b-5aaaf7172495 tempest-TestStampPattern-552338204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:54:46 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-50a4c94a-d2e1-42f4-a20b-5aaaf7172495 tempest-TestStampPattern-552338204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:54:46 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-50a4c94a-d2e1-42f4-a20b-5aaaf7172495 tempest-TestStampPattern-552338204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:54:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-50a4c94a-d2e1-42f4-a20b-5aaaf7172495 tempest-TestStampPattern-552338204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:54:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-50a4c94a-d2e1-42f4-a20b-5aaaf7172495 tempest-TestStampPattern-552338204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:46 devstack sudo[103280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:54:46 devstack sudo[103280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:46 devstack sudo[103274]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c4a1e732-daed-4900-ac09-b4172d4a8475 tempest-ProjectReaderTests-1380058734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-20ea0e55-529c-4fb7-ba7c-136ca38506c5 1073741824" returned: 0 in 0.852s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c4a1e732-daed-4900-ac09-b4172d4a8475 tempest-ProjectReaderTests-1380058734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-20ea0e55-529c-4fb7-ba7c-136ca38506c5 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:47 devstack sudo[103283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-20ea0e55-529c-4fb7-ba7c-136ca38506c5 Jul 08 18:54:47 devstack sudo[103283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:47 devstack sudo[103280]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-50a4c94a-d2e1-42f4-a20b-5aaaf7172495 tempest-TestStampPattern-552338204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.673s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:47 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-50a4c94a-d2e1-42f4-a20b-5aaaf7172495 tempest-TestStampPattern-552338204 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:54:47 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-50a4c94a-d2e1-42f4-a20b-5aaaf7172495 tempest-TestStampPattern-552338204 None] Deleted volume successfully. Jul 08 18:54:47 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-50a4c94a-d2e1-42f4-a20b-5aaaf7172495 tempest-TestStampPattern-552338204 None] Lock "cinder-48a4fbb0-6f9d-43db-a344-d9848388f786-delete_volume" released by "delete_volume" :: held 2.422s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:54:47 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9c604708-9ab6-4712-baff-6d2a9a9b95b3 tempest-TestStampPattern-552338204 None] Acquiring lock "cinder-9cfc8506-986e-4340-b40e-05612ae4a12a-delete_snapshot" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:54:47 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9c604708-9ab6-4712-baff-6d2a9a9b95b3 tempest-TestStampPattern-552338204 None] Lock "cinder-9cfc8506-986e-4340-b40e-05612ae4a12a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:54:47 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9c604708-9ab6-4712-baff-6d2a9a9b95b3 tempest-TestStampPattern-552338204 None] Acquiring lock "cinder-quobyte-9b4e9e68-62e7-443c-b629-b793ce31e961" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:54:47 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9c604708-9ab6-4712-baff-6d2a9a9b95b3 tempest-TestStampPattern-552338204 None] Lock "cinder-quobyte-9b4e9e68-62e7-443c-b629-b793ce31e961" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:54:47 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9c604708-9ab6-4712-baff-6d2a9a9b95b3 tempest-TestStampPattern-552338204 None] Acquiring lock "cinder-quobyte-9cfc8506-986e-4340-b40e-05612ae4a12a" by "_delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:54:47 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9c604708-9ab6-4712-baff-6d2a9a9b95b3 tempest-TestStampPattern-552338204 None] Lock "cinder-quobyte-9cfc8506-986e-4340-b40e-05612ae4a12a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:54:47 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-9c604708-9ab6-4712-baff-6d2a9a9b95b3 tempest-TestStampPattern-552338204 None] Deleting offline snapshot 9cfc8506-986e-4340-b40e-05612ae4a12a of volume 9b4e9e68-62e7-443c-b629-b793ce31e961 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:54:47 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-9c604708-9ab6-4712-baff-6d2a9a9b95b3 tempest-TestStampPattern-552338204 None] snapshot_file for this snap is: volume-9b4e9e68-62e7-443c-b629-b793ce31e961.9cfc8506-986e-4340-b40e-05612ae4a12a {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:54:47 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe1acdc-ccd8-4d84-94d2-ef944821d55e]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:54:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9c604708-9ab6-4712-baff-6d2a9a9b95b3 tempest-TestStampPattern-552338204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961.9cfc8506-986e-4340-b40e-05612ae4a12a {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:47 devstack sudo[103286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961.9cfc8506-986e-4340-b40e-05612ae4a12a Jul 08 18:54:47 devstack sudo[103286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:47 devstack sudo[103283]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c4a1e732-daed-4900-ac09-b4172d4a8475 tempest-ProjectReaderTests-1380058734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-20ea0e55-529c-4fb7-ba7c-136ca38506c5" returned: 0 in 0.756s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:47 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c4a1e732-daed-4900-ac09-b4172d4a8475 tempest-ProjectReaderTests-1380058734 None] <== create_volume: return (1656ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:54:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c4a1e732-daed-4900-ac09-b4172d4a8475 tempest-ProjectReaderTests-1380058734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.658s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:54:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c4a1e732-daed-4900-ac09-b4172d4a8475 tempest-ProjectReaderTests-1380058734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (052bb484-4f80-4c40-bc75-fc4f9323e1ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20ea0e55-529c-4fb7-ba7c-136ca38506c5', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c4a1e732-daed-4900-ac09-b4172d4a8475 tempest-ProjectReaderTests-1380058734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e683d2d-2d20-4b80-b50b-0b583877dbf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:47 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-c4a1e732-daed-4900-ac09-b4172d4a8475 tempest-ProjectReaderTests-1380058734 None] Volume volume-20ea0e55-529c-4fb7-ba7c-136ca38506c5 (20ea0e55-529c-4fb7-ba7c-136ca38506c5): created successfully Jul 08 18:54:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c4a1e732-daed-4900-ac09-b4172d4a8475 tempest-ProjectReaderTests-1380058734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e683d2d-2d20-4b80-b50b-0b583877dbf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c4a1e732-daed-4900-ac09-b4172d4a8475 tempest-ProjectReaderTests-1380058734 None] Flow 'volume_create_manager' (5c457230-074b-462c-8f5e-ded0e83dfc44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:54:47 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-c4a1e732-daed-4900-ac09-b4172d4a8475 tempest-ProjectReaderTests-1380058734 None] Created volume successfully. Jul 08 18:54:48 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-2cc75a86-2c1f-478d-8fc1-b05efdafcae2 tempest-ProjectReaderTests-1380058734 None] Acquiring lock "cinder-20ea0e55-529c-4fb7-ba7c-136ca38506c5-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:54:48 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-2cc75a86-2c1f-478d-8fc1-b05efdafcae2 tempest-ProjectReaderTests-1380058734 None] Lock "cinder-20ea0e55-529c-4fb7-ba7c-136ca38506c5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:54:48 devstack cinder-volume[86873]: DEBUG oslo_service.periodic_task [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86873) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:54:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:54:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:54:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:54:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:54:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:54:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:48 devstack sudo[103289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:54:48 devstack sudo[103289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:48 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-2cc75a86-2c1f-478d-8fc1-b05efdafcae2 tempest-ProjectReaderTests-1380058734 None] Acquiring lock "cinder-quobyte-20ea0e55-529c-4fb7-ba7c-136ca38506c5" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:54:48 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-2cc75a86-2c1f-478d-8fc1-b05efdafcae2 tempest-ProjectReaderTests-1380058734 None] Lock "cinder-quobyte-20ea0e55-529c-4fb7-ba7c-136ca38506c5" acquired by "delete_volume" :: waited 0.023s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:54:48 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[51017bcb-7ea8-4740-8ff0-8bb01894d78d]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:54:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2cc75a86-2c1f-478d-8fc1-b05efdafcae2 tempest-ProjectReaderTests-1380058734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-20ea0e55-529c-4fb7-ba7c-136ca38506c5 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:48 devstack sudo[103286]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9c604708-9ab6-4712-baff-6d2a9a9b95b3 tempest-TestStampPattern-552338204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961.9cfc8506-986e-4340-b40e-05612ae4a12a" returned: 0 in 0.814s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-9c604708-9ab6-4712-baff-6d2a9a9b95b3 tempest-TestStampPattern-552338204 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b4e9e68-62e7-443c-b629-b793ce31e961(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:54:48 devstack sudo[103294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-20ea0e55-529c-4fb7-ba7c-136ca38506c5 Jul 08 18:54:48 devstack sudo[103294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:48 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f06a4b-1d07-4549-bbe7-26bb437c9f6f]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:54:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9c604708-9ab6-4712-baff-6d2a9a9b95b3 tempest-TestStampPattern-552338204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:48 devstack sudo[103296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961 Jul 08 18:54:48 devstack sudo[103296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:48 devstack sudo[103289]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.689s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:48 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:54:48 devstack cinder-volume[86873]: DEBUG oslo_service.periodic_task [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running periodic task VolumeManager._thread_info {{(pid=86873) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:54:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] thread count: 29 {{(pid=86873) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:54:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] thread info: [<_MainThread(MainThread, started 138577734545536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86873) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:54:49 devstack sudo[103294]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2cc75a86-2c1f-478d-8fc1-b05efdafcae2 tempest-ProjectReaderTests-1380058734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-20ea0e55-529c-4fb7-ba7c-136ca38506c5" returned: 0 in 0.771s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2cc75a86-2c1f-478d-8fc1-b05efdafcae2 tempest-ProjectReaderTests-1380058734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-20ea0e55-529c-4fb7-ba7c-136ca38506c5 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:49 devstack sudo[103302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-20ea0e55-529c-4fb7-ba7c-136ca38506c5 Jul 08 18:54:49 devstack sudo[103302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:49 devstack sudo[103296]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9c604708-9ab6-4712-baff-6d2a9a9b95b3 tempest-TestStampPattern-552338204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961" returned: 0 in 0.812s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9c604708-9ab6-4712-baff-6d2a9a9b95b3 tempest-TestStampPattern-552338204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961.9cfc8506-986e-4340-b40e-05612ae4a12a {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:49 devstack sudo[103307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961.9cfc8506-986e-4340-b40e-05612ae4a12a Jul 08 18:54:49 devstack sudo[103307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:49 devstack sudo[103302]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2cc75a86-2c1f-478d-8fc1-b05efdafcae2 tempest-ProjectReaderTests-1380058734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-20ea0e55-529c-4fb7-ba7c-136ca38506c5" returned: 0 in 0.652s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:49 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-2cc75a86-2c1f-478d-8fc1-b05efdafcae2 tempest-ProjectReaderTests-1380058734 None] Lock "cinder-quobyte-20ea0e55-529c-4fb7-ba7c-136ca38506c5" released by "delete_volume" :: held 1.463s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:54:49 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-2cc75a86-2c1f-478d-8fc1-b05efdafcae2 tempest-ProjectReaderTests-1380058734 None] Created reservations ['ee9e5155-7db7-4e18-b729-928c3135671e', '00659a11-8203-4ee8-b14f-76f8b3ea5b1f', '576f0a74-e21d-4431-ac1a-3eb691a10292', '5ee27154-1c52-4c26-a899-cfc2da42389c'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:54:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-2cc75a86-2c1f-478d-8fc1-b05efdafcae2 tempest-ProjectReaderTests-1380058734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:54:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-2cc75a86-2c1f-478d-8fc1-b05efdafcae2 tempest-ProjectReaderTests-1380058734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:54:49 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-2cc75a86-2c1f-478d-8fc1-b05efdafcae2 tempest-ProjectReaderTests-1380058734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:54:49 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-2cc75a86-2c1f-478d-8fc1-b05efdafcae2 tempest-ProjectReaderTests-1380058734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:54:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-2cc75a86-2c1f-478d-8fc1-b05efdafcae2 tempest-ProjectReaderTests-1380058734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:54:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2cc75a86-2c1f-478d-8fc1-b05efdafcae2 tempest-ProjectReaderTests-1380058734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:49 devstack sudo[103313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:54:49 devstack sudo[103313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:50 devstack sudo[103307]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9c604708-9ab6-4712-baff-6d2a9a9b95b3 tempest-TestStampPattern-552338204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961.9cfc8506-986e-4340-b40e-05612ae4a12a" returned: 0 in 0.799s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9c604708-9ab6-4712-baff-6d2a9a9b95b3 tempest-TestStampPattern-552338204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961.9cfc8506-986e-4340-b40e-05612ae4a12a {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:50 devstack sudo[103315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961.9cfc8506-986e-4340-b40e-05612ae4a12a Jul 08 18:54:50 devstack sudo[103315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:50 devstack sudo[103313]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2cc75a86-2c1f-478d-8fc1-b05efdafcae2 tempest-ProjectReaderTests-1380058734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.684s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:50 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-2cc75a86-2c1f-478d-8fc1-b05efdafcae2 tempest-ProjectReaderTests-1380058734 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:54:50 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-2cc75a86-2c1f-478d-8fc1-b05efdafcae2 tempest-ProjectReaderTests-1380058734 None] Deleted volume successfully. Jul 08 18:54:50 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-2cc75a86-2c1f-478d-8fc1-b05efdafcae2 tempest-ProjectReaderTests-1380058734 None] Lock "cinder-20ea0e55-529c-4fb7-ba7c-136ca38506c5-delete_volume" released by "delete_volume" :: held 2.402s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:54:50 devstack sudo[103315]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9c604708-9ab6-4712-baff-6d2a9a9b95b3 tempest-TestStampPattern-552338204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961.9cfc8506-986e-4340-b40e-05612ae4a12a" returned: 0 in 0.681s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:50 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9c604708-9ab6-4712-baff-6d2a9a9b95b3 tempest-TestStampPattern-552338204 None] Lock "cinder-quobyte-9cfc8506-986e-4340-b40e-05612ae4a12a" released by "_delete_snapshot" :: held 3.223s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:54:50 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9c604708-9ab6-4712-baff-6d2a9a9b95b3 tempest-TestStampPattern-552338204 None] Lock "cinder-quobyte-9b4e9e68-62e7-443c-b629-b793ce31e961" released by "delete_snapshot" :: held 3.248s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:54:50 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-9c604708-9ab6-4712-baff-6d2a9a9b95b3 tempest-TestStampPattern-552338204 None] Created reservations ['e705e238-5c78-4a39-8d77-16ded8b3b2c5', '7183175b-92f0-4389-a433-917d34df476a', 'c1dbb132-39ab-4e2b-a0ea-ee451f54d4e6', 'c467f18f-2733-4358-84c4-e876e7b89764'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:54:50 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-b864958c-910d-4e08-9610-0c707c4bb51e tempest-ProjectReaderTests-1380058734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:54:50 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b864958c-910d-4e08-9610-0c707c4bb51e tempest-ProjectReaderTests-1380058734 None] Flow 'volume_create_manager' (351117a9-6938-44fc-901b-3ae8505aef50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:54:50 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b864958c-910d-4e08-9610-0c707c4bb51e tempest-ProjectReaderTests-1380058734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a8d0f52-fc70-4ec0-a144-08a40237d38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:50 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b864958c-910d-4e08-9610-0c707c4bb51e tempest-ProjectReaderTests-1380058734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a8d0f52-fc70-4ec0-a144-08a40237d38a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:54:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-80906036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a74ae2ba-acf9-4dcb-9b3c-dca34a94a945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2586ce51ba8e4d2a841171043bf35203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:54:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:54:51Z,use_quota=True,user_id='a0febf8f52ee49618facf3dadb0085c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:50 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b864958c-910d-4e08-9610-0c707c4bb51e tempest-ProjectReaderTests-1380058734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66f91f5e-b454-43e6-8788-84d810ad0aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:50 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b864958c-910d-4e08-9610-0c707c4bb51e tempest-ProjectReaderTests-1380058734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66f91f5e-b454-43e6-8788-84d810ad0aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:50 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b864958c-910d-4e08-9610-0c707c4bb51e tempest-ProjectReaderTests-1380058734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08f3f2e3-0711-4976-8f30-30241123fb3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:50 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b864958c-910d-4e08-9610-0c707c4bb51e tempest-ProjectReaderTests-1380058734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08f3f2e3-0711-4976-8f30-30241123fb3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a74ae2ba-acf9-4dcb-9b3c-dca34a94a945', 'volume_name': 'volume-a74ae2ba-acf9-4dcb-9b3c-dca34a94a945', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:50 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b864958c-910d-4e08-9610-0c707c4bb51e tempest-ProjectReaderTests-1380058734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6bceaa6-5c49-4cbe-8cae-a35dbd7cdc36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:50 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b864958c-910d-4e08-9610-0c707c4bb51e tempest-ProjectReaderTests-1380058734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6bceaa6-5c49-4cbe-8cae-a35dbd7cdc36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:50 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b864958c-910d-4e08-9610-0c707c4bb51e tempest-ProjectReaderTests-1380058734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75486f13-6c72-4354-b73d-ce23ae40dd69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:50 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-b864958c-910d-4e08-9610-0c707c4bb51e tempest-ProjectReaderTests-1380058734 None] Volume a74ae2ba-acf9-4dcb-9b3c-dca34a94a945: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a74ae2ba-acf9-4dcb-9b3c-dca34a94a945', 'volume_size': 1} Jul 08 18:54:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b864958c-910d-4e08-9610-0c707c4bb51e tempest-ProjectReaderTests-1380058734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:54:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b864958c-910d-4e08-9610-0c707c4bb51e tempest-ProjectReaderTests-1380058734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:54:50 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b864958c-910d-4e08-9610-0c707c4bb51e tempest-ProjectReaderTests-1380058734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:54:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-80906036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a74ae2ba-acf9-4dcb-9b3c-dca34a94a945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2586ce51ba8e4d2a841171043bf35203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:54:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:54:51Z,use_quota=True,user_id='a0febf8f52ee49618facf3dadb0085c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:54:50 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-b864958c-910d-4e08-9610-0c707c4bb51e tempest-ProjectReaderTests-1380058734 None] Creating volume a74ae2ba-acf9-4dcb-9b3c-dca34a94a945 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:54:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b864958c-910d-4e08-9610-0c707c4bb51e tempest-ProjectReaderTests-1380058734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:54:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b864958c-910d-4e08-9610-0c707c4bb51e tempest-ProjectReaderTests-1380058734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:54:50 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b864958c-910d-4e08-9610-0c707c4bb51e tempest-ProjectReaderTests-1380058734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:54:50 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b864958c-910d-4e08-9610-0c707c4bb51e tempest-ProjectReaderTests-1380058734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:54:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b864958c-910d-4e08-9610-0c707c4bb51e tempest-ProjectReaderTests-1380058734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:54:50 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b864958c-910d-4e08-9610-0c707c4bb51e tempest-ProjectReaderTests-1380058734 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:54:50 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-b864958c-910d-4e08-9610-0c707c4bb51e tempest-ProjectReaderTests-1380058734 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:54:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b864958c-910d-4e08-9610-0c707c4bb51e tempest-ProjectReaderTests-1380058734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-a74ae2ba-acf9-4dcb-9b3c-dca34a94a945 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:51 devstack sudo[103319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-a74ae2ba-acf9-4dcb-9b3c-dca34a94a945 1073741824 Jul 08 18:54:51 devstack sudo[103319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:51 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-9c604708-9ab6-4712-baff-6d2a9a9b95b3 tempest-TestStampPattern-552338204 None] Delete snapshot completed successfully. Jul 08 18:54:51 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9c604708-9ab6-4712-baff-6d2a9a9b95b3 tempest-TestStampPattern-552338204 None] Lock "cinder-9cfc8506-986e-4340-b40e-05612ae4a12a-delete_snapshot" released by "delete_snapshot" :: held 3.493s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:54:51 devstack sudo[103319]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b864958c-910d-4e08-9610-0c707c4bb51e tempest-ProjectReaderTests-1380058734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-a74ae2ba-acf9-4dcb-9b3c-dca34a94a945 1073741824" returned: 0 in 0.832s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:51 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:UPDATE=116,cinder:DELETE=12,cinder:SELECT=92,cinder:INSERT=32 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:54:51 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:SELECT=91,cinder:UPDATE=132,cinder:INSERT=26,cinder:DELETE=9 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:54:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b864958c-910d-4e08-9610-0c707c4bb51e tempest-ProjectReaderTests-1380058734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-a74ae2ba-acf9-4dcb-9b3c-dca34a94a945 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:51 devstack sudo[103325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-a74ae2ba-acf9-4dcb-9b3c-dca34a94a945 Jul 08 18:54:51 devstack sudo[103325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:52 devstack sudo[103325]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b864958c-910d-4e08-9610-0c707c4bb51e tempest-ProjectReaderTests-1380058734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-a74ae2ba-acf9-4dcb-9b3c-dca34a94a945" returned: 0 in 0.702s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:52 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b864958c-910d-4e08-9610-0c707c4bb51e tempest-ProjectReaderTests-1380058734 None] <== create_volume: return (1591ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:54:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b864958c-910d-4e08-9610-0c707c4bb51e tempest-ProjectReaderTests-1380058734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.594s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:54:52 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b864958c-910d-4e08-9610-0c707c4bb51e tempest-ProjectReaderTests-1380058734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75486f13-6c72-4354-b73d-ce23ae40dd69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a74ae2ba-acf9-4dcb-9b3c-dca34a94a945', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:52 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b864958c-910d-4e08-9610-0c707c4bb51e tempest-ProjectReaderTests-1380058734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd4d529e-e2f6-4976-9ebe-3c1c528a2ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:52 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-b864958c-910d-4e08-9610-0c707c4bb51e tempest-ProjectReaderTests-1380058734 None] Volume volume-a74ae2ba-acf9-4dcb-9b3c-dca34a94a945 (a74ae2ba-acf9-4dcb-9b3c-dca34a94a945): created successfully Jul 08 18:54:52 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b864958c-910d-4e08-9610-0c707c4bb51e tempest-ProjectReaderTests-1380058734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd4d529e-e2f6-4976-9ebe-3c1c528a2ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:52 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b864958c-910d-4e08-9610-0c707c4bb51e tempest-ProjectReaderTests-1380058734 None] Flow 'volume_create_manager' (351117a9-6938-44fc-901b-3ae8505aef50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:54:52 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-b864958c-910d-4e08-9610-0c707c4bb51e tempest-ProjectReaderTests-1380058734 None] Created volume successfully. Jul 08 18:54:53 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-67817286-f7cd-44de-866b-d2a4447c235a tempest-ProjectReaderTests-1380058734 None] Acquiring lock "cinder-a74ae2ba-acf9-4dcb-9b3c-dca34a94a945-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:54:53 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-67817286-f7cd-44de-866b-d2a4447c235a tempest-ProjectReaderTests-1380058734 None] Lock "cinder-a74ae2ba-acf9-4dcb-9b3c-dca34a94a945-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:54:53 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-67817286-f7cd-44de-866b-d2a4447c235a tempest-ProjectReaderTests-1380058734 None] Acquiring lock "cinder-quobyte-a74ae2ba-acf9-4dcb-9b3c-dca34a94a945" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:54:53 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-67817286-f7cd-44de-866b-d2a4447c235a tempest-ProjectReaderTests-1380058734 None] Lock "cinder-quobyte-a74ae2ba-acf9-4dcb-9b3c-dca34a94a945" acquired by "delete_volume" :: waited 0.015s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:54:53 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf8a36a-788f-4b99-ab1b-c012b4c740af]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:54:53 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-67817286-f7cd-44de-866b-d2a4447c235a tempest-ProjectReaderTests-1380058734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-a74ae2ba-acf9-4dcb-9b3c-dca34a94a945 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:53 devstack sudo[103331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-a74ae2ba-acf9-4dcb-9b3c-dca34a94a945 Jul 08 18:54:53 devstack sudo[103331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:53 devstack sudo[103331]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:53 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-67817286-f7cd-44de-866b-d2a4447c235a tempest-ProjectReaderTests-1380058734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-a74ae2ba-acf9-4dcb-9b3c-dca34a94a945" returned: 0 in 0.790s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:53 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-67817286-f7cd-44de-866b-d2a4447c235a tempest-ProjectReaderTests-1380058734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-a74ae2ba-acf9-4dcb-9b3c-dca34a94a945 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:53 devstack sudo[103340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-a74ae2ba-acf9-4dcb-9b3c-dca34a94a945 Jul 08 18:54:53 devstack sudo[103340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:54 devstack sudo[103340]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-67817286-f7cd-44de-866b-d2a4447c235a tempest-ProjectReaderTests-1380058734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-a74ae2ba-acf9-4dcb-9b3c-dca34a94a945" returned: 0 in 0.704s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:54 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-67817286-f7cd-44de-866b-d2a4447c235a tempest-ProjectReaderTests-1380058734 None] Lock "cinder-quobyte-a74ae2ba-acf9-4dcb-9b3c-dca34a94a945" released by "delete_volume" :: held 1.545s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:54:54 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-67817286-f7cd-44de-866b-d2a4447c235a tempest-ProjectReaderTests-1380058734 None] Created reservations ['9b702206-482d-4841-ab3a-382e5ab943f3', '0ce2bddf-5e1c-4818-ac1e-465d1928f28f', '3c025af2-9253-4241-9ab6-0590b97ead2d', 'db76a152-a5b1-4166-825d-22be28ced362'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:54:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-67817286-f7cd-44de-866b-d2a4447c235a tempest-ProjectReaderTests-1380058734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:54:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-67817286-f7cd-44de-866b-d2a4447c235a tempest-ProjectReaderTests-1380058734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:54:54 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-67817286-f7cd-44de-866b-d2a4447c235a tempest-ProjectReaderTests-1380058734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:54:54 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-67817286-f7cd-44de-866b-d2a4447c235a tempest-ProjectReaderTests-1380058734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:54:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-67817286-f7cd-44de-866b-d2a4447c235a tempest-ProjectReaderTests-1380058734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:54:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-67817286-f7cd-44de-866b-d2a4447c235a tempest-ProjectReaderTests-1380058734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:54 devstack sudo[103362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:54:54 devstack sudo[103362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:55 devstack sudo[103362]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-67817286-f7cd-44de-866b-d2a4447c235a tempest-ProjectReaderTests-1380058734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.749s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:55 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-67817286-f7cd-44de-866b-d2a4447c235a tempest-ProjectReaderTests-1380058734 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:54:55 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-67817286-f7cd-44de-866b-d2a4447c235a tempest-ProjectReaderTests-1380058734 None] Deleted volume successfully. Jul 08 18:54:55 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-67817286-f7cd-44de-866b-d2a4447c235a tempest-ProjectReaderTests-1380058734 None] Lock "cinder-a74ae2ba-acf9-4dcb-9b3c-dca34a94a945-delete_volume" released by "delete_volume" :: held 2.543s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:55:00 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-8d71d853-06dc-4a76-b00f-3e4c89e48804 tempest-TestStampPattern-552338204 None] Acquiring lock "cinder-9b4e9e68-62e7-443c-b629-b793ce31e961-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:55:00 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-8d71d853-06dc-4a76-b00f-3e4c89e48804 tempest-TestStampPattern-552338204 None] Lock "cinder-9b4e9e68-62e7-443c-b629-b793ce31e961-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:55:00 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-8d71d853-06dc-4a76-b00f-3e4c89e48804 tempest-TestStampPattern-552338204 None] Acquiring lock "cinder-quobyte-9b4e9e68-62e7-443c-b629-b793ce31e961" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:55:00 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-8d71d853-06dc-4a76-b00f-3e4c89e48804 tempest-TestStampPattern-552338204 None] Lock "cinder-quobyte-9b4e9e68-62e7-443c-b629-b793ce31e961" acquired by "delete_volume" :: waited 0.013s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:55:00 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ba995c-4f0e-4d9d-a21b-bbd2983b413a]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:55:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8d71d853-06dc-4a76-b00f-3e4c89e48804 tempest-TestStampPattern-552338204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:55:00 devstack sudo[103369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961 Jul 08 18:55:00 devstack sudo[103369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:55:00 devstack sudo[103369]: pam_unix(sudo:session): session closed for user root Jul 08 18:55:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8d71d853-06dc-4a76-b00f-3e4c89e48804 tempest-TestStampPattern-552338204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961" returned: 0 in 0.748s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:55:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8d71d853-06dc-4a76-b00f-3e4c89e48804 tempest-TestStampPattern-552338204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:55:00 devstack sudo[103374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961 Jul 08 18:55:00 devstack sudo[103374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:55:01 devstack sudo[103374]: pam_unix(sudo:session): session closed for user root Jul 08 18:55:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8d71d853-06dc-4a76-b00f-3e4c89e48804 tempest-TestStampPattern-552338204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b4e9e68-62e7-443c-b629-b793ce31e961" returned: 0 in 0.663s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:55:01 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-8d71d853-06dc-4a76-b00f-3e4c89e48804 tempest-TestStampPattern-552338204 None] Lock "cinder-quobyte-9b4e9e68-62e7-443c-b629-b793ce31e961" released by "delete_volume" :: held 1.466s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:55:01 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-8d71d853-06dc-4a76-b00f-3e4c89e48804 tempest-TestStampPattern-552338204 None] Created reservations ['26e15f44-7df2-455e-931e-83fa2fd3c19a', 'a16199c4-e161-4c0f-b423-6bcb68e6ea94', '7940e079-70f8-4909-a064-bd3ef1d1cf3a', 'ef91c959-52f4-426a-8857-31a64d03a5bc'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:55:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-8d71d853-06dc-4a76-b00f-3e4c89e48804 tempest-TestStampPattern-552338204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:55:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-8d71d853-06dc-4a76-b00f-3e4c89e48804 tempest-TestStampPattern-552338204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:55:01 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-8d71d853-06dc-4a76-b00f-3e4c89e48804 tempest-TestStampPattern-552338204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:55:01 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-8d71d853-06dc-4a76-b00f-3e4c89e48804 tempest-TestStampPattern-552338204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:55:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-8d71d853-06dc-4a76-b00f-3e4c89e48804 tempest-TestStampPattern-552338204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:55:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8d71d853-06dc-4a76-b00f-3e4c89e48804 tempest-TestStampPattern-552338204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:55:01 devstack sudo[103380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:55:01 devstack sudo[103380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:55:02 devstack sudo[103380]: pam_unix(sudo:session): session closed for user root Jul 08 18:55:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8d71d853-06dc-4a76-b00f-3e4c89e48804 tempest-TestStampPattern-552338204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.661s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:55:02 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-8d71d853-06dc-4a76-b00f-3e4c89e48804 tempest-TestStampPattern-552338204 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:55:02 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-8d71d853-06dc-4a76-b00f-3e4c89e48804 tempest-TestStampPattern-552338204 None] Deleted volume successfully. Jul 08 18:55:02 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-8d71d853-06dc-4a76-b00f-3e4c89e48804 tempest-TestStampPattern-552338204 None] Lock "cinder-9b4e9e68-62e7-443c-b629-b793ce31e961-delete_volume" released by "delete_volume" :: held 2.323s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:55:11 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:UPDATE=21,cinder:SELECT=7,cinder:DELETE=1,cinder:INSERT=1 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:55:12 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:SELECT=14,cinder:INSERT=8,cinder:UPDATE=15,cinder:DELETE=2 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:55:13 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c741cea-43e2-4dcf-ac15-3aa3445a3f13 tempest-CinderUnicodeTest-1899271221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:55:13 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1c741cea-43e2-4dcf-ac15-3aa3445a3f13 tempest-CinderUnicodeTest-1899271221 None] Flow 'volume_create_manager' (ad6aff38-13c4-44e2-b3d2-9a73b6545898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:55:13 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1c741cea-43e2-4dcf-ac15-3aa3445a3f13 tempest-CinderUnicodeTest-1899271221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d33314d4-34f9-47dd-ad7d-4beab5aaa100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:55:13 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1c741cea-43e2-4dcf-ac15-3aa3445a3f13 tempest-CinderUnicodeTest-1899271221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d33314d4-34f9-47dd-ad7d-4beab5aaa100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:55:13Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fc5cfc6-1d6a-4cc2-8b2c-9958d05b7777,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed62403e1bc8468aa4cf32996bb06c6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:55:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:55:13Z,use_quota=True,user_id='94cd63f181d04805b514ca02855186f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:55:13 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1c741cea-43e2-4dcf-ac15-3aa3445a3f13 tempest-CinderUnicodeTest-1899271221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6e1d0bb-a89d-48a9-b423-fd827f60d8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:55:13 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1c741cea-43e2-4dcf-ac15-3aa3445a3f13 tempest-CinderUnicodeTest-1899271221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6e1d0bb-a89d-48a9-b423-fd827f60d8b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:55:13 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1c741cea-43e2-4dcf-ac15-3aa3445a3f13 tempest-CinderUnicodeTest-1899271221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75608b40-8da5-4797-8bbd-c03a1a3d1419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:55:13 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1c741cea-43e2-4dcf-ac15-3aa3445a3f13 tempest-CinderUnicodeTest-1899271221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75608b40-8da5-4797-8bbd-c03a1a3d1419) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fc5cfc6-1d6a-4cc2-8b2c-9958d05b7777', 'volume_name': 'volume-4fc5cfc6-1d6a-4cc2-8b2c-9958d05b7777', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:55:13 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1c741cea-43e2-4dcf-ac15-3aa3445a3f13 tempest-CinderUnicodeTest-1899271221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a3e8fc0-0b4f-499f-95c6-5285f0018915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:55:13 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1c741cea-43e2-4dcf-ac15-3aa3445a3f13 tempest-CinderUnicodeTest-1899271221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a3e8fc0-0b4f-499f-95c6-5285f0018915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:55:13 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1c741cea-43e2-4dcf-ac15-3aa3445a3f13 tempest-CinderUnicodeTest-1899271221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afe816c9-5cc2-4e06-b6d4-6a7b968490bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:55:13 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-1c741cea-43e2-4dcf-ac15-3aa3445a3f13 tempest-CinderUnicodeTest-1899271221 None] Volume 4fc5cfc6-1d6a-4cc2-8b2c-9958d05b7777: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fc5cfc6-1d6a-4cc2-8b2c-9958d05b7777', 'volume_size': 1} Jul 08 18:55:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1c741cea-43e2-4dcf-ac15-3aa3445a3f13 tempest-CinderUnicodeTest-1899271221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:55:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1c741cea-43e2-4dcf-ac15-3aa3445a3f13 tempest-CinderUnicodeTest-1899271221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:55:13 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-1c741cea-43e2-4dcf-ac15-3aa3445a3f13 tempest-CinderUnicodeTest-1899271221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:55:13Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fc5cfc6-1d6a-4cc2-8b2c-9958d05b7777,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed62403e1bc8468aa4cf32996bb06c6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:55:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:55:13Z,use_quota=True,user_id='94cd63f181d04805b514ca02855186f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:55:13 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-1c741cea-43e2-4dcf-ac15-3aa3445a3f13 tempest-CinderUnicodeTest-1899271221 None] Creating volume 4fc5cfc6-1d6a-4cc2-8b2c-9958d05b7777 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:55:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1c741cea-43e2-4dcf-ac15-3aa3445a3f13 tempest-CinderUnicodeTest-1899271221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:55:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1c741cea-43e2-4dcf-ac15-3aa3445a3f13 tempest-CinderUnicodeTest-1899271221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:55:13 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-1c741cea-43e2-4dcf-ac15-3aa3445a3f13 tempest-CinderUnicodeTest-1899271221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:55:13 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-1c741cea-43e2-4dcf-ac15-3aa3445a3f13 tempest-CinderUnicodeTest-1899271221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:55:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1c741cea-43e2-4dcf-ac15-3aa3445a3f13 tempest-CinderUnicodeTest-1899271221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:55:13 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-1c741cea-43e2-4dcf-ac15-3aa3445a3f13 tempest-CinderUnicodeTest-1899271221 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:55:13 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-1c741cea-43e2-4dcf-ac15-3aa3445a3f13 tempest-CinderUnicodeTest-1899271221 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:55:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1c741cea-43e2-4dcf-ac15-3aa3445a3f13 tempest-CinderUnicodeTest-1899271221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4fc5cfc6-1d6a-4cc2-8b2c-9958d05b7777 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:55:13 devstack sudo[103759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4fc5cfc6-1d6a-4cc2-8b2c-9958d05b7777 1073741824 Jul 08 18:55:13 devstack sudo[103759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:55:14 devstack sudo[103759]: pam_unix(sudo:session): session closed for user root Jul 08 18:55:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1c741cea-43e2-4dcf-ac15-3aa3445a3f13 tempest-CinderUnicodeTest-1899271221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4fc5cfc6-1d6a-4cc2-8b2c-9958d05b7777 1073741824" returned: 0 in 0.783s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:55:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1c741cea-43e2-4dcf-ac15-3aa3445a3f13 tempest-CinderUnicodeTest-1899271221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4fc5cfc6-1d6a-4cc2-8b2c-9958d05b7777 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:55:14 devstack sudo[103765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4fc5cfc6-1d6a-4cc2-8b2c-9958d05b7777 Jul 08 18:55:14 devstack sudo[103765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:55:14 devstack sudo[103765]: pam_unix(sudo:session): session closed for user root Jul 08 18:55:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1c741cea-43e2-4dcf-ac15-3aa3445a3f13 tempest-CinderUnicodeTest-1899271221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4fc5cfc6-1d6a-4cc2-8b2c-9958d05b7777" returned: 0 in 0.691s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:55:14 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-1c741cea-43e2-4dcf-ac15-3aa3445a3f13 tempest-CinderUnicodeTest-1899271221 None] <== create_volume: return (1516ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:55:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1c741cea-43e2-4dcf-ac15-3aa3445a3f13 tempest-CinderUnicodeTest-1899271221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.520s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:55:14 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1c741cea-43e2-4dcf-ac15-3aa3445a3f13 tempest-CinderUnicodeTest-1899271221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afe816c9-5cc2-4e06-b6d4-6a7b968490bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fc5cfc6-1d6a-4cc2-8b2c-9958d05b7777', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:55:14 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1c741cea-43e2-4dcf-ac15-3aa3445a3f13 tempest-CinderUnicodeTest-1899271221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8c32c27-da7f-4c53-8f17-be04f5528d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:55:14 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-1c741cea-43e2-4dcf-ac15-3aa3445a3f13 tempest-CinderUnicodeTest-1899271221 None] Volume volume-4fc5cfc6-1d6a-4cc2-8b2c-9958d05b7777 (4fc5cfc6-1d6a-4cc2-8b2c-9958d05b7777): created successfully Jul 08 18:55:14 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1c741cea-43e2-4dcf-ac15-3aa3445a3f13 tempest-CinderUnicodeTest-1899271221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8c32c27-da7f-4c53-8f17-be04f5528d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:55:14 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1c741cea-43e2-4dcf-ac15-3aa3445a3f13 tempest-CinderUnicodeTest-1899271221 None] Flow 'volume_create_manager' (ad6aff38-13c4-44e2-b3d2-9a73b6545898) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:55:14 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-1c741cea-43e2-4dcf-ac15-3aa3445a3f13 tempest-CinderUnicodeTest-1899271221 None] Created volume successfully. Jul 08 18:55:15 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc6c3209-b05e-4bde-b622-2635da5dc69f tempest-CinderUnicodeTest-1899271221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:55:15 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fc6c3209-b05e-4bde-b622-2635da5dc69f tempest-CinderUnicodeTest-1899271221 None] Flow 'volume_create_manager' (638085cf-784c-47a1-a574-ce5c9d49ce07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:55:15 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fc6c3209-b05e-4bde-b622-2635da5dc69f tempest-CinderUnicodeTest-1899271221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (526525b3-2140-4e05-b4d7-65787f0a6861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:55:15 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fc6c3209-b05e-4bde-b622-2635da5dc69f tempest-CinderUnicodeTest-1899271221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (526525b3-2140-4e05-b4d7-65787f0a6861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:55:15Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1029857010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d74c3b1-63af-484a-a268-edc97d9cb890,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed62403e1bc8468aa4cf32996bb06c6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:55:16Z,use_quota=True,user_id='94cd63f181d04805b514ca02855186f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:55:15 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fc6c3209-b05e-4bde-b622-2635da5dc69f tempest-CinderUnicodeTest-1899271221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f113773-9702-4ff3-9186-96888d1fb052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:55:15 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fc6c3209-b05e-4bde-b622-2635da5dc69f tempest-CinderUnicodeTest-1899271221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f113773-9702-4ff3-9186-96888d1fb052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:55:15 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fc6c3209-b05e-4bde-b622-2635da5dc69f tempest-CinderUnicodeTest-1899271221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5130169b-775f-4352-a616-4ae5842884c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:55:15 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fc6c3209-b05e-4bde-b622-2635da5dc69f tempest-CinderUnicodeTest-1899271221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5130169b-775f-4352-a616-4ae5842884c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d74c3b1-63af-484a-a268-edc97d9cb890', 'volume_name': 'volume-4d74c3b1-63af-484a-a268-edc97d9cb890', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:55:15 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fc6c3209-b05e-4bde-b622-2635da5dc69f tempest-CinderUnicodeTest-1899271221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c4df0e1-6e3d-49e9-bbee-f383b6a13a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:55:15 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fc6c3209-b05e-4bde-b622-2635da5dc69f tempest-CinderUnicodeTest-1899271221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c4df0e1-6e3d-49e9-bbee-f383b6a13a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:55:15 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fc6c3209-b05e-4bde-b622-2635da5dc69f tempest-CinderUnicodeTest-1899271221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a5d2a2a-981c-4c8e-9f5e-47d7b334a031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:55:15 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-fc6c3209-b05e-4bde-b622-2635da5dc69f tempest-CinderUnicodeTest-1899271221 None] Volume 4d74c3b1-63af-484a-a268-edc97d9cb890: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d74c3b1-63af-484a-a268-edc97d9cb890', 'volume_size': 1} Jul 08 18:55:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-fc6c3209-b05e-4bde-b622-2635da5dc69f tempest-CinderUnicodeTest-1899271221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:55:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-fc6c3209-b05e-4bde-b622-2635da5dc69f tempest-CinderUnicodeTest-1899271221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:55:15 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-fc6c3209-b05e-4bde-b622-2635da5dc69f tempest-CinderUnicodeTest-1899271221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:55:15Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1029857010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d74c3b1-63af-484a-a268-edc97d9cb890,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed62403e1bc8468aa4cf32996bb06c6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:55:16Z,use_quota=True,user_id='94cd63f181d04805b514ca02855186f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:55:15 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-fc6c3209-b05e-4bde-b622-2635da5dc69f tempest-CinderUnicodeTest-1899271221 None] Creating volume 4d74c3b1-63af-484a-a268-edc97d9cb890 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:55:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-fc6c3209-b05e-4bde-b622-2635da5dc69f tempest-CinderUnicodeTest-1899271221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:55:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-fc6c3209-b05e-4bde-b622-2635da5dc69f tempest-CinderUnicodeTest-1899271221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:55:15 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-fc6c3209-b05e-4bde-b622-2635da5dc69f tempest-CinderUnicodeTest-1899271221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:55:15 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-fc6c3209-b05e-4bde-b622-2635da5dc69f tempest-CinderUnicodeTest-1899271221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:55:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-fc6c3209-b05e-4bde-b622-2635da5dc69f tempest-CinderUnicodeTest-1899271221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:55:15 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-fc6c3209-b05e-4bde-b622-2635da5dc69f tempest-CinderUnicodeTest-1899271221 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:55:15 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-fc6c3209-b05e-4bde-b622-2635da5dc69f tempest-CinderUnicodeTest-1899271221 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:55:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-fc6c3209-b05e-4bde-b622-2635da5dc69f tempest-CinderUnicodeTest-1899271221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4d74c3b1-63af-484a-a268-edc97d9cb890 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:55:15 devstack sudo[103768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4d74c3b1-63af-484a-a268-edc97d9cb890 1073741824 Jul 08 18:55:15 devstack sudo[103768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:55:16 devstack sudo[103768]: pam_unix(sudo:session): session closed for user root Jul 08 18:55:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-fc6c3209-b05e-4bde-b622-2635da5dc69f tempest-CinderUnicodeTest-1899271221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4d74c3b1-63af-484a-a268-edc97d9cb890 1073741824" returned: 0 in 0.838s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:55:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-fc6c3209-b05e-4bde-b622-2635da5dc69f tempest-CinderUnicodeTest-1899271221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4d74c3b1-63af-484a-a268-edc97d9cb890 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:55:16 devstack sudo[103866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4d74c3b1-63af-484a-a268-edc97d9cb890 Jul 08 18:55:16 devstack sudo[103866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:55:17 devstack sudo[103866]: pam_unix(sudo:session): session closed for user root Jul 08 18:55:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-fc6c3209-b05e-4bde-b622-2635da5dc69f tempest-CinderUnicodeTest-1899271221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4d74c3b1-63af-484a-a268-edc97d9cb890" returned: 0 in 0.662s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:55:17 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-fc6c3209-b05e-4bde-b622-2635da5dc69f tempest-CinderUnicodeTest-1899271221 None] <== create_volume: return (1547ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:55:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-fc6c3209-b05e-4bde-b622-2635da5dc69f tempest-CinderUnicodeTest-1899271221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.550s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:55:17 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fc6c3209-b05e-4bde-b622-2635da5dc69f tempest-CinderUnicodeTest-1899271221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a5d2a2a-981c-4c8e-9f5e-47d7b334a031) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d74c3b1-63af-484a-a268-edc97d9cb890', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:55:17 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fc6c3209-b05e-4bde-b622-2635da5dc69f tempest-CinderUnicodeTest-1899271221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0907867-5492-4040-8a5a-8286441a6302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:55:17 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-fc6c3209-b05e-4bde-b622-2635da5dc69f tempest-CinderUnicodeTest-1899271221 None] Volume volume-4d74c3b1-63af-484a-a268-edc97d9cb890 (4d74c3b1-63af-484a-a268-edc97d9cb890): created successfully Jul 08 18:55:17 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fc6c3209-b05e-4bde-b622-2635da5dc69f tempest-CinderUnicodeTest-1899271221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0907867-5492-4040-8a5a-8286441a6302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:55:17 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fc6c3209-b05e-4bde-b622-2635da5dc69f tempest-CinderUnicodeTest-1899271221 None] Flow 'volume_create_manager' (638085cf-784c-47a1-a574-ce5c9d49ce07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:55:17 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-fc6c3209-b05e-4bde-b622-2635da5dc69f tempest-CinderUnicodeTest-1899271221 None] Created volume successfully. Jul 08 18:55:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-20594653-bda0-4043-88f0-8278acdb948b tempest-CinderUnicodeTest-1899271221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:55:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-20594653-bda0-4043-88f0-8278acdb948b tempest-CinderUnicodeTest-1899271221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:55:18 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-20594653-bda0-4043-88f0-8278acdb948b tempest-CinderUnicodeTest-1899271221 None] Creating offline snapshot 624ae290-64c5-48b5-89e4-dac385692dd0 of volume 4d74c3b1-63af-484a-a268-edc97d9cb890 {{(pid=86873) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:55:18 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84bda99-0c73-45b8-82f3-c82289b95023]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:55:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-20594653-bda0-4043-88f0-8278acdb948b tempest-CinderUnicodeTest-1899271221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4d74c3b1-63af-484a-a268-edc97d9cb890 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:55:18 devstack sudo[103869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4d74c3b1-63af-484a-a268-edc97d9cb890 Jul 08 18:55:18 devstack sudo[103869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:55:18 devstack sudo[103869]: pam_unix(sudo:session): session closed for user root Jul 08 18:55:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-20594653-bda0-4043-88f0-8278acdb948b tempest-CinderUnicodeTest-1899271221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4d74c3b1-63af-484a-a268-edc97d9cb890" returned: 0 in 0.749s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:55:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-20594653-bda0-4043-88f0-8278acdb948b tempest-CinderUnicodeTest-1899271221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4d74c3b1-63af-484a-a268-edc97d9cb890,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4d74c3b1-63af-484a-a268-edc97d9cb890.624ae290-64c5-48b5-89e4-dac385692dd0 1G {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:55:18 devstack sudo[103874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4d74c3b1-63af-484a-a268-edc97d9cb890,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4d74c3b1-63af-484a-a268-edc97d9cb890.624ae290-64c5-48b5-89e4-dac385692dd0 1G Jul 08 18:55:18 devstack sudo[103874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:55:19 devstack sudo[103874]: pam_unix(sudo:session): session closed for user root Jul 08 18:55:19 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-20594653-bda0-4043-88f0-8278acdb948b tempest-CinderUnicodeTest-1899271221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4d74c3b1-63af-484a-a268-edc97d9cb890,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4d74c3b1-63af-484a-a268-edc97d9cb890.624ae290-64c5-48b5-89e4-dac385692dd0 1G" returned: 0 in 0.768s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:55:19 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-20594653-bda0-4043-88f0-8278acdb948b tempest-CinderUnicodeTest-1899271221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d74c3b1-63af-484a-a268-edc97d9cb890 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4d74c3b1-63af-484a-a268-edc97d9cb890.624ae290-64c5-48b5-89e4-dac385692dd0 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:55:19 devstack sudo[103880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d74c3b1-63af-484a-a268-edc97d9cb890 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4d74c3b1-63af-484a-a268-edc97d9cb890.624ae290-64c5-48b5-89e4-dac385692dd0 Jul 08 18:55:19 devstack sudo[103880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:55:20 devstack sudo[103880]: pam_unix(sudo:session): session closed for user root Jul 08 18:55:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-20594653-bda0-4043-88f0-8278acdb948b tempest-CinderUnicodeTest-1899271221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d74c3b1-63af-484a-a268-edc97d9cb890 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4d74c3b1-63af-484a-a268-edc97d9cb890.624ae290-64c5-48b5-89e4-dac385692dd0" returned: 0 in 0.675s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:55:20 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-20594653-bda0-4043-88f0-8278acdb948b tempest-CinderUnicodeTest-1899271221 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4d74c3b1-63af-484a-a268-edc97d9cb890.624ae290-64c5-48b5-89e4-dac385692dd0 is being set with open permissions: ugo+rw Jul 08 18:55:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-20594653-bda0-4043-88f0-8278acdb948b tempest-CinderUnicodeTest-1899271221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4d74c3b1-63af-484a-a268-edc97d9cb890.624ae290-64c5-48b5-89e4-dac385692dd0 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:55:20 devstack sudo[103885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4d74c3b1-63af-484a-a268-edc97d9cb890.624ae290-64c5-48b5-89e4-dac385692dd0 Jul 08 18:55:20 devstack sudo[103885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:55:20 devstack sudo[103885]: pam_unix(sudo:session): session closed for user root Jul 08 18:55:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-20594653-bda0-4043-88f0-8278acdb948b tempest-CinderUnicodeTest-1899271221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4d74c3b1-63af-484a-a268-edc97d9cb890.624ae290-64c5-48b5-89e4-dac385692dd0" returned: 0 in 0.631s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:55:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-20594653-bda0-4043-88f0-8278acdb948b tempest-CinderUnicodeTest-1899271221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4d74c3b1-63af-484a-a268-edc97d9cb890.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:55:20 devstack sudo[103888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4d74c3b1-63af-484a-a268-edc97d9cb890.info Jul 08 18:55:20 devstack sudo[103888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:55:21 devstack sudo[103888]: pam_unix(sudo:session): session closed for user root Jul 08 18:55:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-20594653-bda0-4043-88f0-8278acdb948b tempest-CinderUnicodeTest-1899271221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4d74c3b1-63af-484a-a268-edc97d9cb890.info" returned: 0 in 0.671s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:55:21 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-20594653-bda0-4043-88f0-8278acdb948b tempest-CinderUnicodeTest-1899271221 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4d74c3b1-63af-484a-a268-edc97d9cb890.info is being set with open permissions: ugo+rw Jul 08 18:55:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-20594653-bda0-4043-88f0-8278acdb948b tempest-CinderUnicodeTest-1899271221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4d74c3b1-63af-484a-a268-edc97d9cb890.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:55:21 devstack sudo[103891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4d74c3b1-63af-484a-a268-edc97d9cb890.info Jul 08 18:55:21 devstack sudo[103891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:55:22 devstack sudo[103891]: pam_unix(sudo:session): session closed for user root Jul 08 18:55:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-20594653-bda0-4043-88f0-8278acdb948b tempest-CinderUnicodeTest-1899271221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4d74c3b1-63af-484a-a268-edc97d9cb890.info" returned: 0 in 0.631s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:55:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-20594653-bda0-4043-88f0-8278acdb948b tempest-CinderUnicodeTest-1899271221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.212s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:55:22 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-20594653-bda0-4043-88f0-8278acdb948b tempest-CinderUnicodeTest-1899271221 None] Create snapshot completed successfully Jul 08 18:55:23 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9bc7d3e7-2057-4ad4-a751-14a2d4602a82 tempest-CinderUnicodeTest-1899271221 None] Acquiring lock "cinder-624ae290-64c5-48b5-89e4-dac385692dd0-delete_snapshot" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:55:23 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9bc7d3e7-2057-4ad4-a751-14a2d4602a82 tempest-CinderUnicodeTest-1899271221 None] Lock "cinder-624ae290-64c5-48b5-89e4-dac385692dd0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:55:23 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9bc7d3e7-2057-4ad4-a751-14a2d4602a82 tempest-CinderUnicodeTest-1899271221 None] Acquiring lock "cinder-quobyte-4d74c3b1-63af-484a-a268-edc97d9cb890" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:55:23 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9bc7d3e7-2057-4ad4-a751-14a2d4602a82 tempest-CinderUnicodeTest-1899271221 None] Lock "cinder-quobyte-4d74c3b1-63af-484a-a268-edc97d9cb890" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:55:23 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9bc7d3e7-2057-4ad4-a751-14a2d4602a82 tempest-CinderUnicodeTest-1899271221 None] Acquiring lock "cinder-quobyte-624ae290-64c5-48b5-89e4-dac385692dd0" by "_delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:55:23 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9bc7d3e7-2057-4ad4-a751-14a2d4602a82 tempest-CinderUnicodeTest-1899271221 None] Lock "cinder-quobyte-624ae290-64c5-48b5-89e4-dac385692dd0" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:55:23 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-9bc7d3e7-2057-4ad4-a751-14a2d4602a82 tempest-CinderUnicodeTest-1899271221 None] Deleting offline snapshot 624ae290-64c5-48b5-89e4-dac385692dd0 of volume 4d74c3b1-63af-484a-a268-edc97d9cb890 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:55:23 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-9bc7d3e7-2057-4ad4-a751-14a2d4602a82 tempest-CinderUnicodeTest-1899271221 None] snapshot_file for this snap is: volume-4d74c3b1-63af-484a-a268-edc97d9cb890.624ae290-64c5-48b5-89e4-dac385692dd0 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:55:23 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c50364-8518-4aeb-9da6-47bc1caa4324]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:55:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9bc7d3e7-2057-4ad4-a751-14a2d4602a82 tempest-CinderUnicodeTest-1899271221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4d74c3b1-63af-484a-a268-edc97d9cb890.624ae290-64c5-48b5-89e4-dac385692dd0 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:55:23 devstack sudo[103895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4d74c3b1-63af-484a-a268-edc97d9cb890.624ae290-64c5-48b5-89e4-dac385692dd0 Jul 08 18:55:23 devstack sudo[103895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:55:24 devstack sudo[103895]: pam_unix(sudo:session): session closed for user root Jul 08 18:55:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9bc7d3e7-2057-4ad4-a751-14a2d4602a82 tempest-CinderUnicodeTest-1899271221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4d74c3b1-63af-484a-a268-edc97d9cb890.624ae290-64c5-48b5-89e4-dac385692dd0" returned: 0 in 0.757s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:55:24 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-9bc7d3e7-2057-4ad4-a751-14a2d4602a82 tempest-CinderUnicodeTest-1899271221 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d74c3b1-63af-484a-a268-edc97d9cb890(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:55:24 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eac4f73-0dab-4435-b930-a44409f8f454]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:55:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9bc7d3e7-2057-4ad4-a751-14a2d4602a82 tempest-CinderUnicodeTest-1899271221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4d74c3b1-63af-484a-a268-edc97d9cb890 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:55:24 devstack sudo[103901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4d74c3b1-63af-484a-a268-edc97d9cb890 Jul 08 18:55:24 devstack sudo[103901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:55:24 devstack sudo[103901]: pam_unix(sudo:session): session closed for user root Jul 08 18:55:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9bc7d3e7-2057-4ad4-a751-14a2d4602a82 tempest-CinderUnicodeTest-1899271221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4d74c3b1-63af-484a-a268-edc97d9cb890" returned: 0 in 0.749s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:55:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9bc7d3e7-2057-4ad4-a751-14a2d4602a82 tempest-CinderUnicodeTest-1899271221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4d74c3b1-63af-484a-a268-edc97d9cb890.624ae290-64c5-48b5-89e4-dac385692dd0 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:55:24 devstack sudo[103906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4d74c3b1-63af-484a-a268-edc97d9cb890.624ae290-64c5-48b5-89e4-dac385692dd0 Jul 08 18:55:24 devstack sudo[103906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:55:25 devstack sudo[103906]: pam_unix(sudo:session): session closed for user root Jul 08 18:55:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9bc7d3e7-2057-4ad4-a751-14a2d4602a82 tempest-CinderUnicodeTest-1899271221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4d74c3b1-63af-484a-a268-edc97d9cb890.624ae290-64c5-48b5-89e4-dac385692dd0" returned: 0 in 0.712s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:55:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9bc7d3e7-2057-4ad4-a751-14a2d4602a82 tempest-CinderUnicodeTest-1899271221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4d74c3b1-63af-484a-a268-edc97d9cb890.624ae290-64c5-48b5-89e4-dac385692dd0 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:55:25 devstack sudo[103911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4d74c3b1-63af-484a-a268-edc97d9cb890.624ae290-64c5-48b5-89e4-dac385692dd0 Jul 08 18:55:25 devstack sudo[103911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:55:26 devstack sudo[103911]: pam_unix(sudo:session): session closed for user root Jul 08 18:55:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9bc7d3e7-2057-4ad4-a751-14a2d4602a82 tempest-CinderUnicodeTest-1899271221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4d74c3b1-63af-484a-a268-edc97d9cb890.624ae290-64c5-48b5-89e4-dac385692dd0" returned: 0 in 0.640s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:55:26 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9bc7d3e7-2057-4ad4-a751-14a2d4602a82 tempest-CinderUnicodeTest-1899271221 None] Lock "cinder-quobyte-624ae290-64c5-48b5-89e4-dac385692dd0" released by "_delete_snapshot" :: held 2.961s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:55:26 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9bc7d3e7-2057-4ad4-a751-14a2d4602a82 tempest-CinderUnicodeTest-1899271221 None] Lock "cinder-quobyte-4d74c3b1-63af-484a-a268-edc97d9cb890" released by "delete_snapshot" :: held 2.985s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:55:26 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-9bc7d3e7-2057-4ad4-a751-14a2d4602a82 tempest-CinderUnicodeTest-1899271221 None] Created reservations ['78bb661d-4135-4db8-9e22-cd8d89c29a14', '4ed2c20e-ce9f-4129-9b1f-d215241c4347', '952cbe45-569c-4af6-b339-f281cfa14b86', 'ee812d12-baf1-40ce-ae75-53b3a9d5782e'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:55:26 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-9bc7d3e7-2057-4ad4-a751-14a2d4602a82 tempest-CinderUnicodeTest-1899271221 None] Delete snapshot completed successfully. Jul 08 18:55:26 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9bc7d3e7-2057-4ad4-a751-14a2d4602a82 tempest-CinderUnicodeTest-1899271221 None] Lock "cinder-624ae290-64c5-48b5-89e4-dac385692dd0-delete_snapshot" released by "delete_snapshot" :: held 3.110s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:55:26 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-d69f7101-a904-4173-b85b-f425f8ea8aab tempest-CinderUnicodeTest-1899271221 None] Acquiring lock "cinder-4d74c3b1-63af-484a-a268-edc97d9cb890-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:55:26 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-d69f7101-a904-4173-b85b-f425f8ea8aab tempest-CinderUnicodeTest-1899271221 None] Lock "cinder-4d74c3b1-63af-484a-a268-edc97d9cb890-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:55:26 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-d69f7101-a904-4173-b85b-f425f8ea8aab tempest-CinderUnicodeTest-1899271221 None] Acquiring lock "cinder-quobyte-4d74c3b1-63af-484a-a268-edc97d9cb890" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:55:26 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-d69f7101-a904-4173-b85b-f425f8ea8aab tempest-CinderUnicodeTest-1899271221 None] Lock "cinder-quobyte-4d74c3b1-63af-484a-a268-edc97d9cb890" acquired by "delete_volume" :: waited 0.015s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:55:26 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[356a0576-dcc7-4e3d-9594-a0f1cb32d4ac]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:55:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d69f7101-a904-4173-b85b-f425f8ea8aab tempest-CinderUnicodeTest-1899271221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4d74c3b1-63af-484a-a268-edc97d9cb890 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:55:26 devstack sudo[103914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4d74c3b1-63af-484a-a268-edc97d9cb890 Jul 08 18:55:26 devstack sudo[103914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:55:27 devstack sudo[103914]: pam_unix(sudo:session): session closed for user root Jul 08 18:55:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d69f7101-a904-4173-b85b-f425f8ea8aab tempest-CinderUnicodeTest-1899271221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4d74c3b1-63af-484a-a268-edc97d9cb890" returned: 0 in 0.745s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:55:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d69f7101-a904-4173-b85b-f425f8ea8aab tempest-CinderUnicodeTest-1899271221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4d74c3b1-63af-484a-a268-edc97d9cb890 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:55:27 devstack sudo[103919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4d74c3b1-63af-484a-a268-edc97d9cb890 Jul 08 18:55:27 devstack sudo[103919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:55:27 devstack sudo[103919]: pam_unix(sudo:session): session closed for user root Jul 08 18:55:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d69f7101-a904-4173-b85b-f425f8ea8aab tempest-CinderUnicodeTest-1899271221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4d74c3b1-63af-484a-a268-edc97d9cb890" returned: 0 in 0.638s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:55:27 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-d69f7101-a904-4173-b85b-f425f8ea8aab tempest-CinderUnicodeTest-1899271221 None] Lock "cinder-quobyte-4d74c3b1-63af-484a-a268-edc97d9cb890" released by "delete_volume" :: held 1.439s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:55:28 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-d69f7101-a904-4173-b85b-f425f8ea8aab tempest-CinderUnicodeTest-1899271221 None] Created reservations ['2f89b67d-c367-4c86-9c26-94b710a32703', '27cd078c-eff2-4c69-99d2-860b2906427d', '6823152f-62c6-4322-b301-19ed3c493a2a', '5e7c8ef8-ebe1-4823-88f5-d68372cf953e'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:55:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-d69f7101-a904-4173-b85b-f425f8ea8aab tempest-CinderUnicodeTest-1899271221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:55:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-d69f7101-a904-4173-b85b-f425f8ea8aab tempest-CinderUnicodeTest-1899271221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:55:28 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-d69f7101-a904-4173-b85b-f425f8ea8aab tempest-CinderUnicodeTest-1899271221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:55:28 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-d69f7101-a904-4173-b85b-f425f8ea8aab tempest-CinderUnicodeTest-1899271221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:55:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-d69f7101-a904-4173-b85b-f425f8ea8aab tempest-CinderUnicodeTest-1899271221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:55:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d69f7101-a904-4173-b85b-f425f8ea8aab tempest-CinderUnicodeTest-1899271221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:55:28 devstack sudo[103922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:55:28 devstack sudo[103922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:55:28 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-2be47825-dbed-44ef-bcab-06d083e89ff1 tempest-CinderUnicodeTest-1899271221 None] Acquiring lock "cinder-4fc5cfc6-1d6a-4cc2-8b2c-9958d05b7777-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:55:28 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-2be47825-dbed-44ef-bcab-06d083e89ff1 tempest-CinderUnicodeTest-1899271221 None] Lock "cinder-4fc5cfc6-1d6a-4cc2-8b2c-9958d05b7777-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:55:28 devstack sudo[103922]: pam_unix(sudo:session): session closed for user root Jul 08 18:55:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d69f7101-a904-4173-b85b-f425f8ea8aab tempest-CinderUnicodeTest-1899271221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.648s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:55:28 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-d69f7101-a904-4173-b85b-f425f8ea8aab tempest-CinderUnicodeTest-1899271221 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:55:28 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-d69f7101-a904-4173-b85b-f425f8ea8aab tempest-CinderUnicodeTest-1899271221 None] Deleted volume successfully. Jul 08 18:55:28 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-2be47825-dbed-44ef-bcab-06d083e89ff1 tempest-CinderUnicodeTest-1899271221 None] Acquiring lock "cinder-quobyte-4fc5cfc6-1d6a-4cc2-8b2c-9958d05b7777" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:55:28 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-d69f7101-a904-4173-b85b-f425f8ea8aab tempest-CinderUnicodeTest-1899271221 None] Lock "cinder-4d74c3b1-63af-484a-a268-edc97d9cb890-delete_volume" released by "delete_volume" :: held 2.285s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:55:28 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-2be47825-dbed-44ef-bcab-06d083e89ff1 tempest-CinderUnicodeTest-1899271221 None] Lock "cinder-quobyte-4fc5cfc6-1d6a-4cc2-8b2c-9958d05b7777" acquired by "delete_volume" :: waited 0.018s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:55:28 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d31798a-8459-4964-8535-825e7e5604ef]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:55:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2be47825-dbed-44ef-bcab-06d083e89ff1 tempest-CinderUnicodeTest-1899271221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4fc5cfc6-1d6a-4cc2-8b2c-9958d05b7777 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:55:28 devstack sudo[103925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4fc5cfc6-1d6a-4cc2-8b2c-9958d05b7777 Jul 08 18:55:28 devstack sudo[103925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:55:29 devstack sudo[103925]: pam_unix(sudo:session): session closed for user root Jul 08 18:55:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2be47825-dbed-44ef-bcab-06d083e89ff1 tempest-CinderUnicodeTest-1899271221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4fc5cfc6-1d6a-4cc2-8b2c-9958d05b7777" returned: 0 in 0.741s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:55:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2be47825-dbed-44ef-bcab-06d083e89ff1 tempest-CinderUnicodeTest-1899271221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4fc5cfc6-1d6a-4cc2-8b2c-9958d05b7777 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:55:29 devstack sudo[103930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4fc5cfc6-1d6a-4cc2-8b2c-9958d05b7777 Jul 08 18:55:29 devstack sudo[103930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:55:30 devstack sudo[103930]: pam_unix(sudo:session): session closed for user root Jul 08 18:55:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2be47825-dbed-44ef-bcab-06d083e89ff1 tempest-CinderUnicodeTest-1899271221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-4fc5cfc6-1d6a-4cc2-8b2c-9958d05b7777" returned: 0 in 0.643s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:55:30 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-2be47825-dbed-44ef-bcab-06d083e89ff1 tempest-CinderUnicodeTest-1899271221 None] Lock "cinder-quobyte-4fc5cfc6-1d6a-4cc2-8b2c-9958d05b7777" released by "delete_volume" :: held 1.421s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:55:30 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-2be47825-dbed-44ef-bcab-06d083e89ff1 tempest-CinderUnicodeTest-1899271221 None] Created reservations ['cefefdb7-5a73-4061-961e-e7f0ee819190', '761d6a01-568d-4a50-8b50-38e846d194c4', 'e601f97d-493b-442e-85e1-ac4f7640a31f', 'ded85a6d-d69f-4744-9588-d7840861fc26'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:55:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-2be47825-dbed-44ef-bcab-06d083e89ff1 tempest-CinderUnicodeTest-1899271221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:55:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-2be47825-dbed-44ef-bcab-06d083e89ff1 tempest-CinderUnicodeTest-1899271221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:55:30 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-2be47825-dbed-44ef-bcab-06d083e89ff1 tempest-CinderUnicodeTest-1899271221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:55:30 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-2be47825-dbed-44ef-bcab-06d083e89ff1 tempest-CinderUnicodeTest-1899271221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:55:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-2be47825-dbed-44ef-bcab-06d083e89ff1 tempest-CinderUnicodeTest-1899271221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:55:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2be47825-dbed-44ef-bcab-06d083e89ff1 tempest-CinderUnicodeTest-1899271221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:55:30 devstack sudo[103933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:55:30 devstack sudo[103933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:55:30 devstack sudo[103933]: pam_unix(sudo:session): session closed for user root Jul 08 18:55:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2be47825-dbed-44ef-bcab-06d083e89ff1 tempest-CinderUnicodeTest-1899271221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.654s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:55:30 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-2be47825-dbed-44ef-bcab-06d083e89ff1 tempest-CinderUnicodeTest-1899271221 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:55:30 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-2be47825-dbed-44ef-bcab-06d083e89ff1 tempest-CinderUnicodeTest-1899271221 None] Deleted volume successfully. Jul 08 18:55:30 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-2be47825-dbed-44ef-bcab-06d083e89ff1 tempest-CinderUnicodeTest-1899271221 None] Lock "cinder-4fc5cfc6-1d6a-4cc2-8b2c-9958d05b7777-delete_volume" released by "delete_volume" :: held 2.276s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:55:40 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:UPDATE=30,cinder:SELECT=25,cinder:INSERT=10,cinder:DELETE=2 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:55:40 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:SELECT=21,cinder:INSERT=5,cinder:UPDATE=28,cinder:DELETE=3 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:55:48 devstack cinder-volume[86873]: DEBUG oslo_service.periodic_task [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86873) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:55:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:55:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:55:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:55:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:55:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:55:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:55:48 devstack sudo[103939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:55:48 devstack sudo[103939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:55:48 devstack sudo[103939]: pam_unix(sudo:session): session closed for user root Jul 08 18:55:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.722s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:55:48 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:55:48 devstack cinder-volume[86873]: DEBUG oslo_service.periodic_task [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running periodic task VolumeManager._thread_info {{(pid=86873) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:55:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] thread count: 29 {{(pid=86873) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:55:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] thread info: [<_MainThread(MainThread, started 138577734545536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86873) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:55:57 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b888840-3ce6-453c-97f5-97935a806d3c tempest-SnapshotDependencyTests-441350322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:55:57 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6b888840-3ce6-453c-97f5-97935a806d3c tempest-SnapshotDependencyTests-441350322 None] Flow 'volume_create_manager' (481aee42-dc66-4855-85e1-cd0ad14d3a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:55:57 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6b888840-3ce6-453c-97f5-97935a806d3c tempest-SnapshotDependencyTests-441350322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2ed2abb-0313-49d9-a14f-0371f96ab590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:55:57 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6b888840-3ce6-453c-97f5-97935a806d3c tempest-SnapshotDependencyTests-441350322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2ed2abb-0313-49d9-a14f-0371f96ab590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:55:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1510082140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de4ecfa5-89f7-497b-8fd1-ff894fb8cba9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='223bebc711fe40baac40a726545f7e5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:55:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:55:58Z,use_quota=True,user_id='9648b3fd91db41c281f0c295be755042',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:55:57 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6b888840-3ce6-453c-97f5-97935a806d3c tempest-SnapshotDependencyTests-441350322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07eaac40-5c00-4c0c-9fe3-b7c847441e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:55:57 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6b888840-3ce6-453c-97f5-97935a806d3c tempest-SnapshotDependencyTests-441350322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07eaac40-5c00-4c0c-9fe3-b7c847441e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:55:57 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6b888840-3ce6-453c-97f5-97935a806d3c tempest-SnapshotDependencyTests-441350322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e7f8441-e93e-4d03-bfba-f3c67c1fdaab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:55:57 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6b888840-3ce6-453c-97f5-97935a806d3c tempest-SnapshotDependencyTests-441350322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e7f8441-e93e-4d03-bfba-f3c67c1fdaab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de4ecfa5-89f7-497b-8fd1-ff894fb8cba9', 'volume_name': 'volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:55:57 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6b888840-3ce6-453c-97f5-97935a806d3c tempest-SnapshotDependencyTests-441350322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (766c8b16-0761-4295-9c42-c433191c7f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:55:57 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6b888840-3ce6-453c-97f5-97935a806d3c tempest-SnapshotDependencyTests-441350322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (766c8b16-0761-4295-9c42-c433191c7f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:55:57 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6b888840-3ce6-453c-97f5-97935a806d3c tempest-SnapshotDependencyTests-441350322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9652c284-2aca-4475-9844-954cbea6ec39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:55:57 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-6b888840-3ce6-453c-97f5-97935a806d3c tempest-SnapshotDependencyTests-441350322 None] Volume de4ecfa5-89f7-497b-8fd1-ff894fb8cba9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9', 'volume_size': 1} Jul 08 18:55:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6b888840-3ce6-453c-97f5-97935a806d3c tempest-SnapshotDependencyTests-441350322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:55:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6b888840-3ce6-453c-97f5-97935a806d3c tempest-SnapshotDependencyTests-441350322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:55:57 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-6b888840-3ce6-453c-97f5-97935a806d3c tempest-SnapshotDependencyTests-441350322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:55:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1510082140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de4ecfa5-89f7-497b-8fd1-ff894fb8cba9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='223bebc711fe40baac40a726545f7e5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:55:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:55:58Z,use_quota=True,user_id='9648b3fd91db41c281f0c295be755042',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:55:57 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-6b888840-3ce6-453c-97f5-97935a806d3c tempest-SnapshotDependencyTests-441350322 None] Creating volume de4ecfa5-89f7-497b-8fd1-ff894fb8cba9 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:55:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6b888840-3ce6-453c-97f5-97935a806d3c tempest-SnapshotDependencyTests-441350322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:55:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6b888840-3ce6-453c-97f5-97935a806d3c tempest-SnapshotDependencyTests-441350322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:55:57 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-6b888840-3ce6-453c-97f5-97935a806d3c tempest-SnapshotDependencyTests-441350322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:55:57 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-6b888840-3ce6-453c-97f5-97935a806d3c tempest-SnapshotDependencyTests-441350322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:55:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6b888840-3ce6-453c-97f5-97935a806d3c tempest-SnapshotDependencyTests-441350322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:55:57 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-6b888840-3ce6-453c-97f5-97935a806d3c tempest-SnapshotDependencyTests-441350322 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:55:57 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-6b888840-3ce6-453c-97f5-97935a806d3c tempest-SnapshotDependencyTests-441350322 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:55:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6b888840-3ce6-453c-97f5-97935a806d3c tempest-SnapshotDependencyTests-441350322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:55:58 devstack sudo[103943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9 1073741824 Jul 08 18:55:58 devstack sudo[103943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:55:58 devstack sudo[103943]: pam_unix(sudo:session): session closed for user root Jul 08 18:55:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6b888840-3ce6-453c-97f5-97935a806d3c tempest-SnapshotDependencyTests-441350322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9 1073741824" returned: 0 in 0.825s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:55:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6b888840-3ce6-453c-97f5-97935a806d3c tempest-SnapshotDependencyTests-441350322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:55:58 devstack sudo[103949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9 Jul 08 18:55:58 devstack sudo[103949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:55:59 devstack sudo[103949]: pam_unix(sudo:session): session closed for user root Jul 08 18:55:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6b888840-3ce6-453c-97f5-97935a806d3c tempest-SnapshotDependencyTests-441350322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9" returned: 0 in 0.639s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:55:59 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-6b888840-3ce6-453c-97f5-97935a806d3c tempest-SnapshotDependencyTests-441350322 None] <== create_volume: return (1523ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:55:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6b888840-3ce6-453c-97f5-97935a806d3c tempest-SnapshotDependencyTests-441350322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:55:59 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6b888840-3ce6-453c-97f5-97935a806d3c tempest-SnapshotDependencyTests-441350322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9652c284-2aca-4475-9844-954cbea6ec39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:55:59 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6b888840-3ce6-453c-97f5-97935a806d3c tempest-SnapshotDependencyTests-441350322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb85b0f8-dc40-442a-89c5-caaed2a173c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:55:59 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-6b888840-3ce6-453c-97f5-97935a806d3c tempest-SnapshotDependencyTests-441350322 None] Volume volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9 (de4ecfa5-89f7-497b-8fd1-ff894fb8cba9): created successfully Jul 08 18:55:59 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6b888840-3ce6-453c-97f5-97935a806d3c tempest-SnapshotDependencyTests-441350322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb85b0f8-dc40-442a-89c5-caaed2a173c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:55:59 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-6b888840-3ce6-453c-97f5-97935a806d3c tempest-SnapshotDependencyTests-441350322 None] Flow 'volume_create_manager' (481aee42-dc66-4855-85e1-cd0ad14d3a1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:55:59 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-6b888840-3ce6-453c-97f5-97935a806d3c tempest-SnapshotDependencyTests-441350322 None] Created volume successfully. Jul 08 18:56:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-93ebb32d-10de-4238-a477-33190818c44c tempest-SnapshotDependencyTests-441350322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:56:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-93ebb32d-10de-4238-a477-33190818c44c tempest-SnapshotDependencyTests-441350322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:56:00 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-93ebb32d-10de-4238-a477-33190818c44c tempest-SnapshotDependencyTests-441350322 None] Creating offline snapshot 9ea935ac-3ba6-4b2a-ac91-c2c62c7d4e74 of volume de4ecfa5-89f7-497b-8fd1-ff894fb8cba9 {{(pid=86873) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:56:00 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0a6ef6-03b6-40c7-ad0a-dca61ef7f854]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:56:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-93ebb32d-10de-4238-a477-33190818c44c tempest-SnapshotDependencyTests-441350322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:00 devstack sudo[103953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9 Jul 08 18:56:00 devstack sudo[103953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:00 devstack sudo[103953]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-93ebb32d-10de-4238-a477-33190818c44c tempest-SnapshotDependencyTests-441350322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9" returned: 0 in 0.766s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-93ebb32d-10de-4238-a477-33190818c44c tempest-SnapshotDependencyTests-441350322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9.9ea935ac-3ba6-4b2a-ac91-c2c62c7d4e74 1G {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:01 devstack sudo[103958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9.9ea935ac-3ba6-4b2a-ac91-c2c62c7d4e74 1G Jul 08 18:56:01 devstack sudo[103958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:01 devstack sudo[103958]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-93ebb32d-10de-4238-a477-33190818c44c tempest-SnapshotDependencyTests-441350322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9.9ea935ac-3ba6-4b2a-ac91-c2c62c7d4e74 1G" returned: 0 in 0.820s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-93ebb32d-10de-4238-a477-33190818c44c tempest-SnapshotDependencyTests-441350322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9.9ea935ac-3ba6-4b2a-ac91-c2c62c7d4e74 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:01 devstack sudo[103964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9.9ea935ac-3ba6-4b2a-ac91-c2c62c7d4e74 Jul 08 18:56:01 devstack sudo[103964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:02 devstack sudo[103964]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-93ebb32d-10de-4238-a477-33190818c44c tempest-SnapshotDependencyTests-441350322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9.9ea935ac-3ba6-4b2a-ac91-c2c62c7d4e74" returned: 0 in 0.691s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:02 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-93ebb32d-10de-4238-a477-33190818c44c tempest-SnapshotDependencyTests-441350322 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9.9ea935ac-3ba6-4b2a-ac91-c2c62c7d4e74 is being set with open permissions: ugo+rw Jul 08 18:56:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-93ebb32d-10de-4238-a477-33190818c44c tempest-SnapshotDependencyTests-441350322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9.9ea935ac-3ba6-4b2a-ac91-c2c62c7d4e74 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:02 devstack sudo[103971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9.9ea935ac-3ba6-4b2a-ac91-c2c62c7d4e74 Jul 08 18:56:02 devstack sudo[103971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:03 devstack sudo[103971]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-93ebb32d-10de-4238-a477-33190818c44c tempest-SnapshotDependencyTests-441350322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9.9ea935ac-3ba6-4b2a-ac91-c2c62c7d4e74" returned: 0 in 0.711s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-93ebb32d-10de-4238-a477-33190818c44c tempest-SnapshotDependencyTests-441350322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:03 devstack sudo[103975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9.info Jul 08 18:56:03 devstack sudo[103975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:03 devstack sudo[103975]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-93ebb32d-10de-4238-a477-33190818c44c tempest-SnapshotDependencyTests-441350322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9.info" returned: 0 in 0.678s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:03 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-93ebb32d-10de-4238-a477-33190818c44c tempest-SnapshotDependencyTests-441350322 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9.info is being set with open permissions: ugo+rw Jul 08 18:56:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-93ebb32d-10de-4238-a477-33190818c44c tempest-SnapshotDependencyTests-441350322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:03 devstack sudo[103978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9.info Jul 08 18:56:03 devstack sudo[103978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:04 devstack sudo[103978]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-93ebb32d-10de-4238-a477-33190818c44c tempest-SnapshotDependencyTests-441350322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9.info" returned: 0 in 0.662s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-93ebb32d-10de-4238-a477-33190818c44c tempest-SnapshotDependencyTests-441350322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.414s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:56:04 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-93ebb32d-10de-4238-a477-33190818c44c tempest-SnapshotDependencyTests-441350322 None] Create snapshot completed successfully Jul 08 18:56:06 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-49cda1c1-005f-4b70-8fee-5d4142b744ef tempest-SnapshotDependencyTests-441350322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:56:06 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-49cda1c1-005f-4b70-8fee-5d4142b744ef tempest-SnapshotDependencyTests-441350322 None] Flow 'volume_create_manager' (dc54f3c5-704b-4fe5-937b-8d2fb164a0c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:56:06 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-49cda1c1-005f-4b70-8fee-5d4142b744ef tempest-SnapshotDependencyTests-441350322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0622bc6-af16-49c1-90df-119c613857d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:06 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-49cda1c1-005f-4b70-8fee-5d4142b744ef tempest-SnapshotDependencyTests-441350322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0622bc6-af16-49c1-90df-119c613857d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:56:06Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26bd9f62-c1f7-4000-80b0-03c121e31952,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='223bebc711fe40baac40a726545f7e5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:56:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9ea935ac-3ba6-4b2a-ac91-c2c62c7d4e74,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:56:06Z,use_quota=True,user_id='9648b3fd91db41c281f0c295be755042',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:06 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-49cda1c1-005f-4b70-8fee-5d4142b744ef tempest-SnapshotDependencyTests-441350322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31623afb-9551-484f-acfa-d50e9242eb68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:06 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-49cda1c1-005f-4b70-8fee-5d4142b744ef tempest-SnapshotDependencyTests-441350322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31623afb-9551-484f-acfa-d50e9242eb68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:06 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-49cda1c1-005f-4b70-8fee-5d4142b744ef tempest-SnapshotDependencyTests-441350322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a0282d0-b6de-4a18-8172-ff74bc9ac275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:06 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-49cda1c1-005f-4b70-8fee-5d4142b744ef tempest-SnapshotDependencyTests-441350322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a0282d0-b6de-4a18-8172-ff74bc9ac275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '26bd9f62-c1f7-4000-80b0-03c121e31952', 'volume_name': 'volume-26bd9f62-c1f7-4000-80b0-03c121e31952', 'volume_size': 1, 'snapshot_id': '9ea935ac-3ba6-4b2a-ac91-c2c62c7d4e74'}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:06 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-49cda1c1-005f-4b70-8fee-5d4142b744ef tempest-SnapshotDependencyTests-441350322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bfb1ec9-83ee-4853-ac7c-29caa434704c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:06 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-49cda1c1-005f-4b70-8fee-5d4142b744ef tempest-SnapshotDependencyTests-441350322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bfb1ec9-83ee-4853-ac7c-29caa434704c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:06 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-49cda1c1-005f-4b70-8fee-5d4142b744ef tempest-SnapshotDependencyTests-441350322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38847abd-3c71-41c6-ad86-2c986ee35258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:06 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-49cda1c1-005f-4b70-8fee-5d4142b744ef tempest-SnapshotDependencyTests-441350322 None] Volume 26bd9f62-c1f7-4000-80b0-03c121e31952: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-26bd9f62-c1f7-4000-80b0-03c121e31952', 'volume_size': 1, 'snapshot_id': '9ea935ac-3ba6-4b2a-ac91-c2c62c7d4e74'} Jul 08 18:56:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-49cda1c1-005f-4b70-8fee-5d4142b744ef tempest-SnapshotDependencyTests-441350322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:56:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-49cda1c1-005f-4b70-8fee-5d4142b744ef tempest-SnapshotDependencyTests-441350322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:56:06 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-49cda1c1-005f-4b70-8fee-5d4142b744ef tempest-SnapshotDependencyTests-441350322 None] Acquiring lock "cinder-quobyte-9ea935ac-3ba6-4b2a-ac91-c2c62c7d4e74-26bd9f62-c1f7-4000-80b0-03c121e31952" by "_create_volume_from_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:56:06 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-49cda1c1-005f-4b70-8fee-5d4142b744ef tempest-SnapshotDependencyTests-441350322 None] Lock "cinder-quobyte-9ea935ac-3ba6-4b2a-ac91-c2c62c7d4e74-26bd9f62-c1f7-4000-80b0-03c121e31952" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:56:06 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-49cda1c1-005f-4b70-8fee-5d4142b744ef tempest-SnapshotDependencyTests-441350322 None] Creating volume 26bd9f62-c1f7-4000-80b0-03c121e31952 from snapshot 9ea935ac-3ba6-4b2a-ac91-c2c62c7d4e74 {{(pid=86873) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 18:56:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-49cda1c1-005f-4b70-8fee-5d4142b744ef tempest-SnapshotDependencyTests-441350322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:56:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-49cda1c1-005f-4b70-8fee-5d4142b744ef tempest-SnapshotDependencyTests-441350322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:56:06 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-49cda1c1-005f-4b70-8fee-5d4142b744ef tempest-SnapshotDependencyTests-441350322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:56:06 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-49cda1c1-005f-4b70-8fee-5d4142b744ef tempest-SnapshotDependencyTests-441350322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:56:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-49cda1c1-005f-4b70-8fee-5d4142b744ef tempest-SnapshotDependencyTests-441350322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:56:06 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-49cda1c1-005f-4b70-8fee-5d4142b744ef tempest-SnapshotDependencyTests-441350322 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:56:06 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-49cda1c1-005f-4b70-8fee-5d4142b744ef tempest-SnapshotDependencyTests-441350322 None] Acquiring lock "cinder-quobyte-26bd9f62-c1f7-4000-80b0-03c121e31952" by "_copy_volume_from_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:56:06 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-49cda1c1-005f-4b70-8fee-5d4142b744ef tempest-SnapshotDependencyTests-441350322 None] Lock "cinder-quobyte-26bd9f62-c1f7-4000-80b0-03c121e31952" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:56:06 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-49cda1c1-005f-4b70-8fee-5d4142b744ef tempest-SnapshotDependencyTests-441350322 None] snapshot: 9ea935ac-3ba6-4b2a-ac91-c2c62c7d4e74, volume: 26bd9f62-c1f7-4000-80b0-03c121e31952, {{(pid=86873) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 18:56:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-49cda1c1-005f-4b70-8fee-5d4142b744ef tempest-SnapshotDependencyTests-441350322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:56:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-49cda1c1-005f-4b70-8fee-5d4142b744ef tempest-SnapshotDependencyTests-441350322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:56:06 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-49cda1c1-005f-4b70-8fee-5d4142b744ef tempest-SnapshotDependencyTests-441350322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:56:06 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-49cda1c1-005f-4b70-8fee-5d4142b744ef tempest-SnapshotDependencyTests-441350322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:56:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-49cda1c1-005f-4b70-8fee-5d4142b744ef tempest-SnapshotDependencyTests-441350322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:56:06 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[e727056d-397b-4d0f-86e0-13027dab4f10]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:56:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-49cda1c1-005f-4b70-8fee-5d4142b744ef tempest-SnapshotDependencyTests-441350322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9.9ea935ac-3ba6-4b2a-ac91-c2c62c7d4e74 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:06 devstack sudo[104018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9.9ea935ac-3ba6-4b2a-ac91-c2c62c7d4e74 Jul 08 18:56:06 devstack sudo[104018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:06 devstack sudo[104018]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-49cda1c1-005f-4b70-8fee-5d4142b744ef tempest-SnapshotDependencyTests-441350322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9.9ea935ac-3ba6-4b2a-ac91-c2c62c7d4e74" returned: 0 in 0.753s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:06 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-49cda1c1-005f-4b70-8fee-5d4142b744ef tempest-SnapshotDependencyTests-441350322 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:56:06 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-49cda1c1-005f-4b70-8fee-5d4142b744ef tempest-SnapshotDependencyTests-441350322 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9 {{(pid=86873) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 18:56:06 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-49cda1c1-005f-4b70-8fee-5d4142b744ef tempest-SnapshotDependencyTests-441350322 None] Creating direct copy from snapshot {{(pid=86873) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 18:56:06 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[f465bbb3-94df-402a-a554-57343ec56fab]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:56:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-49cda1c1-005f-4b70-8fee-5d4142b744ef tempest-SnapshotDependencyTests-441350322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:07 devstack sudo[104023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9 Jul 08 18:56:07 devstack sudo[104023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:07 devstack sudo[104023]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-49cda1c1-005f-4b70-8fee-5d4142b744ef tempest-SnapshotDependencyTests-441350322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9" returned: 0 in 0.758s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:07 devstack cinder-volume[86873]: DEBUG cinder.utils [None req-49cda1c1-005f-4b70-8fee-5d4142b744ef tempest-SnapshotDependencyTests-441350322 None] Path /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-26bd9f62-c1f7-4000-80b0-03c121e31952 not found in is_blk_device check {{(pid=86873) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 18:56:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-49cda1c1-005f-4b70-8fee-5d4142b744ef tempest-SnapshotDependencyTests-441350322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-26bd9f62-c1f7-4000-80b0-03c121e31952 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:07 devstack sudo[104028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-26bd9f62-c1f7-4000-80b0-03c121e31952 Jul 08 18:56:07 devstack sudo[104028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:12 devstack sudo[104028]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-49cda1c1-005f-4b70-8fee-5d4142b744ef tempest-SnapshotDependencyTests-441350322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-26bd9f62-c1f7-4000-80b0-03c121e31952" returned: 0 in 4.552s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:12 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[d905e8fe-5ad5-45ec-b4cd-6dbcb314924f]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:56:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-49cda1c1-005f-4b70-8fee-5d4142b744ef tempest-SnapshotDependencyTests-441350322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:12 devstack sudo[104041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9 Jul 08 18:56:12 devstack sudo[104041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:13 devstack sudo[104041]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-49cda1c1-005f-4b70-8fee-5d4142b744ef tempest-SnapshotDependencyTests-441350322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9" returned: 0 in 0.920s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:13 devstack cinder-volume[86873]: DEBUG cinder.image.image_utils [None req-49cda1c1-005f-4b70-8fee-5d4142b744ef tempest-SnapshotDependencyTests-441350322 None] Image conversion details: src /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9, size 1024.00 MB, duration 4.55 sec, destination /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-26bd9f62-c1f7-4000-80b0-03c121e31952 {{(pid=86873) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:56:13 devstack cinder-volume[86873]: INFO cinder.image.image_utils [None req-49cda1c1-005f-4b70-8fee-5d4142b744ef tempest-SnapshotDependencyTests-441350322 None] Converted 1024.00 MB image at 224.88 MB/s Jul 08 18:56:13 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-49cda1c1-005f-4b70-8fee-5d4142b744ef tempest-SnapshotDependencyTests-441350322 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-26bd9f62-c1f7-4000-80b0-03c121e31952 is being set with open permissions: ugo+rw Jul 08 18:56:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-49cda1c1-005f-4b70-8fee-5d4142b744ef tempest-SnapshotDependencyTests-441350322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-26bd9f62-c1f7-4000-80b0-03c121e31952 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:13 devstack sudo[104047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-26bd9f62-c1f7-4000-80b0-03c121e31952 Jul 08 18:56:13 devstack sudo[104047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:13 devstack sudo[104047]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-49cda1c1-005f-4b70-8fee-5d4142b744ef tempest-SnapshotDependencyTests-441350322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-26bd9f62-c1f7-4000-80b0-03c121e31952" returned: 0 in 0.630s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:13 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-49cda1c1-005f-4b70-8fee-5d4142b744ef tempest-SnapshotDependencyTests-441350322 None] Lock "cinder-quobyte-26bd9f62-c1f7-4000-80b0-03c121e31952" released by "_copy_volume_from_snapshot" :: held 7.711s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:56:13 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-49cda1c1-005f-4b70-8fee-5d4142b744ef tempest-SnapshotDependencyTests-441350322 None] Lock "cinder-quobyte-9ea935ac-3ba6-4b2a-ac91-c2c62c7d4e74-26bd9f62-c1f7-4000-80b0-03c121e31952" released by "_create_volume_from_snapshot" :: held 7.742s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:56:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-49cda1c1-005f-4b70-8fee-5d4142b744ef tempest-SnapshotDependencyTests-441350322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.762s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:56:13 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-49cda1c1-005f-4b70-8fee-5d4142b744ef tempest-SnapshotDependencyTests-441350322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38847abd-3c71-41c6-ad86-2c986ee35258) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26bd9f62-c1f7-4000-80b0-03c121e31952', 'volume_size': 1, 'snapshot_id': '9ea935ac-3ba6-4b2a-ac91-c2c62c7d4e74'}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:13 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-49cda1c1-005f-4b70-8fee-5d4142b744ef tempest-SnapshotDependencyTests-441350322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ba4aaf0-047d-47a6-b2bf-8b5a44288c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:13 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-49cda1c1-005f-4b70-8fee-5d4142b744ef tempest-SnapshotDependencyTests-441350322 None] Volume volume-26bd9f62-c1f7-4000-80b0-03c121e31952 (26bd9f62-c1f7-4000-80b0-03c121e31952): created successfully Jul 08 18:56:13 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-49cda1c1-005f-4b70-8fee-5d4142b744ef tempest-SnapshotDependencyTests-441350322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ba4aaf0-047d-47a6-b2bf-8b5a44288c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:13 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-49cda1c1-005f-4b70-8fee-5d4142b744ef tempest-SnapshotDependencyTests-441350322 None] Flow 'volume_create_manager' (dc54f3c5-704b-4fe5-937b-8d2fb164a0c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:56:13 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-49cda1c1-005f-4b70-8fee-5d4142b744ef tempest-SnapshotDependencyTests-441350322 None] Created volume successfully. Jul 08 18:56:14 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9851c0b0-4d9a-473c-99a5-ce9ed0205ff3 tempest-SnapshotDependencyTests-441350322 None] Acquiring lock "cinder-9ea935ac-3ba6-4b2a-ac91-c2c62c7d4e74-delete_snapshot" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:56:14 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9851c0b0-4d9a-473c-99a5-ce9ed0205ff3 tempest-SnapshotDependencyTests-441350322 None] Lock "cinder-9ea935ac-3ba6-4b2a-ac91-c2c62c7d4e74-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:56:14 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9851c0b0-4d9a-473c-99a5-ce9ed0205ff3 tempest-SnapshotDependencyTests-441350322 None] Acquiring lock "cinder-quobyte-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:56:14 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9851c0b0-4d9a-473c-99a5-ce9ed0205ff3 tempest-SnapshotDependencyTests-441350322 None] Lock "cinder-quobyte-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:56:14 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9851c0b0-4d9a-473c-99a5-ce9ed0205ff3 tempest-SnapshotDependencyTests-441350322 None] Acquiring lock "cinder-quobyte-9ea935ac-3ba6-4b2a-ac91-c2c62c7d4e74" by "_delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:56:14 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9851c0b0-4d9a-473c-99a5-ce9ed0205ff3 tempest-SnapshotDependencyTests-441350322 None] Lock "cinder-quobyte-9ea935ac-3ba6-4b2a-ac91-c2c62c7d4e74" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:56:14 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-9851c0b0-4d9a-473c-99a5-ce9ed0205ff3 tempest-SnapshotDependencyTests-441350322 None] Deleting offline snapshot 9ea935ac-3ba6-4b2a-ac91-c2c62c7d4e74 of volume de4ecfa5-89f7-497b-8fd1-ff894fb8cba9 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:56:14 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-9851c0b0-4d9a-473c-99a5-ce9ed0205ff3 tempest-SnapshotDependencyTests-441350322 None] snapshot_file for this snap is: volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9.9ea935ac-3ba6-4b2a-ac91-c2c62c7d4e74 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:56:14 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a39a0b-b187-4d70-a2e3-cff45fe43898]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:56:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9851c0b0-4d9a-473c-99a5-ce9ed0205ff3 tempest-SnapshotDependencyTests-441350322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9.9ea935ac-3ba6-4b2a-ac91-c2c62c7d4e74 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:14 devstack sudo[104050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9.9ea935ac-3ba6-4b2a-ac91-c2c62c7d4e74 Jul 08 18:56:14 devstack sudo[104050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:15 devstack sudo[104050]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9851c0b0-4d9a-473c-99a5-ce9ed0205ff3 tempest-SnapshotDependencyTests-441350322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9.9ea935ac-3ba6-4b2a-ac91-c2c62c7d4e74" returned: 0 in 0.748s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:15 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-9851c0b0-4d9a-473c-99a5-ce9ed0205ff3 tempest-SnapshotDependencyTests-441350322 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:56:15 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfdca200-31b0-4d45-a06a-ddfa8b3ff2ef]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:56:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9851c0b0-4d9a-473c-99a5-ce9ed0205ff3 tempest-SnapshotDependencyTests-441350322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:15 devstack sudo[104055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9 Jul 08 18:56:15 devstack sudo[104055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:16 devstack sudo[104055]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9851c0b0-4d9a-473c-99a5-ce9ed0205ff3 tempest-SnapshotDependencyTests-441350322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9" returned: 0 in 0.746s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9851c0b0-4d9a-473c-99a5-ce9ed0205ff3 tempest-SnapshotDependencyTests-441350322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9.9ea935ac-3ba6-4b2a-ac91-c2c62c7d4e74 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:16 devstack sudo[104063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9.9ea935ac-3ba6-4b2a-ac91-c2c62c7d4e74 Jul 08 18:56:16 devstack sudo[104063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:17 devstack sudo[104063]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9851c0b0-4d9a-473c-99a5-ce9ed0205ff3 tempest-SnapshotDependencyTests-441350322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9.9ea935ac-3ba6-4b2a-ac91-c2c62c7d4e74" returned: 0 in 0.727s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9851c0b0-4d9a-473c-99a5-ce9ed0205ff3 tempest-SnapshotDependencyTests-441350322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9.9ea935ac-3ba6-4b2a-ac91-c2c62c7d4e74 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:17 devstack sudo[104071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9.9ea935ac-3ba6-4b2a-ac91-c2c62c7d4e74 Jul 08 18:56:17 devstack sudo[104071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:17 devstack sudo[104071]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9851c0b0-4d9a-473c-99a5-ce9ed0205ff3 tempest-SnapshotDependencyTests-441350322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9.9ea935ac-3ba6-4b2a-ac91-c2c62c7d4e74" returned: 0 in 0.639s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:17 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9851c0b0-4d9a-473c-99a5-ce9ed0205ff3 tempest-SnapshotDependencyTests-441350322 None] Lock "cinder-quobyte-9ea935ac-3ba6-4b2a-ac91-c2c62c7d4e74" released by "_delete_snapshot" :: held 2.955s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:56:17 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9851c0b0-4d9a-473c-99a5-ce9ed0205ff3 tempest-SnapshotDependencyTests-441350322 None] Lock "cinder-quobyte-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9" released by "delete_snapshot" :: held 2.974s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:56:17 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-9851c0b0-4d9a-473c-99a5-ce9ed0205ff3 tempest-SnapshotDependencyTests-441350322 None] Created reservations ['c662da8d-7d2c-4faa-88fa-2f3e3d67c977', '09179cf5-61f8-4675-a3e4-c4231f7cb59b', '063d31e7-dc6c-4f8d-8b33-2fdb101ea2c4', '37c0469f-aa7b-4f24-9f2c-341c6b38f006'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:56:17 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-9851c0b0-4d9a-473c-99a5-ce9ed0205ff3 tempest-SnapshotDependencyTests-441350322 None] Delete snapshot completed successfully. Jul 08 18:56:17 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9851c0b0-4d9a-473c-99a5-ce9ed0205ff3 tempest-SnapshotDependencyTests-441350322 None] Lock "cinder-9ea935ac-3ba6-4b2a-ac91-c2c62c7d4e74-delete_snapshot" released by "delete_snapshot" :: held 3.096s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:56:18 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b5e7addd-2048-46f1-878d-2f3184db2774 tempest-SnapshotDependencyTests-441350322 None] Acquiring lock "cinder-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:56:18 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b5e7addd-2048-46f1-878d-2f3184db2774 tempest-SnapshotDependencyTests-441350322 None] Lock "cinder-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:56:18 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b5e7addd-2048-46f1-878d-2f3184db2774 tempest-SnapshotDependencyTests-441350322 None] Acquiring lock "cinder-quobyte-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:56:18 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b5e7addd-2048-46f1-878d-2f3184db2774 tempest-SnapshotDependencyTests-441350322 None] Lock "cinder-quobyte-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9" acquired by "delete_volume" :: waited 0.017s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:56:18 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc65f0d8-a2d3-4af4-a240-289aab3f9627]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:56:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b5e7addd-2048-46f1-878d-2f3184db2774 tempest-SnapshotDependencyTests-441350322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:18 devstack sudo[104074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9 Jul 08 18:56:18 devstack sudo[104074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:18 devstack sudo[104074]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b5e7addd-2048-46f1-878d-2f3184db2774 tempest-SnapshotDependencyTests-441350322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9" returned: 0 in 0.760s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b5e7addd-2048-46f1-878d-2f3184db2774 tempest-SnapshotDependencyTests-441350322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:18 devstack sudo[104079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9 Jul 08 18:56:18 devstack sudo[104079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:19 devstack sudo[104079]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:19 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b5e7addd-2048-46f1-878d-2f3184db2774 tempest-SnapshotDependencyTests-441350322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9" returned: 0 in 0.641s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:19 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b5e7addd-2048-46f1-878d-2f3184db2774 tempest-SnapshotDependencyTests-441350322 None] Lock "cinder-quobyte-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9" released by "delete_volume" :: held 1.457s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:56:19 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-b5e7addd-2048-46f1-878d-2f3184db2774 tempest-SnapshotDependencyTests-441350322 None] Created reservations ['4b11a7b3-669e-403b-a65e-f206b995a3ba', '7712a5c2-f49a-40cf-a964-27285ce5ca84', '4a68cc88-d993-470f-8cb0-d7a33a35d1d3', 'b562dd82-726f-4472-a6cc-d4f34799eeba'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:56:19 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b5e7addd-2048-46f1-878d-2f3184db2774 tempest-SnapshotDependencyTests-441350322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:56:19 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b5e7addd-2048-46f1-878d-2f3184db2774 tempest-SnapshotDependencyTests-441350322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:56:19 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b5e7addd-2048-46f1-878d-2f3184db2774 tempest-SnapshotDependencyTests-441350322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:56:19 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b5e7addd-2048-46f1-878d-2f3184db2774 tempest-SnapshotDependencyTests-441350322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:56:19 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b5e7addd-2048-46f1-878d-2f3184db2774 tempest-SnapshotDependencyTests-441350322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:56:19 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b5e7addd-2048-46f1-878d-2f3184db2774 tempest-SnapshotDependencyTests-441350322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:19 devstack sudo[104083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:56:19 devstack sudo[104083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:20 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-f3e9b3db-c21f-4186-ad23-3705616387b4 tempest-SnapshotDependencyTests-441350322 None] Acquiring lock "cinder-26bd9f62-c1f7-4000-80b0-03c121e31952-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:56:20 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-f3e9b3db-c21f-4186-ad23-3705616387b4 tempest-SnapshotDependencyTests-441350322 None] Lock "cinder-26bd9f62-c1f7-4000-80b0-03c121e31952-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:56:20 devstack sudo[104083]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b5e7addd-2048-46f1-878d-2f3184db2774 tempest-SnapshotDependencyTests-441350322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.657s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:20 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-b5e7addd-2048-46f1-878d-2f3184db2774 tempest-SnapshotDependencyTests-441350322 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:56:20 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-f3e9b3db-c21f-4186-ad23-3705616387b4 tempest-SnapshotDependencyTests-441350322 None] Acquiring lock "cinder-quobyte-26bd9f62-c1f7-4000-80b0-03c121e31952" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:56:20 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-b5e7addd-2048-46f1-878d-2f3184db2774 tempest-SnapshotDependencyTests-441350322 None] Deleted volume successfully. Jul 08 18:56:20 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-f3e9b3db-c21f-4186-ad23-3705616387b4 tempest-SnapshotDependencyTests-441350322 None] Lock "cinder-quobyte-26bd9f62-c1f7-4000-80b0-03c121e31952" acquired by "delete_volume" :: waited 0.022s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:56:20 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b5e7addd-2048-46f1-878d-2f3184db2774 tempest-SnapshotDependencyTests-441350322 None] Lock "cinder-de4ecfa5-89f7-497b-8fd1-ff894fb8cba9-delete_volume" released by "delete_volume" :: held 2.326s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:56:20 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[41313acf-ec03-444a-83ab-21c464f1ea8b]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:56:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f3e9b3db-c21f-4186-ad23-3705616387b4 tempest-SnapshotDependencyTests-441350322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-26bd9f62-c1f7-4000-80b0-03c121e31952 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:20 devstack sudo[104086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-26bd9f62-c1f7-4000-80b0-03c121e31952 Jul 08 18:56:20 devstack sudo[104086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:21 devstack sudo[104086]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f3e9b3db-c21f-4186-ad23-3705616387b4 tempest-SnapshotDependencyTests-441350322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-26bd9f62-c1f7-4000-80b0-03c121e31952" returned: 0 in 0.795s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f3e9b3db-c21f-4186-ad23-3705616387b4 tempest-SnapshotDependencyTests-441350322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-26bd9f62-c1f7-4000-80b0-03c121e31952 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:21 devstack sudo[104091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-26bd9f62-c1f7-4000-80b0-03c121e31952 Jul 08 18:56:21 devstack sudo[104091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:21 devstack sudo[104091]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f3e9b3db-c21f-4186-ad23-3705616387b4 tempest-SnapshotDependencyTests-441350322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-26bd9f62-c1f7-4000-80b0-03c121e31952" returned: 0 in 0.669s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:21 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-f3e9b3db-c21f-4186-ad23-3705616387b4 tempest-SnapshotDependencyTests-441350322 None] Lock "cinder-quobyte-26bd9f62-c1f7-4000-80b0-03c121e31952" released by "delete_volume" :: held 1.507s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:56:21 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-f3e9b3db-c21f-4186-ad23-3705616387b4 tempest-SnapshotDependencyTests-441350322 None] Created reservations ['1466e5a6-1ae4-4a81-9bce-02c6581c821d', '0dea9a6b-6828-452b-9695-9ccf915a4a2e', '22f9a190-411d-4d52-862f-b4b490390cbe', 'fc165cd1-3062-4648-bc80-118acdf206a3'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:56:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f3e9b3db-c21f-4186-ad23-3705616387b4 tempest-SnapshotDependencyTests-441350322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:56:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f3e9b3db-c21f-4186-ad23-3705616387b4 tempest-SnapshotDependencyTests-441350322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:56:21 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-f3e9b3db-c21f-4186-ad23-3705616387b4 tempest-SnapshotDependencyTests-441350322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:56:21 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-f3e9b3db-c21f-4186-ad23-3705616387b4 tempest-SnapshotDependencyTests-441350322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:56:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f3e9b3db-c21f-4186-ad23-3705616387b4 tempest-SnapshotDependencyTests-441350322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:56:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f3e9b3db-c21f-4186-ad23-3705616387b4 tempest-SnapshotDependencyTests-441350322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:21 devstack sudo[104094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:56:21 devstack sudo[104094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:22 devstack sudo[104094]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f3e9b3db-c21f-4186-ad23-3705616387b4 tempest-SnapshotDependencyTests-441350322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.653s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:22 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-f3e9b3db-c21f-4186-ad23-3705616387b4 tempest-SnapshotDependencyTests-441350322 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:56:22 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-f3e9b3db-c21f-4186-ad23-3705616387b4 tempest-SnapshotDependencyTests-441350322 None] Deleted volume successfully. Jul 08 18:56:22 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-f3e9b3db-c21f-4186-ad23-3705616387b4 tempest-SnapshotDependencyTests-441350322 None] Lock "cinder-26bd9f62-c1f7-4000-80b0-03c121e31952-delete_volume" released by "delete_volume" :: held 2.374s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:56:31 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:UPDATE=30,cinder:SELECT=23,cinder:DELETE=1,cinder:INSERT=4 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:56:32 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:SELECT=24,cinder:UPDATE=26,cinder:INSERT=10,cinder:DELETE=4 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:56:41 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3001482-55fc-429d-801f-82a5a6c848cc tempest-CreateVolumesFromSnapshotTest-202843157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:56:41 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d3001482-55fc-429d-801f-82a5a6c848cc tempest-CreateVolumesFromSnapshotTest-202843157 None] Flow 'volume_create_manager' (dfcd53af-3c86-4bfb-a2dc-4e5f62df77a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:56:41 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d3001482-55fc-429d-801f-82a5a6c848cc tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2138f3bd-81a6-47cf-838e-f6649a8d3868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:41 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d3001482-55fc-429d-801f-82a5a6c848cc tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2138f3bd-81a6-47cf-838e-f6649a8d3868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1343746311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10e47c5a-6525-47f1-aca8-8672ada2f3f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f58dd594e6704f04aa670507ae860614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:56:41Z,use_quota=True,user_id='18dfc796e05642b8bcaf789a3d9f411c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:41 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d3001482-55fc-429d-801f-82a5a6c848cc tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (235f4568-d64a-4b62-9ea7-98aa1f42c137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:41 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d3001482-55fc-429d-801f-82a5a6c848cc tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (235f4568-d64a-4b62-9ea7-98aa1f42c137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:41 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d3001482-55fc-429d-801f-82a5a6c848cc tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efd58bb5-a453-4d2e-b9be-56dc68bfd5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:41 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d3001482-55fc-429d-801f-82a5a6c848cc tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efd58bb5-a453-4d2e-b9be-56dc68bfd5a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10e47c5a-6525-47f1-aca8-8672ada2f3f5', 'volume_name': 'volume-10e47c5a-6525-47f1-aca8-8672ada2f3f5', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:41 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d3001482-55fc-429d-801f-82a5a6c848cc tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (761c25ae-1497-482b-899f-2860097a8bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:41 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d3001482-55fc-429d-801f-82a5a6c848cc tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (761c25ae-1497-482b-899f-2860097a8bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:41 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d3001482-55fc-429d-801f-82a5a6c848cc tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7b09b86-1d01-4c2d-bd34-e1f7ccb1e4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:41 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-d3001482-55fc-429d-801f-82a5a6c848cc tempest-CreateVolumesFromSnapshotTest-202843157 None] Volume 10e47c5a-6525-47f1-aca8-8672ada2f3f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10e47c5a-6525-47f1-aca8-8672ada2f3f5', 'volume_size': 1} Jul 08 18:56:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-d3001482-55fc-429d-801f-82a5a6c848cc tempest-CreateVolumesFromSnapshotTest-202843157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:56:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-d3001482-55fc-429d-801f-82a5a6c848cc tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:56:41 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-d3001482-55fc-429d-801f-82a5a6c848cc tempest-CreateVolumesFromSnapshotTest-202843157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1343746311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10e47c5a-6525-47f1-aca8-8672ada2f3f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f58dd594e6704f04aa670507ae860614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:56:41Z,use_quota=True,user_id='18dfc796e05642b8bcaf789a3d9f411c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:56:41 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-d3001482-55fc-429d-801f-82a5a6c848cc tempest-CreateVolumesFromSnapshotTest-202843157 None] Creating volume 10e47c5a-6525-47f1-aca8-8672ada2f3f5 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:56:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-d3001482-55fc-429d-801f-82a5a6c848cc tempest-CreateVolumesFromSnapshotTest-202843157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:56:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-d3001482-55fc-429d-801f-82a5a6c848cc tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:56:41 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-d3001482-55fc-429d-801f-82a5a6c848cc tempest-CreateVolumesFromSnapshotTest-202843157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:56:41 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-d3001482-55fc-429d-801f-82a5a6c848cc tempest-CreateVolumesFromSnapshotTest-202843157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:56:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-d3001482-55fc-429d-801f-82a5a6c848cc tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:56:41 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-d3001482-55fc-429d-801f-82a5a6c848cc tempest-CreateVolumesFromSnapshotTest-202843157 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:56:41 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-d3001482-55fc-429d-801f-82a5a6c848cc tempest-CreateVolumesFromSnapshotTest-202843157 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:56:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d3001482-55fc-429d-801f-82a5a6c848cc tempest-CreateVolumesFromSnapshotTest-202843157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-10e47c5a-6525-47f1-aca8-8672ada2f3f5 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:41 devstack sudo[104139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-10e47c5a-6525-47f1-aca8-8672ada2f3f5 1073741824 Jul 08 18:56:41 devstack sudo[104139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:41 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-4638240e-214b-437f-8f19-87ab6460a35a tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:56:41 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-4638240e-214b-437f-8f19-87ab6460a35a tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Flow 'volume_create_manager' (4c89a2db-bad8-4ac1-b8b9-3a63b8f83855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:56:41 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-4638240e-214b-437f-8f19-87ab6460a35a tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2380a4e-38d1-4dca-8bf1-69728f47d6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:41 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-4638240e-214b-437f-8f19-87ab6460a35a tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2380a4e-38d1-4dca-8bf1-69728f47d6c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1229939995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab928dd2-09f4-4c0e-835a-07c84344127b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3aca0457f0147b3b2e27e7496ca53f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:56:41Z,use_quota=True,user_id='f5888002e3ec40d6aa0a642c11d86688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:41 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-4638240e-214b-437f-8f19-87ab6460a35a tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8e28a1c-a0e1-4496-876f-9a8fe5ed455f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:41 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-4638240e-214b-437f-8f19-87ab6460a35a tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8e28a1c-a0e1-4496-876f-9a8fe5ed455f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:41 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-4638240e-214b-437f-8f19-87ab6460a35a tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1aad060-81e2-483f-8339-e2a941e03702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:41 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-4638240e-214b-437f-8f19-87ab6460a35a tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1aad060-81e2-483f-8339-e2a941e03702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab928dd2-09f4-4c0e-835a-07c84344127b', 'volume_name': 'volume-ab928dd2-09f4-4c0e-835a-07c84344127b', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:41 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-4638240e-214b-437f-8f19-87ab6460a35a tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b67ab319-1b70-456c-a0c6-09eba4895177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:41 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-4638240e-214b-437f-8f19-87ab6460a35a tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b67ab319-1b70-456c-a0c6-09eba4895177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:41 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-4638240e-214b-437f-8f19-87ab6460a35a tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e0e0674-d2e8-41b3-97db-fbc1a4a2ebf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:41 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-4638240e-214b-437f-8f19-87ab6460a35a tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Volume ab928dd2-09f4-4c0e-835a-07c84344127b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab928dd2-09f4-4c0e-835a-07c84344127b', 'volume_size': 1} Jul 08 18:56:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-4638240e-214b-437f-8f19-87ab6460a35a tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:56:42 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-b290306d-3c41-4016-a485-98081277d3d0 tempest-VolumeDependencyTests-1321967090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:56:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b290306d-3c41-4016-a485-98081277d3d0 tempest-VolumeDependencyTests-1321967090 None] Flow 'volume_create_manager' (df43ce4f-9520-4340-9f3d-3b46d58e8439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:56:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b290306d-3c41-4016-a485-98081277d3d0 tempest-VolumeDependencyTests-1321967090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (132acb10-4d90-4fca-aefe-d18f35d6be8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b290306d-3c41-4016-a485-98081277d3d0 tempest-VolumeDependencyTests-1321967090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (132acb10-4d90-4fca-aefe-d18f35d6be8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-464610354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a56282f-de69-4d61-835e-5ab241a6b719,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0237aed5eaa4123992928b692fd72a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:56:42Z,use_quota=True,user_id='57e9d98d65254aceaa9e001663533231',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b290306d-3c41-4016-a485-98081277d3d0 tempest-VolumeDependencyTests-1321967090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2ce6e84-cf22-4286-b05b-d9f2f2a2c87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b290306d-3c41-4016-a485-98081277d3d0 tempest-VolumeDependencyTests-1321967090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2ce6e84-cf22-4286-b05b-d9f2f2a2c87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b290306d-3c41-4016-a485-98081277d3d0 tempest-VolumeDependencyTests-1321967090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af109d81-4e3b-4779-8016-5280b557035e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b290306d-3c41-4016-a485-98081277d3d0 tempest-VolumeDependencyTests-1321967090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af109d81-4e3b-4779-8016-5280b557035e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a56282f-de69-4d61-835e-5ab241a6b719', 'volume_name': 'volume-5a56282f-de69-4d61-835e-5ab241a6b719', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b290306d-3c41-4016-a485-98081277d3d0 tempest-VolumeDependencyTests-1321967090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d3da00a-2560-41e2-9684-4b422dedd1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b290306d-3c41-4016-a485-98081277d3d0 tempest-VolumeDependencyTests-1321967090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d3da00a-2560-41e2-9684-4b422dedd1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b290306d-3c41-4016-a485-98081277d3d0 tempest-VolumeDependencyTests-1321967090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abc999b2-c06a-40dd-9a2e-d70534795cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:42 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-b290306d-3c41-4016-a485-98081277d3d0 tempest-VolumeDependencyTests-1321967090 None] Volume 5a56282f-de69-4d61-835e-5ab241a6b719: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a56282f-de69-4d61-835e-5ab241a6b719', 'volume_size': 1} Jul 08 18:56:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b290306d-3c41-4016-a485-98081277d3d0 tempest-VolumeDependencyTests-1321967090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:56:42 devstack sudo[104139]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d3001482-55fc-429d-801f-82a5a6c848cc tempest-CreateVolumesFromSnapshotTest-202843157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-10e47c5a-6525-47f1-aca8-8672ada2f3f5 1073741824" returned: 0 in 0.934s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d3001482-55fc-429d-801f-82a5a6c848cc tempest-CreateVolumesFromSnapshotTest-202843157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-10e47c5a-6525-47f1-aca8-8672ada2f3f5 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:42 devstack sudo[104145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-10e47c5a-6525-47f1-aca8-8672ada2f3f5 Jul 08 18:56:42 devstack sudo[104145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:43 devstack sudo[104145]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d3001482-55fc-429d-801f-82a5a6c848cc tempest-CreateVolumesFromSnapshotTest-202843157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-10e47c5a-6525-47f1-aca8-8672ada2f3f5" returned: 0 in 0.639s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:43 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-d3001482-55fc-429d-801f-82a5a6c848cc tempest-CreateVolumesFromSnapshotTest-202843157 None] <== create_volume: return (1614ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:56:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-d3001482-55fc-429d-801f-82a5a6c848cc tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.618s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:56:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-4638240e-214b-437f-8f19-87ab6460a35a tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.428s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:56:43 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-4638240e-214b-437f-8f19-87ab6460a35a tempest-CreateVolumesFromSourceVolumeTest-106813322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1229939995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab928dd2-09f4-4c0e-835a-07c84344127b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3aca0457f0147b3b2e27e7496ca53f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:56:41Z,use_quota=True,user_id='f5888002e3ec40d6aa0a642c11d86688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:56:43 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-4638240e-214b-437f-8f19-87ab6460a35a tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Creating volume ab928dd2-09f4-4c0e-835a-07c84344127b {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:56:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-4638240e-214b-437f-8f19-87ab6460a35a tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:56:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-4638240e-214b-437f-8f19-87ab6460a35a tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:56:43 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-4638240e-214b-437f-8f19-87ab6460a35a tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:56:43 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-4638240e-214b-437f-8f19-87ab6460a35a tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:56:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-4638240e-214b-437f-8f19-87ab6460a35a tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:56:43 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-4638240e-214b-437f-8f19-87ab6460a35a tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:56:43 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-4638240e-214b-437f-8f19-87ab6460a35a tempest-CreateVolumesFromSourceVolumeTest-106813322 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:56:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-4638240e-214b-437f-8f19-87ab6460a35a tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ab928dd2-09f4-4c0e-835a-07c84344127b 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:43 devstack sudo[104149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ab928dd2-09f4-4c0e-835a-07c84344127b 1073741824 Jul 08 18:56:43 devstack sudo[104149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:43 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d3001482-55fc-429d-801f-82a5a6c848cc tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7b09b86-1d01-4c2d-bd34-e1f7ccb1e4ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10e47c5a-6525-47f1-aca8-8672ada2f3f5', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:43 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d3001482-55fc-429d-801f-82a5a6c848cc tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb4d08d7-6252-44e1-9ea3-7fa5e5752f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:43 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-d3001482-55fc-429d-801f-82a5a6c848cc tempest-CreateVolumesFromSnapshotTest-202843157 None] Volume volume-10e47c5a-6525-47f1-aca8-8672ada2f3f5 (10e47c5a-6525-47f1-aca8-8672ada2f3f5): created successfully Jul 08 18:56:43 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d3001482-55fc-429d-801f-82a5a6c848cc tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb4d08d7-6252-44e1-9ea3-7fa5e5752f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:43 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-d3001482-55fc-429d-801f-82a5a6c848cc tempest-CreateVolumesFromSnapshotTest-202843157 None] Flow 'volume_create_manager' (dfcd53af-3c86-4bfb-a2dc-4e5f62df77a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:56:43 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-d3001482-55fc-429d-801f-82a5a6c848cc tempest-CreateVolumesFromSnapshotTest-202843157 None] Created volume successfully. Jul 08 18:56:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-245b43d0-74e2-4a09-ba25-2675a8a5a457 tempest-CreateVolumesFromSnapshotTest-202843157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:56:43 devstack sudo[104149]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-4638240e-214b-437f-8f19-87ab6460a35a tempest-CreateVolumesFromSourceVolumeTest-106813322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ab928dd2-09f4-4c0e-835a-07c84344127b 1073741824" returned: 0 in 0.863s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-4638240e-214b-437f-8f19-87ab6460a35a tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ab928dd2-09f4-4c0e-835a-07c84344127b {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:43 devstack sudo[104155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ab928dd2-09f4-4c0e-835a-07c84344127b Jul 08 18:56:43 devstack sudo[104155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:44 devstack sudo[104155]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-4638240e-214b-437f-8f19-87ab6460a35a tempest-CreateVolumesFromSourceVolumeTest-106813322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ab928dd2-09f4-4c0e-835a-07c84344127b" returned: 0 in 0.663s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:44 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-4638240e-214b-437f-8f19-87ab6460a35a tempest-CreateVolumesFromSourceVolumeTest-106813322 None] <== create_volume: return (1567ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:56:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-4638240e-214b-437f-8f19-87ab6460a35a tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.570s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:56:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b290306d-3c41-4016-a485-98081277d3d0 tempest-VolumeDependencyTests-1321967090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.518s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:56:44 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b290306d-3c41-4016-a485-98081277d3d0 tempest-VolumeDependencyTests-1321967090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-464610354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a56282f-de69-4d61-835e-5ab241a6b719,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0237aed5eaa4123992928b692fd72a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:56:42Z,use_quota=True,user_id='57e9d98d65254aceaa9e001663533231',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:56:44 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-b290306d-3c41-4016-a485-98081277d3d0 tempest-VolumeDependencyTests-1321967090 None] Creating volume 5a56282f-de69-4d61-835e-5ab241a6b719 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:56:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b290306d-3c41-4016-a485-98081277d3d0 tempest-VolumeDependencyTests-1321967090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:56:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b290306d-3c41-4016-a485-98081277d3d0 tempest-VolumeDependencyTests-1321967090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:56:44 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b290306d-3c41-4016-a485-98081277d3d0 tempest-VolumeDependencyTests-1321967090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:56:44 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b290306d-3c41-4016-a485-98081277d3d0 tempest-VolumeDependencyTests-1321967090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:56:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b290306d-3c41-4016-a485-98081277d3d0 tempest-VolumeDependencyTests-1321967090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:56:44 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b290306d-3c41-4016-a485-98081277d3d0 tempest-VolumeDependencyTests-1321967090 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:56:44 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-b290306d-3c41-4016-a485-98081277d3d0 tempest-VolumeDependencyTests-1321967090 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:56:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b290306d-3c41-4016-a485-98081277d3d0 tempest-VolumeDependencyTests-1321967090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a56282f-de69-4d61-835e-5ab241a6b719 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:44 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-4638240e-214b-437f-8f19-87ab6460a35a tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e0e0674-d2e8-41b3-97db-fbc1a4a2ebf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab928dd2-09f4-4c0e-835a-07c84344127b', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:44 devstack sudo[104158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a56282f-de69-4d61-835e-5ab241a6b719 1073741824 Jul 08 18:56:44 devstack sudo[104158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:44 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-4638240e-214b-437f-8f19-87ab6460a35a tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (452fa256-436b-42a6-bc0a-d5f0687e23cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:44 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-4638240e-214b-437f-8f19-87ab6460a35a tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Volume volume-ab928dd2-09f4-4c0e-835a-07c84344127b (ab928dd2-09f4-4c0e-835a-07c84344127b): created successfully Jul 08 18:56:44 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-4638240e-214b-437f-8f19-87ab6460a35a tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (452fa256-436b-42a6-bc0a-d5f0687e23cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:44 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-4638240e-214b-437f-8f19-87ab6460a35a tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Flow 'volume_create_manager' (4c89a2db-bad8-4ac1-b8b9-3a63b8f83855) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:56:44 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:56:44 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Flow 'volume_create_manager' (222d970b-5b4e-47d4-a9f1-1b58367baa52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:56:44 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56a90b2b-4c45-4977-baa9-e22ab52ece41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:44 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-4638240e-214b-437f-8f19-87ab6460a35a tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Created volume successfully. Jul 08 18:56:44 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56a90b2b-4c45-4977-baa9-e22ab52ece41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:56:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b528ac19-bc49-4309-a584-306d6b493cfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c104a13ac714249b976201d15b64a3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:56:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:56:45Z,use_quota=True,user_id='0296d00de27c4244ba8a78815d60196e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24b1c931-a4cd-4cab-ac5b-10c5fe3c6e92),volume_type_id=24b1c931-a4cd-4cab-ac5b-10c5fe3c6e92)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:44 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b25d6ae-4099-4c89-a896-d680f2125839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:44 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b25d6ae-4099-4c89-a896-d680f2125839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:44 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b764424-c004-4631-84c6-28b3c8fa3312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:44 devstack cinder-volume[86873]: DEBUG cinder.image.glance [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Creating Keystone auth plugin from conf {{(pid=86873) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 18:56:45 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b764424-c004-4631-84c6-28b3c8fa3312) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b528ac19-bc49-4309-a584-306d6b493cfd', 'volume_name': 'volume-b528ac19-bc49-4309-a584-306d6b493cfd', 'volume_size': 1, 'image_id': 'c23945cd-25bb-4024-a63e-5851735ebb07', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c23945cd-25bb-4024-a63e-5851735ebb07', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '29b52e6f70284dd74ae305133623fc27', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0c104a13ac714249b976201d15b64a3e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '486f52a98e846c5f520199f659b80c9e8d22f8cf917fc13c9033865b18df87c833d39ce546caa6163ea3f33a6b9164fa2f8e92a1a8890c18c28723ba49e7f26a', 'id': 'c23945cd-25bb-4024-a63e-5851735ebb07', 'created_at': datetime.datetime(2026, 7, 8, 16, 56, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 56, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c23945cd-25bb-4024-a63e-5851735ebb07/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:45 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4520334-f533-4122-bbe2-5a2156b34541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:45 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4520334-f533-4122-bbe2-5a2156b34541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:45 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b2823e6-71f8-49b8-8e7b-dde2b3fef3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:45 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Volume b528ac19-bc49-4309-a584-306d6b493cfd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b528ac19-bc49-4309-a584-306d6b493cfd', 'volume_size': 1, 'image_id': 'c23945cd-25bb-4024-a63e-5851735ebb07', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c23945cd-25bb-4024-a63e-5851735ebb07', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '29b52e6f70284dd74ae305133623fc27', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0c104a13ac714249b976201d15b64a3e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '486f52a98e846c5f520199f659b80c9e8d22f8cf917fc13c9033865b18df87c833d39ce546caa6163ea3f33a6b9164fa2f8e92a1a8890c18c28723ba49e7f26a', 'id': 'c23945cd-25bb-4024-a63e-5851735ebb07', 'created_at': datetime.datetime(2026, 7, 8, 16, 56, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 56, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c23945cd-25bb-4024-a63e-5851735ebb07/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 08 18:56:45 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Trying to clone b528ac19-bc49-4309-a584-306d6b493cfd from image c23945cd-25bb-4024-a63e-5851735ebb07 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c23945cd-25bb-4024-a63e-5851735ebb07', 'metadata': {}}]). {{(pid=86873) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 18:56:45 devstack cinder-volume[86873]: DEBUG cinder.image.image_utils [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c23945cd-25bb-4024-a63e-5851735ebb07_kw10cd3kdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86873) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 18:56:45 devstack cinder-volume[86873]: INFO cinder.image.image_utils [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Image download 0.00 MB at 0.00 MB/s Jul 08 18:56:45 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5385da-e2af-4665-abe0-f41c5d34d87b]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:56:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c23945cd-25bb-4024-a63e-5851735ebb07_kw10cd3kdevstack@QuobyteHD {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:45 devstack sudo[104163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c23945cd-25bb-4024-a63e-5851735ebb07_kw10cd3kdevstack@QuobyteHD Jul 08 18:56:45 devstack sudo[104163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:45 devstack sudo[104158]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b290306d-3c41-4016-a485-98081277d3d0 tempest-VolumeDependencyTests-1321967090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a56282f-de69-4d61-835e-5ab241a6b719 1073741824" returned: 0 in 0.848s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b290306d-3c41-4016-a485-98081277d3d0 tempest-VolumeDependencyTests-1321967090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a56282f-de69-4d61-835e-5ab241a6b719 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:45 devstack sudo[104165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a56282f-de69-4d61-835e-5ab241a6b719 Jul 08 18:56:45 devstack sudo[104165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:46 devstack sudo[104163]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c23945cd-25bb-4024-a63e-5851735ebb07_kw10cd3kdevstack@QuobyteHD" returned: 0 in 0.799s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c23945cd-25bb-4024-a63e-5851735ebb07_kw10cd3kdevstack@QuobyteHD {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:46 devstack sudo[104169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c23945cd-25bb-4024-a63e-5851735ebb07_kw10cd3kdevstack@QuobyteHD Jul 08 18:56:46 devstack sudo[104169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:46 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-26a4f0f9-8684-499c-8eea-a73568d6d83f tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:56:46 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-26a4f0f9-8684-499c-8eea-a73568d6d83f tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Flow 'volume_create_manager' (195d374f-adf4-4a0d-980e-99bb199c8639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:56:46 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-26a4f0f9-8684-499c-8eea-a73568d6d83f tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaf220a8-ab5a-49ff-acc7-922cb51c330c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:46 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-26a4f0f9-8684-499c-8eea-a73568d6d83f tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaf220a8-ab5a-49ff-acc7-922cb51c330c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1967104004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4db6527-86b6-4764-bdc2-c350190d739a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3aca0457f0147b3b2e27e7496ca53f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:56:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:56:46Z,use_quota=True,user_id='f5888002e3ec40d6aa0a642c11d86688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:46 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-26a4f0f9-8684-499c-8eea-a73568d6d83f tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (900274bb-a971-4d59-88d9-03c5406da758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:46 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-26a4f0f9-8684-499c-8eea-a73568d6d83f tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (900274bb-a971-4d59-88d9-03c5406da758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:46 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-26a4f0f9-8684-499c-8eea-a73568d6d83f tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d2ce485-bbd7-4f5c-9a87-24b3b3608ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:46 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-26a4f0f9-8684-499c-8eea-a73568d6d83f tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d2ce485-bbd7-4f5c-9a87-24b3b3608ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4db6527-86b6-4764-bdc2-c350190d739a', 'volume_name': 'volume-d4db6527-86b6-4764-bdc2-c350190d739a', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:46 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-26a4f0f9-8684-499c-8eea-a73568d6d83f tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef4b7213-ebcb-4312-9837-1b551341b02e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:46 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-26a4f0f9-8684-499c-8eea-a73568d6d83f tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef4b7213-ebcb-4312-9837-1b551341b02e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:46 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-26a4f0f9-8684-499c-8eea-a73568d6d83f tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c480e6cf-8ace-47fc-a928-317ef6f5577e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:46 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-26a4f0f9-8684-499c-8eea-a73568d6d83f tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Volume d4db6527-86b6-4764-bdc2-c350190d739a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4db6527-86b6-4764-bdc2-c350190d739a', 'volume_size': 1} Jul 08 18:56:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-26a4f0f9-8684-499c-8eea-a73568d6d83f tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:56:46 devstack sudo[104165]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b290306d-3c41-4016-a485-98081277d3d0 tempest-VolumeDependencyTests-1321967090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a56282f-de69-4d61-835e-5ab241a6b719" returned: 0 in 0.809s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:46 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b290306d-3c41-4016-a485-98081277d3d0 tempest-VolumeDependencyTests-1321967090 None] <== create_volume: return (1705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:56:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b290306d-3c41-4016-a485-98081277d3d0 tempest-VolumeDependencyTests-1321967090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.709s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:56:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-245b43d0-74e2-4a09-ba25-2675a8a5a457 tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.682s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:56:46 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b290306d-3c41-4016-a485-98081277d3d0 tempest-VolumeDependencyTests-1321967090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abc999b2-c06a-40dd-9a2e-d70534795cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a56282f-de69-4d61-835e-5ab241a6b719', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:46 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b290306d-3c41-4016-a485-98081277d3d0 tempest-VolumeDependencyTests-1321967090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24c8f477-69d2-47a9-a39c-53d901351762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:46 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-245b43d0-74e2-4a09-ba25-2675a8a5a457 tempest-CreateVolumesFromSnapshotTest-202843157 None] Creating offline snapshot 349364ed-be44-4349-b6d2-afb1daa53c88 of volume 10e47c5a-6525-47f1-aca8-8672ada2f3f5 {{(pid=86873) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:56:46 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-b290306d-3c41-4016-a485-98081277d3d0 tempest-VolumeDependencyTests-1321967090 None] Volume volume-5a56282f-de69-4d61-835e-5ab241a6b719 (5a56282f-de69-4d61-835e-5ab241a6b719): created successfully Jul 08 18:56:46 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b290306d-3c41-4016-a485-98081277d3d0 tempest-VolumeDependencyTests-1321967090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24c8f477-69d2-47a9-a39c-53d901351762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:46 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b290306d-3c41-4016-a485-98081277d3d0 tempest-VolumeDependencyTests-1321967090 None] Flow 'volume_create_manager' (df43ce4f-9520-4340-9f3d-3b46d58e8439) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:56:46 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b3a607-e1ee-4b1c-ae74-debc0930d4b9]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:56:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-245b43d0-74e2-4a09-ba25-2675a8a5a457 tempest-CreateVolumesFromSnapshotTest-202843157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-10e47c5a-6525-47f1-aca8-8672ada2f3f5 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:46 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-b290306d-3c41-4016-a485-98081277d3d0 tempest-VolumeDependencyTests-1321967090 None] Created volume successfully. Jul 08 18:56:46 devstack sudo[104172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-10e47c5a-6525-47f1-aca8-8672ada2f3f5 Jul 08 18:56:46 devstack sudo[104172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:46 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e9c799a-5412-4e3c-b8ef-b215541fb30c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:56:46 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1e9c799a-5412-4e3c-b8ef-b215541fb30c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Flow 'volume_create_manager' (f931ca47-3b80-473b-98f4-9de5ba70e4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:56:46 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1e9c799a-5412-4e3c-b8ef-b215541fb30c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb671fad-3325-4c45-8e6b-61547722e249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:46 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1e9c799a-5412-4e3c-b8ef-b215541fb30c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb671fad-3325-4c45-8e6b-61547722e249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-400076306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76a0405e-2021-470b-924e-eced5b1b70d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3aca0457f0147b3b2e27e7496ca53f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:56:47Z,use_quota=True,user_id='f5888002e3ec40d6aa0a642c11d86688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:46 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1e9c799a-5412-4e3c-b8ef-b215541fb30c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa9085b8-975e-4e93-9b84-0789d6de324e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:46 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1e9c799a-5412-4e3c-b8ef-b215541fb30c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa9085b8-975e-4e93-9b84-0789d6de324e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:46 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1e9c799a-5412-4e3c-b8ef-b215541fb30c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec47d92a-8830-4d13-aebf-f0eb5ec39ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:46 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1e9c799a-5412-4e3c-b8ef-b215541fb30c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec47d92a-8830-4d13-aebf-f0eb5ec39ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76a0405e-2021-470b-924e-eced5b1b70d3', 'volume_name': 'volume-76a0405e-2021-470b-924e-eced5b1b70d3', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:46 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1e9c799a-5412-4e3c-b8ef-b215541fb30c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67dd63b1-64e1-4e21-bd64-8d4c3bb96934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:46 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1e9c799a-5412-4e3c-b8ef-b215541fb30c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67dd63b1-64e1-4e21-bd64-8d4c3bb96934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:46 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1e9c799a-5412-4e3c-b8ef-b215541fb30c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df831700-d70a-4b7c-8690-23995bba9e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:46 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-1e9c799a-5412-4e3c-b8ef-b215541fb30c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Volume 76a0405e-2021-470b-924e-eced5b1b70d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76a0405e-2021-470b-924e-eced5b1b70d3', 'volume_size': 1} Jul 08 18:56:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1e9c799a-5412-4e3c-b8ef-b215541fb30c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:56:46 devstack sudo[104169]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c23945cd-25bb-4024-a63e-5851735ebb07_kw10cd3kdevstack@QuobyteHD" returned: 1 in 0.904s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c23945cd-25bb-4024-a63e-5851735ebb07_kw10cd3kdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:56:46 devstack cinder-volume[86873]: DEBUG cinder.image.image_utils [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Temporary image c23945cd-25bb-4024-a63e-5851735ebb07 is fetched for user 0296d00de27c4244ba8a78815d60196e. {{(pid=86873) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 18:56:47 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a17b7ae-2e29-4132-a52a-6714242d2511]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:56:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c23945cd-25bb-4024-a63e-5851735ebb07_kw10cd3kdevstack@QuobyteHD {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:47 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-664283d1-39ae-46bd-8018-bf64f7fbe068 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:56:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-664283d1-39ae-46bd-8018-bf64f7fbe068 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Flow 'volume_create_manager' (28772cea-4885-4d68-a573-d933948f8e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:56:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-664283d1-39ae-46bd-8018-bf64f7fbe068 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31a7209a-d631-4bb5-8bf2-eef3efe6cd2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-664283d1-39ae-46bd-8018-bf64f7fbe068 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31a7209a-d631-4bb5-8bf2-eef3efe6cd2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:56:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1593313456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=114bae0e-e140-415b-a016-b81f1250e216,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3aca0457f0147b3b2e27e7496ca53f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:56:47Z,use_quota=True,user_id='f5888002e3ec40d6aa0a642c11d86688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-664283d1-39ae-46bd-8018-bf64f7fbe068 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89bb7502-5785-4f78-99af-62b9491c09a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-664283d1-39ae-46bd-8018-bf64f7fbe068 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89bb7502-5785-4f78-99af-62b9491c09a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-664283d1-39ae-46bd-8018-bf64f7fbe068 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e79c665-6e6f-4828-a622-d241866b664d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-664283d1-39ae-46bd-8018-bf64f7fbe068 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e79c665-6e6f-4828-a622-d241866b664d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '114bae0e-e140-415b-a016-b81f1250e216', 'volume_name': 'volume-114bae0e-e140-415b-a016-b81f1250e216', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-664283d1-39ae-46bd-8018-bf64f7fbe068 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca1dffc1-481c-4e99-86b6-714f99ba5257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-664283d1-39ae-46bd-8018-bf64f7fbe068 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca1dffc1-481c-4e99-86b6-714f99ba5257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-664283d1-39ae-46bd-8018-bf64f7fbe068 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceb7acff-c624-4f0e-98bf-602a64ed5623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:47 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-664283d1-39ae-46bd-8018-bf64f7fbe068 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Volume 114bae0e-e140-415b-a016-b81f1250e216: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-114bae0e-e140-415b-a016-b81f1250e216', 'volume_size': 1} Jul 08 18:56:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-664283d1-39ae-46bd-8018-bf64f7fbe068 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:56:47 devstack sudo[104177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c23945cd-25bb-4024-a63e-5851735ebb07_kw10cd3kdevstack@QuobyteHD Jul 08 18:56:47 devstack sudo[104177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:47 devstack sudo[104172]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-245b43d0-74e2-4a09-ba25-2675a8a5a457 tempest-CreateVolumesFromSnapshotTest-202843157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-10e47c5a-6525-47f1-aca8-8672ada2f3f5" returned: 0 in 1.015s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-245b43d0-74e2-4a09-ba25-2675a8a5a457 tempest-CreateVolumesFromSnapshotTest-202843157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-10e47c5a-6525-47f1-aca8-8672ada2f3f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-10e47c5a-6525-47f1-aca8-8672ada2f3f5.349364ed-be44-4349-b6d2-afb1daa53c88 1G {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:47 devstack sudo[104182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-10e47c5a-6525-47f1-aca8-8672ada2f3f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-10e47c5a-6525-47f1-aca8-8672ada2f3f5.349364ed-be44-4349-b6d2-afb1daa53c88 1G Jul 08 18:56:47 devstack sudo[104182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:47 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-f14370df-1be2-483d-9acf-d87d052c77d1 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:56:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f14370df-1be2-483d-9acf-d87d052c77d1 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Flow 'volume_create_manager' (b4821fc4-9c6a-4025-9657-9bae9f26c2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:56:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f14370df-1be2-483d-9acf-d87d052c77d1 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (748f7b2f-60ca-4787-a034-c9d50a6a8cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f14370df-1be2-483d-9acf-d87d052c77d1 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (748f7b2f-60ca-4787-a034-c9d50a6a8cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:56:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2040137361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b9e7f8d-33ec-4910-b982-df033166c604,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3aca0457f0147b3b2e27e7496ca53f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:56:47Z,use_quota=True,user_id='f5888002e3ec40d6aa0a642c11d86688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f14370df-1be2-483d-9acf-d87d052c77d1 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69801cf3-54a6-4cad-aa65-019e025ebd5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f14370df-1be2-483d-9acf-d87d052c77d1 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69801cf3-54a6-4cad-aa65-019e025ebd5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f14370df-1be2-483d-9acf-d87d052c77d1 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3c66459-d7b8-4403-81d4-a3932a7da5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f14370df-1be2-483d-9acf-d87d052c77d1 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3c66459-d7b8-4403-81d4-a3932a7da5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b9e7f8d-33ec-4910-b982-df033166c604', 'volume_name': 'volume-9b9e7f8d-33ec-4910-b982-df033166c604', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f14370df-1be2-483d-9acf-d87d052c77d1 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be90ce16-62f6-4099-a22f-a891694598aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f14370df-1be2-483d-9acf-d87d052c77d1 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be90ce16-62f6-4099-a22f-a891694598aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f14370df-1be2-483d-9acf-d87d052c77d1 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc30e4b6-84d2-4adf-95ff-b24decd8443b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:47 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-f14370df-1be2-483d-9acf-d87d052c77d1 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Volume 9b9e7f8d-33ec-4910-b982-df033166c604: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b9e7f8d-33ec-4910-b982-df033166c604', 'volume_size': 1} Jul 08 18:56:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f14370df-1be2-483d-9acf-d87d052c77d1 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:56:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1cd1dc1b-e339-4c48-af76-fc47c211fef5 tempest-VolumeDependencyTests-1321967090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:56:47 devstack sudo[104177]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c23945cd-25bb-4024-a63e-5851735ebb07_kw10cd3kdevstack@QuobyteHD" returned: 0 in 0.868s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c23945cd-25bb-4024-a63e-5851735ebb07_kw10cd3kdevstack@QuobyteHD {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:48 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-c12949f1-4986-4c73-ad27-25f30cf0546c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:56:48 devstack sudo[104186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c23945cd-25bb-4024-a63e-5851735ebb07_kw10cd3kdevstack@QuobyteHD Jul 08 18:56:48 devstack sudo[104186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c12949f1-4986-4c73-ad27-25f30cf0546c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Flow 'volume_create_manager' (8bfbddb9-bf23-48fe-b3e4-474251018315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:56:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c12949f1-4986-4c73-ad27-25f30cf0546c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a9f73e8-982e-4da2-98f0-a8de8e800c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c12949f1-4986-4c73-ad27-25f30cf0546c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a9f73e8-982e-4da2-98f0-a8de8e800c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:56:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-951799837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0afee2b-8bc5-4230-8a4f-f195ff5595cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3aca0457f0147b3b2e27e7496ca53f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:56:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:56:48Z,use_quota=True,user_id='f5888002e3ec40d6aa0a642c11d86688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c12949f1-4986-4c73-ad27-25f30cf0546c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a279043e-51e3-4527-8149-61d75de2a567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c12949f1-4986-4c73-ad27-25f30cf0546c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a279043e-51e3-4527-8149-61d75de2a567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c12949f1-4986-4c73-ad27-25f30cf0546c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ab15b97-54f3-4940-9774-0f7941a48c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c12949f1-4986-4c73-ad27-25f30cf0546c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ab15b97-54f3-4940-9774-0f7941a48c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0afee2b-8bc5-4230-8a4f-f195ff5595cd', 'volume_name': 'volume-c0afee2b-8bc5-4230-8a4f-f195ff5595cd', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c12949f1-4986-4c73-ad27-25f30cf0546c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18c50e5a-66e4-4008-a2ea-132fba8af59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c12949f1-4986-4c73-ad27-25f30cf0546c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18c50e5a-66e4-4008-a2ea-132fba8af59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c12949f1-4986-4c73-ad27-25f30cf0546c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c1eea0b-b63a-465d-b402-942d2da4a297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:48 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-c12949f1-4986-4c73-ad27-25f30cf0546c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Volume c0afee2b-8bc5-4230-8a4f-f195ff5595cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0afee2b-8bc5-4230-8a4f-f195ff5595cd', 'volume_size': 1} Jul 08 18:56:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c12949f1-4986-4c73-ad27-25f30cf0546c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:56:48 devstack cinder-volume[86873]: DEBUG oslo_service.periodic_task [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86873) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:56:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:56:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:56:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:56:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:56:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:56:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:48 devstack sudo[104191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:56:48 devstack sudo[104191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:48 devstack sudo[104182]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-245b43d0-74e2-4a09-ba25-2675a8a5a457 tempest-CreateVolumesFromSnapshotTest-202843157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-10e47c5a-6525-47f1-aca8-8672ada2f3f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-10e47c5a-6525-47f1-aca8-8672ada2f3f5.349364ed-be44-4349-b6d2-afb1daa53c88 1G" returned: 0 in 1.064s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-245b43d0-74e2-4a09-ba25-2675a8a5a457 tempest-CreateVolumesFromSnapshotTest-202843157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10e47c5a-6525-47f1-aca8-8672ada2f3f5 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-10e47c5a-6525-47f1-aca8-8672ada2f3f5.349364ed-be44-4349-b6d2-afb1daa53c88 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:48 devstack sudo[104193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10e47c5a-6525-47f1-aca8-8672ada2f3f5 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-10e47c5a-6525-47f1-aca8-8672ada2f3f5.349364ed-be44-4349-b6d2-afb1daa53c88 Jul 08 18:56:48 devstack sudo[104193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:48 devstack sudo[104186]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c23945cd-25bb-4024-a63e-5851735ebb07_kw10cd3kdevstack@QuobyteHD" returned: 1 in 0.784s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c23945cd-25bb-4024-a63e-5851735ebb07_kw10cd3kdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:56:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:56:48 devstack sudo[104191]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.671s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:48 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:56:48 devstack cinder-volume[86873]: DEBUG oslo_service.periodic_task [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running periodic task VolumeManager._thread_info {{(pid=86873) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:56:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] thread count: 29 {{(pid=86873) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:56:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] thread info: [<_MainThread(MainThread, started 138577734545536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86873) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:56:49 devstack sudo[104193]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-245b43d0-74e2-4a09-ba25-2675a8a5a457 tempest-CreateVolumesFromSnapshotTest-202843157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10e47c5a-6525-47f1-aca8-8672ada2f3f5 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-10e47c5a-6525-47f1-aca8-8672ada2f3f5.349364ed-be44-4349-b6d2-afb1daa53c88" returned: 0 in 0.712s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:49 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-245b43d0-74e2-4a09-ba25-2675a8a5a457 tempest-CreateVolumesFromSnapshotTest-202843157 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-10e47c5a-6525-47f1-aca8-8672ada2f3f5.349364ed-be44-4349-b6d2-afb1daa53c88 is being set with open permissions: ugo+rw Jul 08 18:56:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-245b43d0-74e2-4a09-ba25-2675a8a5a457 tempest-CreateVolumesFromSnapshotTest-202843157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-10e47c5a-6525-47f1-aca8-8672ada2f3f5.349364ed-be44-4349-b6d2-afb1daa53c88 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:49 devstack sudo[104202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-10e47c5a-6525-47f1-aca8-8672ada2f3f5.349364ed-be44-4349-b6d2-afb1daa53c88 Jul 08 18:56:49 devstack sudo[104202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:49 devstack sudo[104202]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-245b43d0-74e2-4a09-ba25-2675a8a5a457 tempest-CreateVolumesFromSnapshotTest-202843157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-10e47c5a-6525-47f1-aca8-8672ada2f3f5.349364ed-be44-4349-b6d2-afb1daa53c88" returned: 0 in 0.662s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-245b43d0-74e2-4a09-ba25-2675a8a5a457 tempest-CreateVolumesFromSnapshotTest-202843157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-10e47c5a-6525-47f1-aca8-8672ada2f3f5.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:49 devstack sudo[104205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-10e47c5a-6525-47f1-aca8-8672ada2f3f5.info Jul 08 18:56:49 devstack sudo[104205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:50 devstack sudo[104205]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-245b43d0-74e2-4a09-ba25-2675a8a5a457 tempest-CreateVolumesFromSnapshotTest-202843157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-10e47c5a-6525-47f1-aca8-8672ada2f3f5.info" returned: 0 in 0.658s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:50 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-245b43d0-74e2-4a09-ba25-2675a8a5a457 tempest-CreateVolumesFromSnapshotTest-202843157 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-10e47c5a-6525-47f1-aca8-8672ada2f3f5.info is being set with open permissions: ugo+rw Jul 08 18:56:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-245b43d0-74e2-4a09-ba25-2675a8a5a457 tempest-CreateVolumesFromSnapshotTest-202843157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-10e47c5a-6525-47f1-aca8-8672ada2f3f5.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:50 devstack sudo[104208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-10e47c5a-6525-47f1-aca8-8672ada2f3f5.info Jul 08 18:56:50 devstack sudo[104208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:51 devstack sudo[104208]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-245b43d0-74e2-4a09-ba25-2675a8a5a457 tempest-CreateVolumesFromSnapshotTest-202843157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-10e47c5a-6525-47f1-aca8-8672ada2f3f5.info" returned: 0 in 0.646s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-245b43d0-74e2-4a09-ba25-2675a8a5a457 tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.892s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:56:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-26a4f0f9-8684-499c-8eea-a73568d6d83f tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.901s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:56:51 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-26a4f0f9-8684-499c-8eea-a73568d6d83f tempest-CreateVolumesFromSourceVolumeTest-106813322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1967104004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4db6527-86b6-4764-bdc2-c350190d739a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3aca0457f0147b3b2e27e7496ca53f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:56:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:56:46Z,use_quota=True,user_id='f5888002e3ec40d6aa0a642c11d86688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:56:51 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-26a4f0f9-8684-499c-8eea-a73568d6d83f tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Creating volume d4db6527-86b6-4764-bdc2-c350190d739a {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:56:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-26a4f0f9-8684-499c-8eea-a73568d6d83f tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:56:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-26a4f0f9-8684-499c-8eea-a73568d6d83f tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:56:51 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-26a4f0f9-8684-499c-8eea-a73568d6d83f tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:56:51 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-26a4f0f9-8684-499c-8eea-a73568d6d83f tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:56:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-26a4f0f9-8684-499c-8eea-a73568d6d83f tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:56:51 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-26a4f0f9-8684-499c-8eea-a73568d6d83f tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:56:51 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-26a4f0f9-8684-499c-8eea-a73568d6d83f tempest-CreateVolumesFromSourceVolumeTest-106813322 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:56:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-26a4f0f9-8684-499c-8eea-a73568d6d83f tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4db6527-86b6-4764-bdc2-c350190d739a 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:51 devstack sudo[104211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4db6527-86b6-4764-bdc2-c350190d739a 1073741824 Jul 08 18:56:51 devstack sudo[104211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:51 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-245b43d0-74e2-4a09-ba25-2675a8a5a457 tempest-CreateVolumesFromSnapshotTest-202843157 None] Create snapshot completed successfully Jul 08 18:56:52 devstack sudo[104211]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-26a4f0f9-8684-499c-8eea-a73568d6d83f tempest-CreateVolumesFromSourceVolumeTest-106813322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4db6527-86b6-4764-bdc2-c350190d739a 1073741824" returned: 0 in 0.819s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-26a4f0f9-8684-499c-8eea-a73568d6d83f tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4db6527-86b6-4764-bdc2-c350190d739a {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:52 devstack sudo[104217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4db6527-86b6-4764-bdc2-c350190d739a Jul 08 18:56:52 devstack sudo[104217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:52 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f103202-46b8-47ed-b2e8-7a12bf05be63 tempest-CreateVolumesFromSnapshotTest-202843157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:56:52 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-9f103202-46b8-47ed-b2e8-7a12bf05be63 tempest-CreateVolumesFromSnapshotTest-202843157 None] Flow 'volume_create_manager' (969fb816-b51a-48cd-8688-92340b4fff76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:56:52 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-9f103202-46b8-47ed-b2e8-7a12bf05be63 tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23b29e50-d6ef-490b-b382-c96e5cb63960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:52 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-9f103202-46b8-47ed-b2e8-7a12bf05be63 tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23b29e50-d6ef-490b-b382-c96e5cb63960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:56:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1095459663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf841f53-ae69-415b-a18a-8613b270e125,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f58dd594e6704f04aa670507ae860614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:56:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:56:52Z,use_quota=True,user_id='18dfc796e05642b8bcaf789a3d9f411c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:52 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-9f103202-46b8-47ed-b2e8-7a12bf05be63 tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77b5c5f4-5366-4daa-9e9d-2e83ca43ad42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:52 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-9f103202-46b8-47ed-b2e8-7a12bf05be63 tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77b5c5f4-5366-4daa-9e9d-2e83ca43ad42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:52 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-9f103202-46b8-47ed-b2e8-7a12bf05be63 tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b511fec-b03d-4233-833d-f64c7ebdf35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:52 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-9f103202-46b8-47ed-b2e8-7a12bf05be63 tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b511fec-b03d-4233-833d-f64c7ebdf35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf841f53-ae69-415b-a18a-8613b270e125', 'volume_name': 'volume-cf841f53-ae69-415b-a18a-8613b270e125', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:52 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-9f103202-46b8-47ed-b2e8-7a12bf05be63 tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfc7d7f0-b8e5-4736-940d-881b9ab4bbd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:52 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-9f103202-46b8-47ed-b2e8-7a12bf05be63 tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfc7d7f0-b8e5-4736-940d-881b9ab4bbd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:52 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-9f103202-46b8-47ed-b2e8-7a12bf05be63 tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87a066f9-f7b5-47a7-a252-14f3623491bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:52 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-9f103202-46b8-47ed-b2e8-7a12bf05be63 tempest-CreateVolumesFromSnapshotTest-202843157 None] Volume cf841f53-ae69-415b-a18a-8613b270e125: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf841f53-ae69-415b-a18a-8613b270e125', 'volume_size': 1} Jul 08 18:56:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-9f103202-46b8-47ed-b2e8-7a12bf05be63 tempest-CreateVolumesFromSnapshotTest-202843157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:56:52 devstack sudo[104217]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-26a4f0f9-8684-499c-8eea-a73568d6d83f tempest-CreateVolumesFromSourceVolumeTest-106813322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4db6527-86b6-4764-bdc2-c350190d739a" returned: 0 in 0.665s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:52 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-26a4f0f9-8684-499c-8eea-a73568d6d83f tempest-CreateVolumesFromSourceVolumeTest-106813322 None] <== create_volume: return (1534ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:56:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-26a4f0f9-8684-499c-8eea-a73568d6d83f tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.537s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:56:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1e9c799a-5412-4e3c-b8ef-b215541fb30c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.046s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:56:52 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-1e9c799a-5412-4e3c-b8ef-b215541fb30c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-400076306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76a0405e-2021-470b-924e-eced5b1b70d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3aca0457f0147b3b2e27e7496ca53f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:56:47Z,use_quota=True,user_id='f5888002e3ec40d6aa0a642c11d86688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:56:52 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-1e9c799a-5412-4e3c-b8ef-b215541fb30c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Creating volume 76a0405e-2021-470b-924e-eced5b1b70d3 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:56:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1e9c799a-5412-4e3c-b8ef-b215541fb30c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:56:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1e9c799a-5412-4e3c-b8ef-b215541fb30c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:56:52 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-1e9c799a-5412-4e3c-b8ef-b215541fb30c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:56:52 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-1e9c799a-5412-4e3c-b8ef-b215541fb30c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:56:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1e9c799a-5412-4e3c-b8ef-b215541fb30c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:56:52 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-1e9c799a-5412-4e3c-b8ef-b215541fb30c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:56:52 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-1e9c799a-5412-4e3c-b8ef-b215541fb30c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:56:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1e9c799a-5412-4e3c-b8ef-b215541fb30c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-76a0405e-2021-470b-924e-eced5b1b70d3 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:52 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-26a4f0f9-8684-499c-8eea-a73568d6d83f tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c480e6cf-8ace-47fc-a928-317ef6f5577e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4db6527-86b6-4764-bdc2-c350190d739a', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:52 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-26a4f0f9-8684-499c-8eea-a73568d6d83f tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d0aff54-9d54-45d3-ac40-73a2590efecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:52 devstack sudo[104221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-76a0405e-2021-470b-924e-eced5b1b70d3 1073741824 Jul 08 18:56:52 devstack sudo[104221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:52 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-26a4f0f9-8684-499c-8eea-a73568d6d83f tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Volume volume-d4db6527-86b6-4764-bdc2-c350190d739a (d4db6527-86b6-4764-bdc2-c350190d739a): created successfully Jul 08 18:56:52 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-26a4f0f9-8684-499c-8eea-a73568d6d83f tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d0aff54-9d54-45d3-ac40-73a2590efecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:52 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-26a4f0f9-8684-499c-8eea-a73568d6d83f tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Flow 'volume_create_manager' (195d374f-adf4-4a0d-980e-99bb199c8639) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:56:52 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-26a4f0f9-8684-499c-8eea-a73568d6d83f tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Created volume successfully. Jul 08 18:56:52 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e247b1f-6774-41d1-b34b-c83fafe81a31 tempest-CreateVolumesFromSnapshotTest-202843157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:56:52 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5e247b1f-6774-41d1-b34b-c83fafe81a31 tempest-CreateVolumesFromSnapshotTest-202843157 None] Flow 'volume_create_manager' (807bf166-c04d-4cf1-8775-297f719bf909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:56:52 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5e247b1f-6774-41d1-b34b-c83fafe81a31 tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b8aa622-529a-46e0-856b-9e3e587cfa7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:52 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5e247b1f-6774-41d1-b34b-c83fafe81a31 tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b8aa622-529a-46e0-856b-9e3e587cfa7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:56:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2080615850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96de88df-5d88-43da-8031-e1d1fc041d99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f58dd594e6704f04aa670507ae860614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:56:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:56:53Z,use_quota=True,user_id='18dfc796e05642b8bcaf789a3d9f411c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:52 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5e247b1f-6774-41d1-b34b-c83fafe81a31 tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cefd1b0-04f9-4419-947a-49f0c1ca3f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:52 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5e247b1f-6774-41d1-b34b-c83fafe81a31 tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cefd1b0-04f9-4419-947a-49f0c1ca3f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:53 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5e247b1f-6774-41d1-b34b-c83fafe81a31 tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2b75432-61b1-43bf-9197-74df82a62e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:53 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5e247b1f-6774-41d1-b34b-c83fafe81a31 tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2b75432-61b1-43bf-9197-74df82a62e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96de88df-5d88-43da-8031-e1d1fc041d99', 'volume_name': 'volume-96de88df-5d88-43da-8031-e1d1fc041d99', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:53 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5e247b1f-6774-41d1-b34b-c83fafe81a31 tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65ac18f3-9813-4a6f-9002-8c762d22cfcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:53 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5e247b1f-6774-41d1-b34b-c83fafe81a31 tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65ac18f3-9813-4a6f-9002-8c762d22cfcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:53 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5e247b1f-6774-41d1-b34b-c83fafe81a31 tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4afede2-b3b8-429f-a0c4-d8b1dacfe6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:53 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-5e247b1f-6774-41d1-b34b-c83fafe81a31 tempest-CreateVolumesFromSnapshotTest-202843157 None] Volume 96de88df-5d88-43da-8031-e1d1fc041d99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96de88df-5d88-43da-8031-e1d1fc041d99', 'volume_size': 1} Jul 08 18:56:53 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5e247b1f-6774-41d1-b34b-c83fafe81a31 tempest-CreateVolumesFromSnapshotTest-202843157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:56:53 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7636492-9dd6-4767-a750-399f3ee5034b tempest-CreateVolumesFromSnapshotTest-202843157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:56:53 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c7636492-9dd6-4767-a750-399f3ee5034b tempest-CreateVolumesFromSnapshotTest-202843157 None] Flow 'volume_create_manager' (6570f1de-26e4-4e99-8cff-d7a756651f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:56:53 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c7636492-9dd6-4767-a750-399f3ee5034b tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42ac1eb1-5e08-444d-a6f9-a056d397cde8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:53 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c7636492-9dd6-4767-a750-399f3ee5034b tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42ac1eb1-5e08-444d-a6f9-a056d397cde8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:56:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2109202217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45cde405-e75c-48da-a2f8-cd6d5dd82eda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f58dd594e6704f04aa670507ae860614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:56:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:56:53Z,use_quota=True,user_id='18dfc796e05642b8bcaf789a3d9f411c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:53 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c7636492-9dd6-4767-a750-399f3ee5034b tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98cd0a49-24de-4e76-826d-6f17c8bc1980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:53 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c7636492-9dd6-4767-a750-399f3ee5034b tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98cd0a49-24de-4e76-826d-6f17c8bc1980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:53 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c7636492-9dd6-4767-a750-399f3ee5034b tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13428201-602b-4f41-a6df-d8a3b7ee1af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:53 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c7636492-9dd6-4767-a750-399f3ee5034b tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13428201-602b-4f41-a6df-d8a3b7ee1af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45cde405-e75c-48da-a2f8-cd6d5dd82eda', 'volume_name': 'volume-45cde405-e75c-48da-a2f8-cd6d5dd82eda', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:53 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c7636492-9dd6-4767-a750-399f3ee5034b tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be449df6-56e1-4027-b2f0-7d21efdc1bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:53 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c7636492-9dd6-4767-a750-399f3ee5034b tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be449df6-56e1-4027-b2f0-7d21efdc1bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:53 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c7636492-9dd6-4767-a750-399f3ee5034b tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (438f9421-e255-47a9-89b3-0b8ac652c6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:53 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-c7636492-9dd6-4767-a750-399f3ee5034b tempest-CreateVolumesFromSnapshotTest-202843157 None] Volume 45cde405-e75c-48da-a2f8-cd6d5dd82eda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45cde405-e75c-48da-a2f8-cd6d5dd82eda', 'volume_size': 1} Jul 08 18:56:53 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c7636492-9dd6-4767-a750-399f3ee5034b tempest-CreateVolumesFromSnapshotTest-202843157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:56:53 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-a575d788-26fb-466f-ab91-daf2b44e148d tempest-CreateVolumesFromSnapshotTest-202843157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:56:53 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-a575d788-26fb-466f-ab91-daf2b44e148d tempest-CreateVolumesFromSnapshotTest-202843157 None] Flow 'volume_create_manager' (a1017761-ac70-4354-bb4f-5a5419950fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:56:53 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-a575d788-26fb-466f-ab91-daf2b44e148d tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1275dbbc-abaa-4791-8085-d1662c872437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:53 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-a575d788-26fb-466f-ab91-daf2b44e148d tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1275dbbc-abaa-4791-8085-d1662c872437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:56:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1543987227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=402ff7f6-b067-4adb-84f3-57c7475fa870,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f58dd594e6704f04aa670507ae860614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:56:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:56:54Z,use_quota=True,user_id='18dfc796e05642b8bcaf789a3d9f411c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:53 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-a575d788-26fb-466f-ab91-daf2b44e148d tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18010bad-2ff4-41d0-8d48-a5bbd777a3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:53 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-a575d788-26fb-466f-ab91-daf2b44e148d tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18010bad-2ff4-41d0-8d48-a5bbd777a3b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:53 devstack sudo[104221]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:53 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-a575d788-26fb-466f-ab91-daf2b44e148d tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e76f140c-9659-43d2-a9fc-81b170070819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:53 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-a575d788-26fb-466f-ab91-daf2b44e148d tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e76f140c-9659-43d2-a9fc-81b170070819) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '402ff7f6-b067-4adb-84f3-57c7475fa870', 'volume_name': 'volume-402ff7f6-b067-4adb-84f3-57c7475fa870', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:53 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-a575d788-26fb-466f-ab91-daf2b44e148d tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6fb83e4-f3b6-459d-9578-10e4b1bc99a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:53 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-a575d788-26fb-466f-ab91-daf2b44e148d tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6fb83e4-f3b6-459d-9578-10e4b1bc99a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:53 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-a575d788-26fb-466f-ab91-daf2b44e148d tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b79a56b-f383-4fe4-b04d-d0717e5dd692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:53 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-a575d788-26fb-466f-ab91-daf2b44e148d tempest-CreateVolumesFromSnapshotTest-202843157 None] Volume 402ff7f6-b067-4adb-84f3-57c7475fa870: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-402ff7f6-b067-4adb-84f3-57c7475fa870', 'volume_size': 1} Jul 08 18:56:53 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-a575d788-26fb-466f-ab91-daf2b44e148d tempest-CreateVolumesFromSnapshotTest-202843157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:56:53 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1e9c799a-5412-4e3c-b8ef-b215541fb30c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-76a0405e-2021-470b-924e-eced5b1b70d3 1073741824" returned: 0 in 1.025s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:53 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1e9c799a-5412-4e3c-b8ef-b215541fb30c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-76a0405e-2021-470b-924e-eced5b1b70d3 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:53 devstack sudo[104227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-76a0405e-2021-470b-924e-eced5b1b70d3 Jul 08 18:56:53 devstack sudo[104227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:54 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-51acaa72-caf4-4d15-8911-582266fb01d8 tempest-CreateVolumesFromSnapshotTest-202843157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:56:54 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-51acaa72-caf4-4d15-8911-582266fb01d8 tempest-CreateVolumesFromSnapshotTest-202843157 None] Flow 'volume_create_manager' (9383f930-3ae5-4ca0-8ad9-12f3943da8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:56:54 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-51acaa72-caf4-4d15-8911-582266fb01d8 tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42369db5-c823-4445-aea4-345fd36592bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:54 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-51acaa72-caf4-4d15-8911-582266fb01d8 tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42369db5-c823-4445-aea4-345fd36592bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:56:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-490706073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f53733c7-17d8-4e99-9ff5-a19226eecb33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f58dd594e6704f04aa670507ae860614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:56:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:56:54Z,use_quota=True,user_id='18dfc796e05642b8bcaf789a3d9f411c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:54 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-51acaa72-caf4-4d15-8911-582266fb01d8 tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25705b56-7cb7-49a8-883f-4651bb19a50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:54 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-51acaa72-caf4-4d15-8911-582266fb01d8 tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25705b56-7cb7-49a8-883f-4651bb19a50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:54 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-51acaa72-caf4-4d15-8911-582266fb01d8 tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1df88d7-ad1f-44b0-8abd-f7133ca5862c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:54 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-51acaa72-caf4-4d15-8911-582266fb01d8 tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1df88d7-ad1f-44b0-8abd-f7133ca5862c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f53733c7-17d8-4e99-9ff5-a19226eecb33', 'volume_name': 'volume-f53733c7-17d8-4e99-9ff5-a19226eecb33', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:54 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-51acaa72-caf4-4d15-8911-582266fb01d8 tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef4713f8-bd68-4b00-92b6-50e731f57d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:54 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-51acaa72-caf4-4d15-8911-582266fb01d8 tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef4713f8-bd68-4b00-92b6-50e731f57d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:54 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-51acaa72-caf4-4d15-8911-582266fb01d8 tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e57bbbdf-e605-4743-bf84-35c529d14f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:54 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-51acaa72-caf4-4d15-8911-582266fb01d8 tempest-CreateVolumesFromSnapshotTest-202843157 None] Volume f53733c7-17d8-4e99-9ff5-a19226eecb33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f53733c7-17d8-4e99-9ff5-a19226eecb33', 'volume_size': 1} Jul 08 18:56:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-51acaa72-caf4-4d15-8911-582266fb01d8 tempest-CreateVolumesFromSnapshotTest-202843157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:56:54 devstack sudo[104227]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1e9c799a-5412-4e3c-b8ef-b215541fb30c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-76a0405e-2021-470b-924e-eced5b1b70d3" returned: 0 in 0.685s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:54 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-1e9c799a-5412-4e3c-b8ef-b215541fb30c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] <== create_volume: return (1757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:56:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1e9c799a-5412-4e3c-b8ef-b215541fb30c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.761s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:56:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-664283d1-39ae-46bd-8018-bf64f7fbe068 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.412s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:56:54 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-664283d1-39ae-46bd-8018-bf64f7fbe068 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:56:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1593313456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=114bae0e-e140-415b-a016-b81f1250e216,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3aca0457f0147b3b2e27e7496ca53f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:56:47Z,use_quota=True,user_id='f5888002e3ec40d6aa0a642c11d86688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:56:54 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-664283d1-39ae-46bd-8018-bf64f7fbe068 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Creating volume 114bae0e-e140-415b-a016-b81f1250e216 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:56:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-664283d1-39ae-46bd-8018-bf64f7fbe068 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:56:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-664283d1-39ae-46bd-8018-bf64f7fbe068 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:56:54 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-664283d1-39ae-46bd-8018-bf64f7fbe068 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:56:54 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-664283d1-39ae-46bd-8018-bf64f7fbe068 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:56:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-664283d1-39ae-46bd-8018-bf64f7fbe068 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:56:54 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-664283d1-39ae-46bd-8018-bf64f7fbe068 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:56:54 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-664283d1-39ae-46bd-8018-bf64f7fbe068 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:56:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-664283d1-39ae-46bd-8018-bf64f7fbe068 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-114bae0e-e140-415b-a016-b81f1250e216 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:54 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1e9c799a-5412-4e3c-b8ef-b215541fb30c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df831700-d70a-4b7c-8690-23995bba9e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76a0405e-2021-470b-924e-eced5b1b70d3', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:54 devstack sudo[104230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-114bae0e-e140-415b-a016-b81f1250e216 1073741824 Jul 08 18:56:54 devstack sudo[104230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:54 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1e9c799a-5412-4e3c-b8ef-b215541fb30c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f059c99d-2d8b-4d5e-9782-168dae242dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:54 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-1e9c799a-5412-4e3c-b8ef-b215541fb30c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Volume volume-76a0405e-2021-470b-924e-eced5b1b70d3 (76a0405e-2021-470b-924e-eced5b1b70d3): created successfully Jul 08 18:56:54 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1e9c799a-5412-4e3c-b8ef-b215541fb30c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f059c99d-2d8b-4d5e-9782-168dae242dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:54 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1e9c799a-5412-4e3c-b8ef-b215541fb30c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Flow 'volume_create_manager' (f931ca47-3b80-473b-98f4-9de5ba70e4ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:56:54 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-1e9c799a-5412-4e3c-b8ef-b215541fb30c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Created volume successfully. Jul 08 18:56:55 devstack sudo[104230]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-664283d1-39ae-46bd-8018-bf64f7fbe068 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-114bae0e-e140-415b-a016-b81f1250e216 1073741824" returned: 0 in 0.867s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-664283d1-39ae-46bd-8018-bf64f7fbe068 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-114bae0e-e140-415b-a016-b81f1250e216 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:55 devstack sudo[104236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-114bae0e-e140-415b-a016-b81f1250e216 Jul 08 18:56:55 devstack sudo[104236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:56 devstack sudo[104236]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-664283d1-39ae-46bd-8018-bf64f7fbe068 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-114bae0e-e140-415b-a016-b81f1250e216" returned: 0 in 0.675s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:56 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-664283d1-39ae-46bd-8018-bf64f7fbe068 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] <== create_volume: return (1580ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:56:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-664283d1-39ae-46bd-8018-bf64f7fbe068 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.582s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:56:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f14370df-1be2-483d-9acf-d87d052c77d1 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.510s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:56:56 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-f14370df-1be2-483d-9acf-d87d052c77d1 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:56:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2040137361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b9e7f8d-33ec-4910-b982-df033166c604,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3aca0457f0147b3b2e27e7496ca53f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:56:47Z,use_quota=True,user_id='f5888002e3ec40d6aa0a642c11d86688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:56:56 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-f14370df-1be2-483d-9acf-d87d052c77d1 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Creating volume 9b9e7f8d-33ec-4910-b982-df033166c604 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:56:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f14370df-1be2-483d-9acf-d87d052c77d1 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:56:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f14370df-1be2-483d-9acf-d87d052c77d1 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:56:56 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-f14370df-1be2-483d-9acf-d87d052c77d1 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:56:56 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-f14370df-1be2-483d-9acf-d87d052c77d1 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:56:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f14370df-1be2-483d-9acf-d87d052c77d1 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:56:56 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-f14370df-1be2-483d-9acf-d87d052c77d1 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:56:56 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-f14370df-1be2-483d-9acf-d87d052c77d1 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:56:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f14370df-1be2-483d-9acf-d87d052c77d1 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b9e7f8d-33ec-4910-b982-df033166c604 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:56 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-664283d1-39ae-46bd-8018-bf64f7fbe068 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceb7acff-c624-4f0e-98bf-602a64ed5623) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-114bae0e-e140-415b-a016-b81f1250e216', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:56 devstack sudo[104239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b9e7f8d-33ec-4910-b982-df033166c604 1073741824 Jul 08 18:56:56 devstack sudo[104239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:56 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-664283d1-39ae-46bd-8018-bf64f7fbe068 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73db692d-2584-46c3-9ec0-4750fb00d72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:56 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-664283d1-39ae-46bd-8018-bf64f7fbe068 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Volume volume-114bae0e-e140-415b-a016-b81f1250e216 (114bae0e-e140-415b-a016-b81f1250e216): created successfully Jul 08 18:56:56 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-664283d1-39ae-46bd-8018-bf64f7fbe068 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73db692d-2584-46c3-9ec0-4750fb00d72a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:56 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-664283d1-39ae-46bd-8018-bf64f7fbe068 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Flow 'volume_create_manager' (28772cea-4885-4d68-a573-d933948f8e9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:56:56 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-664283d1-39ae-46bd-8018-bf64f7fbe068 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Created volume successfully. Jul 08 18:56:56 devstack sudo[104239]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f14370df-1be2-483d-9acf-d87d052c77d1 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b9e7f8d-33ec-4910-b982-df033166c604 1073741824" returned: 0 in 0.824s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f14370df-1be2-483d-9acf-d87d052c77d1 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b9e7f8d-33ec-4910-b982-df033166c604 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:57 devstack sudo[104245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b9e7f8d-33ec-4910-b982-df033166c604 Jul 08 18:56:57 devstack sudo[104245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:57 devstack sudo[104245]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f14370df-1be2-483d-9acf-d87d052c77d1 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b9e7f8d-33ec-4910-b982-df033166c604" returned: 0 in 0.652s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:57 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-f14370df-1be2-483d-9acf-d87d052c77d1 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] <== create_volume: return (1515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:56:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f14370df-1be2-483d-9acf-d87d052c77d1 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.518s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:56:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1cd1dc1b-e339-4c48-af76-fc47c211fef5 tempest-VolumeDependencyTests-1321967090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.947s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:56:57 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f14370df-1be2-483d-9acf-d87d052c77d1 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc30e4b6-84d2-4adf-95ff-b24decd8443b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b9e7f8d-33ec-4910-b982-df033166c604', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:57 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f14370df-1be2-483d-9acf-d87d052c77d1 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (687d9c72-6ec6-4a5b-a386-655665a55af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:57 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-1cd1dc1b-e339-4c48-af76-fc47c211fef5 tempest-VolumeDependencyTests-1321967090 None] Creating offline snapshot 657b870a-b2d6-4d4a-b36d-233151045e40 of volume 5a56282f-de69-4d61-835e-5ab241a6b719 {{(pid=86873) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:56:57 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-f14370df-1be2-483d-9acf-d87d052c77d1 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Volume volume-9b9e7f8d-33ec-4910-b982-df033166c604 (9b9e7f8d-33ec-4910-b982-df033166c604): created successfully Jul 08 18:56:57 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f14370df-1be2-483d-9acf-d87d052c77d1 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (687d9c72-6ec6-4a5b-a386-655665a55af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:57 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f14370df-1be2-483d-9acf-d87d052c77d1 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Flow 'volume_create_manager' (b4821fc4-9c6a-4025-9657-9bae9f26c2b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:56:57 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c316e2d-55f8-406f-88ce-8f929f53136d]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:56:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1cd1dc1b-e339-4c48-af76-fc47c211fef5 tempest-VolumeDependencyTests-1321967090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a56282f-de69-4d61-835e-5ab241a6b719 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:57 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-f14370df-1be2-483d-9acf-d87d052c77d1 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Created volume successfully. Jul 08 18:56:57 devstack sudo[104248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a56282f-de69-4d61-835e-5ab241a6b719 Jul 08 18:56:57 devstack sudo[104248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:58 devstack sudo[104248]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1cd1dc1b-e339-4c48-af76-fc47c211fef5 tempest-VolumeDependencyTests-1321967090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a56282f-de69-4d61-835e-5ab241a6b719" returned: 0 in 0.794s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1cd1dc1b-e339-4c48-af76-fc47c211fef5 tempest-VolumeDependencyTests-1321967090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a56282f-de69-4d61-835e-5ab241a6b719,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a56282f-de69-4d61-835e-5ab241a6b719.657b870a-b2d6-4d4a-b36d-233151045e40 1G {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:58 devstack sudo[104253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a56282f-de69-4d61-835e-5ab241a6b719,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a56282f-de69-4d61-835e-5ab241a6b719.657b870a-b2d6-4d4a-b36d-233151045e40 1G Jul 08 18:56:58 devstack sudo[104253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:59 devstack sudo[104253]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1cd1dc1b-e339-4c48-af76-fc47c211fef5 tempest-VolumeDependencyTests-1321967090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a56282f-de69-4d61-835e-5ab241a6b719,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a56282f-de69-4d61-835e-5ab241a6b719.657b870a-b2d6-4d4a-b36d-233151045e40 1G" returned: 0 in 0.838s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1cd1dc1b-e339-4c48-af76-fc47c211fef5 tempest-VolumeDependencyTests-1321967090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a56282f-de69-4d61-835e-5ab241a6b719 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a56282f-de69-4d61-835e-5ab241a6b719.657b870a-b2d6-4d4a-b36d-233151045e40 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:59 devstack sudo[104259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a56282f-de69-4d61-835e-5ab241a6b719 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a56282f-de69-4d61-835e-5ab241a6b719.657b870a-b2d6-4d4a-b36d-233151045e40 Jul 08 18:56:59 devstack sudo[104259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:00 devstack sudo[104259]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1cd1dc1b-e339-4c48-af76-fc47c211fef5 tempest-VolumeDependencyTests-1321967090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a56282f-de69-4d61-835e-5ab241a6b719 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a56282f-de69-4d61-835e-5ab241a6b719.657b870a-b2d6-4d4a-b36d-233151045e40" returned: 0 in 0.686s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:00 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-1cd1dc1b-e339-4c48-af76-fc47c211fef5 tempest-VolumeDependencyTests-1321967090 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a56282f-de69-4d61-835e-5ab241a6b719.657b870a-b2d6-4d4a-b36d-233151045e40 is being set with open permissions: ugo+rw Jul 08 18:57:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1cd1dc1b-e339-4c48-af76-fc47c211fef5 tempest-VolumeDependencyTests-1321967090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a56282f-de69-4d61-835e-5ab241a6b719.657b870a-b2d6-4d4a-b36d-233151045e40 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:00 devstack sudo[104265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a56282f-de69-4d61-835e-5ab241a6b719.657b870a-b2d6-4d4a-b36d-233151045e40 Jul 08 18:57:00 devstack sudo[104265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:00 devstack sudo[104265]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1cd1dc1b-e339-4c48-af76-fc47c211fef5 tempest-VolumeDependencyTests-1321967090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a56282f-de69-4d61-835e-5ab241a6b719.657b870a-b2d6-4d4a-b36d-233151045e40" returned: 0 in 0.704s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1cd1dc1b-e339-4c48-af76-fc47c211fef5 tempest-VolumeDependencyTests-1321967090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a56282f-de69-4d61-835e-5ab241a6b719.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:00 devstack sudo[104268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a56282f-de69-4d61-835e-5ab241a6b719.info Jul 08 18:57:00 devstack sudo[104268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:01 devstack sudo[104268]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1cd1dc1b-e339-4c48-af76-fc47c211fef5 tempest-VolumeDependencyTests-1321967090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a56282f-de69-4d61-835e-5ab241a6b719.info" returned: 0 in 0.706s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:01 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-1cd1dc1b-e339-4c48-af76-fc47c211fef5 tempest-VolumeDependencyTests-1321967090 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a56282f-de69-4d61-835e-5ab241a6b719.info is being set with open permissions: ugo+rw Jul 08 18:57:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1cd1dc1b-e339-4c48-af76-fc47c211fef5 tempest-VolumeDependencyTests-1321967090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a56282f-de69-4d61-835e-5ab241a6b719.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:01 devstack sudo[104271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a56282f-de69-4d61-835e-5ab241a6b719.info Jul 08 18:57:01 devstack sudo[104271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:02 devstack sudo[104271]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1cd1dc1b-e339-4c48-af76-fc47c211fef5 tempest-VolumeDependencyTests-1321967090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a56282f-de69-4d61-835e-5ab241a6b719.info" returned: 0 in 0.702s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1cd1dc1b-e339-4c48-af76-fc47c211fef5 tempest-VolumeDependencyTests-1321967090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.547s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c12949f1-4986-4c73-ad27-25f30cf0546c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.095s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:02 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c12949f1-4986-4c73-ad27-25f30cf0546c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:56:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-951799837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0afee2b-8bc5-4230-8a4f-f195ff5595cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3aca0457f0147b3b2e27e7496ca53f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:56:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:56:48Z,use_quota=True,user_id='f5888002e3ec40d6aa0a642c11d86688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:57:02 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-c12949f1-4986-4c73-ad27-25f30cf0546c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Creating volume c0afee2b-8bc5-4230-8a4f-f195ff5595cd {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:57:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c12949f1-4986-4c73-ad27-25f30cf0546c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c12949f1-4986-4c73-ad27-25f30cf0546c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:02 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c12949f1-4986-4c73-ad27-25f30cf0546c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:02 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c12949f1-4986-4c73-ad27-25f30cf0546c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c12949f1-4986-4c73-ad27-25f30cf0546c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:02 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c12949f1-4986-4c73-ad27-25f30cf0546c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:57:02 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-c12949f1-4986-4c73-ad27-25f30cf0546c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:57:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c12949f1-4986-4c73-ad27-25f30cf0546c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c0afee2b-8bc5-4230-8a4f-f195ff5595cd 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:02 devstack sudo[104274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c0afee2b-8bc5-4230-8a4f-f195ff5595cd 1073741824 Jul 08 18:57:02 devstack sudo[104274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:02 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-1cd1dc1b-e339-4c48-af76-fc47c211fef5 tempest-VolumeDependencyTests-1321967090 None] Create snapshot completed successfully Jul 08 18:57:03 devstack sudo[104274]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c12949f1-4986-4c73-ad27-25f30cf0546c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c0afee2b-8bc5-4230-8a4f-f195ff5595cd 1073741824" returned: 0 in 0.888s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c12949f1-4986-4c73-ad27-25f30cf0546c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c0afee2b-8bc5-4230-8a4f-f195ff5595cd {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:03 devstack sudo[104283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c0afee2b-8bc5-4230-8a4f-f195ff5595cd Jul 08 18:57:03 devstack sudo[104283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:03 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1586f5e-6035-4ac6-929f-bfedd4580e4d tempest-VolumeDependencyTests-1321967090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:57:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f1586f5e-6035-4ac6-929f-bfedd4580e4d tempest-VolumeDependencyTests-1321967090 None] Flow 'volume_create_manager' (4e56d1dc-7fe9-4e21-9949-45cbc8b6d9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:57:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f1586f5e-6035-4ac6-929f-bfedd4580e4d tempest-VolumeDependencyTests-1321967090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdedafb3-431c-467a-a09f-b386e39e68aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:03 devstack sudo[104283]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c12949f1-4986-4c73-ad27-25f30cf0546c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c0afee2b-8bc5-4230-8a4f-f195ff5595cd" returned: 0 in 0.764s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:03 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c12949f1-4986-4c73-ad27-25f30cf0546c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] <== create_volume: return (1691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:57:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c12949f1-4986-4c73-ad27-25f30cf0546c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.693s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.222s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:03 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:56:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b528ac19-bc49-4309-a584-306d6b493cfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c104a13ac714249b976201d15b64a3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:56:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:56:45Z,use_quota=True,user_id='0296d00de27c4244ba8a78815d60196e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24b1c931-a4cd-4cab-ac5b-10c5fe3c6e92),volume_type_id=24b1c931-a4cd-4cab-ac5b-10c5fe3c6e92)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:57:03 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Creating volume b528ac19-bc49-4309-a584-306d6b493cfd {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:57:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:03 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:03 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:03 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:57:03 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:57:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b528ac19-bc49-4309-a584-306d6b493cfd 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f1586f5e-6035-4ac6-929f-bfedd4580e4d tempest-VolumeDependencyTests-1321967090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdedafb3-431c-467a-a09f-b386e39e68aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:57:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-319306858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7db732b1-cc7a-4238-a7a8-6650b389986c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0237aed5eaa4123992928b692fd72a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:57:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=657b870a-b2d6-4d4a-b36d-233151045e40,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:57:04Z,use_quota=True,user_id='57e9d98d65254aceaa9e001663533231',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f1586f5e-6035-4ac6-929f-bfedd4580e4d tempest-VolumeDependencyTests-1321967090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dc8c978-6692-4795-89e3-395fcfe16e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:03 devstack sudo[104286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b528ac19-bc49-4309-a584-306d6b493cfd 1073741824 Jul 08 18:57:03 devstack sudo[104286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f1586f5e-6035-4ac6-929f-bfedd4580e4d tempest-VolumeDependencyTests-1321967090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dc8c978-6692-4795-89e3-395fcfe16e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f1586f5e-6035-4ac6-929f-bfedd4580e4d tempest-VolumeDependencyTests-1321967090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5a7f0b2-26e3-4123-b2ea-e2cab8cd6665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f1586f5e-6035-4ac6-929f-bfedd4580e4d tempest-VolumeDependencyTests-1321967090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5a7f0b2-26e3-4123-b2ea-e2cab8cd6665) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7db732b1-cc7a-4238-a7a8-6650b389986c', 'volume_name': 'volume-7db732b1-cc7a-4238-a7a8-6650b389986c', 'volume_size': 1, 'snapshot_id': '657b870a-b2d6-4d4a-b36d-233151045e40'}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f1586f5e-6035-4ac6-929f-bfedd4580e4d tempest-VolumeDependencyTests-1321967090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38143b18-d9e4-4e2c-807e-265517b7d6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f1586f5e-6035-4ac6-929f-bfedd4580e4d tempest-VolumeDependencyTests-1321967090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38143b18-d9e4-4e2c-807e-265517b7d6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f1586f5e-6035-4ac6-929f-bfedd4580e4d tempest-VolumeDependencyTests-1321967090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3309604-32b2-447f-b6f1-de0221f4ddb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:03 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-f1586f5e-6035-4ac6-929f-bfedd4580e4d tempest-VolumeDependencyTests-1321967090 None] Volume 7db732b1-cc7a-4238-a7a8-6650b389986c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7db732b1-cc7a-4238-a7a8-6650b389986c', 'volume_size': 1, 'snapshot_id': '657b870a-b2d6-4d4a-b36d-233151045e40'} Jul 08 18:57:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f1586f5e-6035-4ac6-929f-bfedd4580e4d tempest-VolumeDependencyTests-1321967090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c12949f1-4986-4c73-ad27-25f30cf0546c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c1eea0b-b63a-465d-b402-942d2da4a297) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0afee2b-8bc5-4230-8a4f-f195ff5595cd', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c12949f1-4986-4c73-ad27-25f30cf0546c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9f92aa4-deeb-44d3-9a7a-7fd3fca544d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:04 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-c12949f1-4986-4c73-ad27-25f30cf0546c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Volume volume-c0afee2b-8bc5-4230-8a4f-f195ff5595cd (c0afee2b-8bc5-4230-8a4f-f195ff5595cd): created successfully Jul 08 18:57:04 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c12949f1-4986-4c73-ad27-25f30cf0546c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9f92aa4-deeb-44d3-9a7a-7fd3fca544d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:04 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c12949f1-4986-4c73-ad27-25f30cf0546c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Flow 'volume_create_manager' (8bfbddb9-bf23-48fe-b3e4-474251018315) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:57:04 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-c12949f1-4986-4c73-ad27-25f30cf0546c tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Created volume successfully. Jul 08 18:57:04 devstack sudo[104286]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b528ac19-bc49-4309-a584-306d6b493cfd 1073741824" returned: 0 in 0.861s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b528ac19-bc49-4309-a584-306d6b493cfd {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:04 devstack sudo[104291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b528ac19-bc49-4309-a584-306d6b493cfd Jul 08 18:57:04 devstack sudo[104291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:05 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-197746bd-29c3-44c5-81b0-5f53ff142772 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Acquiring lock "cinder-c0afee2b-8bc5-4230-8a4f-f195ff5595cd-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:05 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-197746bd-29c3-44c5-81b0-5f53ff142772 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Lock "cinder-c0afee2b-8bc5-4230-8a4f-f195ff5595cd-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:05 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-197746bd-29c3-44c5-81b0-5f53ff142772 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Acquiring lock "cinder-quobyte-c0afee2b-8bc5-4230-8a4f-f195ff5595cd" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:05 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-197746bd-29c3-44c5-81b0-5f53ff142772 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Lock "cinder-quobyte-c0afee2b-8bc5-4230-8a4f-f195ff5595cd" acquired by "delete_volume" :: waited 0.020s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:05 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[db078d00-fc53-4478-bf95-611bcba6e3c3]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-197746bd-29c3-44c5-81b0-5f53ff142772 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c0afee2b-8bc5-4230-8a4f-f195ff5595cd {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:05 devstack sudo[104293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c0afee2b-8bc5-4230-8a4f-f195ff5595cd Jul 08 18:57:05 devstack sudo[104293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:05 devstack sudo[104291]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b528ac19-bc49-4309-a584-306d6b493cfd" returned: 0 in 0.680s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:05 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] <== create_volume: return (1580ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:57:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.584s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-9f103202-46b8-47ed-b2e8-7a12bf05be63 tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.861s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:05 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-9f103202-46b8-47ed-b2e8-7a12bf05be63 tempest-CreateVolumesFromSnapshotTest-202843157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:56:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1095459663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf841f53-ae69-415b-a18a-8613b270e125,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f58dd594e6704f04aa670507ae860614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:56:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:56:52Z,use_quota=True,user_id='18dfc796e05642b8bcaf789a3d9f411c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:57:05 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-9f103202-46b8-47ed-b2e8-7a12bf05be63 tempest-CreateVolumesFromSnapshotTest-202843157 None] Creating volume cf841f53-ae69-415b-a18a-8613b270e125 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:57:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-9f103202-46b8-47ed-b2e8-7a12bf05be63 tempest-CreateVolumesFromSnapshotTest-202843157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-9f103202-46b8-47ed-b2e8-7a12bf05be63 tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:05 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-9f103202-46b8-47ed-b2e8-7a12bf05be63 tempest-CreateVolumesFromSnapshotTest-202843157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:05 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-9f103202-46b8-47ed-b2e8-7a12bf05be63 tempest-CreateVolumesFromSnapshotTest-202843157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-9f103202-46b8-47ed-b2e8-7a12bf05be63 tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:05 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-9f103202-46b8-47ed-b2e8-7a12bf05be63 tempest-CreateVolumesFromSnapshotTest-202843157 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:57:05 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-9f103202-46b8-47ed-b2e8-7a12bf05be63 tempest-CreateVolumesFromSnapshotTest-202843157 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:57:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9f103202-46b8-47ed-b2e8-7a12bf05be63 tempest-CreateVolumesFromSnapshotTest-202843157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cf841f53-ae69-415b-a18a-8613b270e125 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:05 devstack sudo[104296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cf841f53-ae69-415b-a18a-8613b270e125 1073741824 Jul 08 18:57:05 devstack sudo[104296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:05 devstack cinder-volume[86873]: DEBUG cinder.volume.volume_utils [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Attempting download of c23945cd-25bb-4024-a63e-5851735ebb07 ((None, [{'url': 'file:///opt/stack/data/glance/images/c23945cd-25bb-4024-a63e-5851735ebb07', 'metadata': {}}])) to volume b528ac19-bc49-4309-a584-306d6b493cfd. {{(pid=86873) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 18:57:05 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[919f5ef2-882a-411b-a71f-e9bf2228f32c]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c23945cd-25bb-4024-a63e-5851735ebb07_m4oo7t7k {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:05 devstack sudo[104298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c23945cd-25bb-4024-a63e-5851735ebb07_m4oo7t7k Jul 08 18:57:05 devstack sudo[104298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:06 devstack sudo[104293]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-197746bd-29c3-44c5-81b0-5f53ff142772 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c0afee2b-8bc5-4230-8a4f-f195ff5595cd" returned: 0 in 0.889s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-197746bd-29c3-44c5-81b0-5f53ff142772 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c0afee2b-8bc5-4230-8a4f-f195ff5595cd {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:06 devstack sudo[104341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c0afee2b-8bc5-4230-8a4f-f195ff5595cd Jul 08 18:57:06 devstack sudo[104341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:06 devstack sudo[104296]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9f103202-46b8-47ed-b2e8-7a12bf05be63 tempest-CreateVolumesFromSnapshotTest-202843157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cf841f53-ae69-415b-a18a-8613b270e125 1073741824" returned: 0 in 0.957s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:06 devstack sudo[104298]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c23945cd-25bb-4024-a63e-5851735ebb07_m4oo7t7k" returned: 0 in 0.907s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c23945cd-25bb-4024-a63e-5851735ebb07_m4oo7t7k {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9f103202-46b8-47ed-b2e8-7a12bf05be63 tempest-CreateVolumesFromSnapshotTest-202843157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cf841f53-ae69-415b-a18a-8613b270e125 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:06 devstack sudo[104348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cf841f53-ae69-415b-a18a-8613b270e125 Jul 08 18:57:06 devstack sudo[104348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:06 devstack sudo[104347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c23945cd-25bb-4024-a63e-5851735ebb07_m4oo7t7k Jul 08 18:57:06 devstack sudo[104347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:06 devstack sudo[104341]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-197746bd-29c3-44c5-81b0-5f53ff142772 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c0afee2b-8bc5-4230-8a4f-f195ff5595cd" returned: 0 in 0.763s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:06 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-197746bd-29c3-44c5-81b0-5f53ff142772 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Lock "cinder-quobyte-c0afee2b-8bc5-4230-8a4f-f195ff5595cd" released by "delete_volume" :: held 1.699s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:07 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-197746bd-29c3-44c5-81b0-5f53ff142772 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Created reservations ['e105dff3-177e-4a36-9f6f-2f6acf6c6d07', '303db7ad-fe36-4dfb-b79f-8c5a3e06855b', 'd4fe0ab2-9eac-4034-a504-91f5fe5ad022', '30ba031a-beb9-4d10-8c1a-6409edffe9b7'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:57:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-197746bd-29c3-44c5-81b0-5f53ff142772 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-197746bd-29c3-44c5-81b0-5f53ff142772 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:07 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-197746bd-29c3-44c5-81b0-5f53ff142772 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:07 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-197746bd-29c3-44c5-81b0-5f53ff142772 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-197746bd-29c3-44c5-81b0-5f53ff142772 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-197746bd-29c3-44c5-81b0-5f53ff142772 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:07 devstack sudo[104352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:57:07 devstack sudo[104352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:07 devstack sudo[104348]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:07 devstack sudo[104347]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9f103202-46b8-47ed-b2e8-7a12bf05be63 tempest-CreateVolumesFromSnapshotTest-202843157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cf841f53-ae69-415b-a18a-8613b270e125" returned: 0 in 0.822s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:07 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-9f103202-46b8-47ed-b2e8-7a12bf05be63 tempest-CreateVolumesFromSnapshotTest-202843157 None] <== create_volume: return (1860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:57:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-9f103202-46b8-47ed-b2e8-7a12bf05be63 tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.864s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5e247b1f-6774-41d1-b34b-c83fafe81a31 tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.337s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:07 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-5e247b1f-6774-41d1-b34b-c83fafe81a31 tempest-CreateVolumesFromSnapshotTest-202843157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:56:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2080615850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96de88df-5d88-43da-8031-e1d1fc041d99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f58dd594e6704f04aa670507ae860614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:56:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:56:53Z,use_quota=True,user_id='18dfc796e05642b8bcaf789a3d9f411c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:57:07 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-5e247b1f-6774-41d1-b34b-c83fafe81a31 tempest-CreateVolumesFromSnapshotTest-202843157 None] Creating volume 96de88df-5d88-43da-8031-e1d1fc041d99 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:57:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5e247b1f-6774-41d1-b34b-c83fafe81a31 tempest-CreateVolumesFromSnapshotTest-202843157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5e247b1f-6774-41d1-b34b-c83fafe81a31 tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:07 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-5e247b1f-6774-41d1-b34b-c83fafe81a31 tempest-CreateVolumesFromSnapshotTest-202843157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:07 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-5e247b1f-6774-41d1-b34b-c83fafe81a31 tempest-CreateVolumesFromSnapshotTest-202843157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5e247b1f-6774-41d1-b34b-c83fafe81a31 tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:07 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-5e247b1f-6774-41d1-b34b-c83fafe81a31 tempest-CreateVolumesFromSnapshotTest-202843157 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:57:07 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-5e247b1f-6774-41d1-b34b-c83fafe81a31 tempest-CreateVolumesFromSnapshotTest-202843157 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:57:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5e247b1f-6774-41d1-b34b-c83fafe81a31 tempest-CreateVolumesFromSnapshotTest-202843157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-96de88df-5d88-43da-8031-e1d1fc041d99 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c23945cd-25bb-4024-a63e-5851735ebb07_m4oo7t7k" returned: 1 in 0.880s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c23945cd-25bb-4024-a63e-5851735ebb07_m4oo7t7k' failed. Not Retrying. {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:57:07 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[eded5b71-3330-442f-864d-2fff6913c572]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c23945cd-25bb-4024-a63e-5851735ebb07_kw10cd3kdevstack@QuobyteHD {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:07 devstack sudo[104357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-96de88df-5d88-43da-8031-e1d1fc041d99 1073741824 Jul 08 18:57:07 devstack sudo[104357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-9f103202-46b8-47ed-b2e8-7a12bf05be63 tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87a066f9-f7b5-47a7-a252-14f3623491bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf841f53-ae69-415b-a18a-8613b270e125', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-9f103202-46b8-47ed-b2e8-7a12bf05be63 tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae3b32b3-2273-4151-981d-6052c53115d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:07 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-9f103202-46b8-47ed-b2e8-7a12bf05be63 tempest-CreateVolumesFromSnapshotTest-202843157 None] Volume volume-cf841f53-ae69-415b-a18a-8613b270e125 (cf841f53-ae69-415b-a18a-8613b270e125): created successfully Jul 08 18:57:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-9f103202-46b8-47ed-b2e8-7a12bf05be63 tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae3b32b3-2273-4151-981d-6052c53115d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:07 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-9f103202-46b8-47ed-b2e8-7a12bf05be63 tempest-CreateVolumesFromSnapshotTest-202843157 None] Flow 'volume_create_manager' (969fb816-b51a-48cd-8688-92340b4fff76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:57:07 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-9f103202-46b8-47ed-b2e8-7a12bf05be63 tempest-CreateVolumesFromSnapshotTest-202843157 None] Created volume successfully. Jul 08 18:57:07 devstack sudo[104358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c23945cd-25bb-4024-a63e-5851735ebb07_kw10cd3kdevstack@QuobyteHD Jul 08 18:57:07 devstack sudo[104358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:07 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-2361574b-f24f-4f12-b657-1153a7c50058 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Acquiring lock "cinder-9b9e7f8d-33ec-4910-b982-df033166c604-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:07 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-2361574b-f24f-4f12-b657-1153a7c50058 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Lock "cinder-9b9e7f8d-33ec-4910-b982-df033166c604-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:07 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-2361574b-f24f-4f12-b657-1153a7c50058 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Acquiring lock "cinder-quobyte-9b9e7f8d-33ec-4910-b982-df033166c604" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:07 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-2361574b-f24f-4f12-b657-1153a7c50058 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Lock "cinder-quobyte-9b9e7f8d-33ec-4910-b982-df033166c604" acquired by "delete_volume" :: waited 0.017s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:07 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac04fcef-4739-4a19-bccd-6d6a143d1977]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2361574b-f24f-4f12-b657-1153a7c50058 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b9e7f8d-33ec-4910-b982-df033166c604 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:07 devstack sudo[104361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b9e7f8d-33ec-4910-b982-df033166c604 Jul 08 18:57:07 devstack sudo[104361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:08 devstack sudo[104352]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-197746bd-29c3-44c5-81b0-5f53ff142772 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 1.055s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:08 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-197746bd-29c3-44c5-81b0-5f53ff142772 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:57:08 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-197746bd-29c3-44c5-81b0-5f53ff142772 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Deleted volume successfully. Jul 08 18:57:08 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-197746bd-29c3-44c5-81b0-5f53ff142772 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Lock "cinder-c0afee2b-8bc5-4230-8a4f-f195ff5595cd-delete_volume" released by "delete_volume" :: held 3.031s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:08 devstack sudo[104357]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5e247b1f-6774-41d1-b34b-c83fafe81a31 tempest-CreateVolumesFromSnapshotTest-202843157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-96de88df-5d88-43da-8031-e1d1fc041d99 1073741824" returned: 0 in 1.038s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5e247b1f-6774-41d1-b34b-c83fafe81a31 tempest-CreateVolumesFromSnapshotTest-202843157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-96de88df-5d88-43da-8031-e1d1fc041d99 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:08 devstack sudo[104358]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c23945cd-25bb-4024-a63e-5851735ebb07_kw10cd3kdevstack@QuobyteHD" returned: 0 in 1.069s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c23945cd-25bb-4024-a63e-5851735ebb07_kw10cd3kdevstack@QuobyteHD {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:08 devstack sudo[104370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-96de88df-5d88-43da-8031-e1d1fc041d99 Jul 08 18:57:08 devstack sudo[104370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:08 devstack sudo[104371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c23945cd-25bb-4024-a63e-5851735ebb07_kw10cd3kdevstack@QuobyteHD Jul 08 18:57:08 devstack sudo[104371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:08 devstack sudo[104361]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2361574b-f24f-4f12-b657-1153a7c50058 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b9e7f8d-33ec-4910-b982-df033166c604" returned: 0 in 1.122s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2361574b-f24f-4f12-b657-1153a7c50058 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b9e7f8d-33ec-4910-b982-df033166c604 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:08 devstack sudo[104377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b9e7f8d-33ec-4910-b982-df033166c604 Jul 08 18:57:08 devstack sudo[104377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:09 devstack sudo[104370]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5e247b1f-6774-41d1-b34b-c83fafe81a31 tempest-CreateVolumesFromSnapshotTest-202843157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-96de88df-5d88-43da-8031-e1d1fc041d99" returned: 0 in 0.744s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:09 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-5e247b1f-6774-41d1-b34b-c83fafe81a31 tempest-CreateVolumesFromSnapshotTest-202843157 None] <== create_volume: return (1829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:57:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-5e247b1f-6774-41d1-b34b-c83fafe81a31 tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.832s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c7636492-9dd6-4767-a750-399f3ee5034b tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.741s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:09 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c7636492-9dd6-4767-a750-399f3ee5034b tempest-CreateVolumesFromSnapshotTest-202843157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:56:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2109202217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45cde405-e75c-48da-a2f8-cd6d5dd82eda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f58dd594e6704f04aa670507ae860614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:56:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:56:53Z,use_quota=True,user_id='18dfc796e05642b8bcaf789a3d9f411c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:57:09 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-c7636492-9dd6-4767-a750-399f3ee5034b tempest-CreateVolumesFromSnapshotTest-202843157 None] Creating volume 45cde405-e75c-48da-a2f8-cd6d5dd82eda {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:57:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c7636492-9dd6-4767-a750-399f3ee5034b tempest-CreateVolumesFromSnapshotTest-202843157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c7636492-9dd6-4767-a750-399f3ee5034b tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:09 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c7636492-9dd6-4767-a750-399f3ee5034b tempest-CreateVolumesFromSnapshotTest-202843157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:09 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c7636492-9dd6-4767-a750-399f3ee5034b tempest-CreateVolumesFromSnapshotTest-202843157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c7636492-9dd6-4767-a750-399f3ee5034b tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:09 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c7636492-9dd6-4767-a750-399f3ee5034b tempest-CreateVolumesFromSnapshotTest-202843157 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:57:09 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-c7636492-9dd6-4767-a750-399f3ee5034b tempest-CreateVolumesFromSnapshotTest-202843157 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:57:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c7636492-9dd6-4767-a750-399f3ee5034b tempest-CreateVolumesFromSnapshotTest-202843157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-45cde405-e75c-48da-a2f8-cd6d5dd82eda 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:09 devstack sudo[104383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-45cde405-e75c-48da-a2f8-cd6d5dd82eda 1073741824 Jul 08 18:57:09 devstack sudo[104383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:09 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5e247b1f-6774-41d1-b34b-c83fafe81a31 tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4afede2-b3b8-429f-a0c4-d8b1dacfe6d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96de88df-5d88-43da-8031-e1d1fc041d99', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:09 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5e247b1f-6774-41d1-b34b-c83fafe81a31 tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2442a5bc-f794-4ff0-8b95-f649bb4f9271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:09 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-5e247b1f-6774-41d1-b34b-c83fafe81a31 tempest-CreateVolumesFromSnapshotTest-202843157 None] Volume volume-96de88df-5d88-43da-8031-e1d1fc041d99 (96de88df-5d88-43da-8031-e1d1fc041d99): created successfully Jul 08 18:57:09 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5e247b1f-6774-41d1-b34b-c83fafe81a31 tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2442a5bc-f794-4ff0-8b95-f649bb4f9271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:09 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-5e247b1f-6774-41d1-b34b-c83fafe81a31 tempest-CreateVolumesFromSnapshotTest-202843157 None] Flow 'volume_create_manager' (807bf166-c04d-4cf1-8775-297f719bf909) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:57:09 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-5e247b1f-6774-41d1-b34b-c83fafe81a31 tempest-CreateVolumesFromSnapshotTest-202843157 None] Created volume successfully. Jul 08 18:57:09 devstack sudo[104371]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c23945cd-25bb-4024-a63e-5851735ebb07_kw10cd3kdevstack@QuobyteHD" returned: 1 in 0.879s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c23945cd-25bb-4024-a63e-5851735ebb07_kw10cd3kdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:57:09 devstack cinder-volume[86873]: DEBUG cinder.image.image_utils [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] c23945cd-25bb-4024-a63e-5851735ebb07 was raw, converting to raw {{(pid=86873) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 18:57:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c23945cd-25bb-4024-a63e-5851735ebb07_kw10cd3kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b528ac19-bc49-4309-a584-306d6b493cfd {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:09 devstack sudo[104385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c23945cd-25bb-4024-a63e-5851735ebb07_kw10cd3kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b528ac19-bc49-4309-a584-306d6b493cfd Jul 08 18:57:09 devstack sudo[104385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:09 devstack sudo[104377]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2361574b-f24f-4f12-b657-1153a7c50058 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9b9e7f8d-33ec-4910-b982-df033166c604" returned: 0 in 0.692s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:09 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-2361574b-f24f-4f12-b657-1153a7c50058 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Lock "cinder-quobyte-9b9e7f8d-33ec-4910-b982-df033166c604" released by "delete_volume" :: held 1.861s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:09 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-2361574b-f24f-4f12-b657-1153a7c50058 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Created reservations ['0400a98d-b7b6-4767-9926-dcdd58076596', '78abf79d-0f6c-474c-9ee4-685c320bbacb', '900b3e2f-db22-44da-a742-f0e4ada836a7', '41b35308-3bb4-4b5f-9fcb-c64df1efde2e'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:57:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-2361574b-f24f-4f12-b657-1153a7c50058 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-2361574b-f24f-4f12-b657-1153a7c50058 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:09 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-2361574b-f24f-4f12-b657-1153a7c50058 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:09 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-2361574b-f24f-4f12-b657-1153a7c50058 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-2361574b-f24f-4f12-b657-1153a7c50058 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2361574b-f24f-4f12-b657-1153a7c50058 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:09 devstack sudo[104388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:57:09 devstack sudo[104388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:09 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-e8731489-3ad8-4903-8baa-c9e208c55201 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Acquiring lock "cinder-114bae0e-e140-415b-a016-b81f1250e216-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:09 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-e8731489-3ad8-4903-8baa-c9e208c55201 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Lock "cinder-114bae0e-e140-415b-a016-b81f1250e216-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:09 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-e8731489-3ad8-4903-8baa-c9e208c55201 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Acquiring lock "cinder-quobyte-114bae0e-e140-415b-a016-b81f1250e216" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:09 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-e8731489-3ad8-4903-8baa-c9e208c55201 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Lock "cinder-quobyte-114bae0e-e140-415b-a016-b81f1250e216" acquired by "delete_volume" :: waited 0.023s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:09 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd73f4b-9e89-42c5-a4c8-74db061c64fb]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e8731489-3ad8-4903-8baa-c9e208c55201 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-114bae0e-e140-415b-a016-b81f1250e216 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:10 devstack sudo[104395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-114bae0e-e140-415b-a016-b81f1250e216 Jul 08 18:57:10 devstack sudo[104395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:10 devstack sudo[104385]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c23945cd-25bb-4024-a63e-5851735ebb07_kw10cd3kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b528ac19-bc49-4309-a584-306d6b493cfd" returned: 0 in 0.829s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:10 devstack cinder-volume[86873]: DEBUG cinder.image.image_utils [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c23945cd-25bb-4024-a63e-5851735ebb07_kw10cd3kdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b528ac19-bc49-4309-a584-306d6b493cfd {{(pid=86873) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:57:10 devstack cinder-volume[86873]: INFO cinder.image.image_utils [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 18:57:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b528ac19-bc49-4309-a584-306d6b493cfd 1G {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:10 devstack sudo[104383]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c7636492-9dd6-4767-a750-399f3ee5034b tempest-CreateVolumesFromSnapshotTest-202843157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-45cde405-e75c-48da-a2f8-cd6d5dd82eda 1073741824" returned: 0 in 0.999s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:10 devstack sudo[104398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b528ac19-bc49-4309-a584-306d6b493cfd 1G Jul 08 18:57:10 devstack sudo[104398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c7636492-9dd6-4767-a750-399f3ee5034b tempest-CreateVolumesFromSnapshotTest-202843157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-45cde405-e75c-48da-a2f8-cd6d5dd82eda {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:10 devstack sudo[104400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-45cde405-e75c-48da-a2f8-cd6d5dd82eda Jul 08 18:57:10 devstack sudo[104400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:10 devstack sudo[104388]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2361574b-f24f-4f12-b657-1153a7c50058 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.859s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:10 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-2361574b-f24f-4f12-b657-1153a7c50058 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:57:10 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-2361574b-f24f-4f12-b657-1153a7c50058 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Deleted volume successfully. Jul 08 18:57:10 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-2361574b-f24f-4f12-b657-1153a7c50058 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Lock "cinder-9b9e7f8d-33ec-4910-b982-df033166c604-delete_volume" released by "delete_volume" :: held 2.946s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:10 devstack sudo[104395]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e8731489-3ad8-4903-8baa-c9e208c55201 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-114bae0e-e140-415b-a016-b81f1250e216" returned: 0 in 1.007s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e8731489-3ad8-4903-8baa-c9e208c55201 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-114bae0e-e140-415b-a016-b81f1250e216 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:10 devstack sudo[104400]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c7636492-9dd6-4767-a750-399f3ee5034b tempest-CreateVolumesFromSnapshotTest-202843157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-45cde405-e75c-48da-a2f8-cd6d5dd82eda" returned: 0 in 0.723s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:10 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c7636492-9dd6-4767-a750-399f3ee5034b tempest-CreateVolumesFromSnapshotTest-202843157 None] <== create_volume: return (1799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:57:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c7636492-9dd6-4767-a750-399f3ee5034b tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.802s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:10 devstack sudo[104398]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-a575d788-26fb-466f-ab91-daf2b44e148d tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.179s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:11 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-a575d788-26fb-466f-ab91-daf2b44e148d tempest-CreateVolumesFromSnapshotTest-202843157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:56:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1543987227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=402ff7f6-b067-4adb-84f3-57c7475fa870,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f58dd594e6704f04aa670507ae860614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:56:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:56:54Z,use_quota=True,user_id='18dfc796e05642b8bcaf789a3d9f411c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:57:11 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-a575d788-26fb-466f-ab91-daf2b44e148d tempest-CreateVolumesFromSnapshotTest-202843157 None] Creating volume 402ff7f6-b067-4adb-84f3-57c7475fa870 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:57:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-a575d788-26fb-466f-ab91-daf2b44e148d tempest-CreateVolumesFromSnapshotTest-202843157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-a575d788-26fb-466f-ab91-daf2b44e148d tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:11 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-a575d788-26fb-466f-ab91-daf2b44e148d tempest-CreateVolumesFromSnapshotTest-202843157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:11 devstack sudo[104410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-114bae0e-e140-415b-a016-b81f1250e216 Jul 08 18:57:11 devstack sudo[104410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:11 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-a575d788-26fb-466f-ab91-daf2b44e148d tempest-CreateVolumesFromSnapshotTest-202843157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-a575d788-26fb-466f-ab91-daf2b44e148d tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:11 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-a575d788-26fb-466f-ab91-daf2b44e148d tempest-CreateVolumesFromSnapshotTest-202843157 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:57:11 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-a575d788-26fb-466f-ab91-daf2b44e148d tempest-CreateVolumesFromSnapshotTest-202843157 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:57:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-a575d788-26fb-466f-ab91-daf2b44e148d tempest-CreateVolumesFromSnapshotTest-202843157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-402ff7f6-b067-4adb-84f3-57c7475fa870 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b528ac19-bc49-4309-a584-306d6b493cfd 1G" returned: 0 in 0.844s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:11 devstack sudo[104412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-402ff7f6-b067-4adb-84f3-57c7475fa870 1073741824 Jul 08 18:57:11 devstack sudo[104412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:11 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c7636492-9dd6-4767-a750-399f3ee5034b tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (438f9421-e255-47a9-89b3-0b8ac652c6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45cde405-e75c-48da-a2f8-cd6d5dd82eda', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:11 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c7636492-9dd6-4767-a750-399f3ee5034b tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5ccae2c-da66-436c-8713-b1f9e289970e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:11 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-c7636492-9dd6-4767-a750-399f3ee5034b tempest-CreateVolumesFromSnapshotTest-202843157 None] Volume volume-45cde405-e75c-48da-a2f8-cd6d5dd82eda (45cde405-e75c-48da-a2f8-cd6d5dd82eda): created successfully Jul 08 18:57:11 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c7636492-9dd6-4767-a750-399f3ee5034b tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5ccae2c-da66-436c-8713-b1f9e289970e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:11 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c7636492-9dd6-4767-a750-399f3ee5034b tempest-CreateVolumesFromSnapshotTest-202843157 None] Flow 'volume_create_manager' (6570f1de-26e4-4e99-8cff-d7a756651f24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:57:11 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d3eada-6534-4f5b-9d6f-1c53fe093ca7]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b528ac19-bc49-4309-a584-306d6b493cfd {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:11 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-c7636492-9dd6-4767-a750-399f3ee5034b tempest-CreateVolumesFromSnapshotTest-202843157 None] Created volume successfully. Jul 08 18:57:11 devstack sudo[104414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b528ac19-bc49-4309-a584-306d6b493cfd Jul 08 18:57:11 devstack sudo[104414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:11 devstack sudo[104410]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e8731489-3ad8-4903-8baa-c9e208c55201 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-114bae0e-e140-415b-a016-b81f1250e216" returned: 0 in 0.762s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:11 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-e8731489-3ad8-4903-8baa-c9e208c55201 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Lock "cinder-quobyte-114bae0e-e140-415b-a016-b81f1250e216" released by "delete_volume" :: held 1.816s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:11 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-e8731489-3ad8-4903-8baa-c9e208c55201 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Created reservations ['73b36e80-1384-4248-9dcf-fd2e3e54398a', 'f6fa0645-e4b8-4edc-a654-883ca573d995', 'dd804fb4-bfdc-4f3a-b4d9-3913d4d6581b', '5181fde5-2969-4096-ae6b-37d30dc710f5'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:57:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-e8731489-3ad8-4903-8baa-c9e208c55201 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-e8731489-3ad8-4903-8baa-c9e208c55201 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:11 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-e8731489-3ad8-4903-8baa-c9e208c55201 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:11 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-e8731489-3ad8-4903-8baa-c9e208c55201 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-e8731489-3ad8-4903-8baa-c9e208c55201 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e8731489-3ad8-4903-8baa-c9e208c55201 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:11 devstack sudo[104412]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:11 devstack sudo[104423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:57:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-a575d788-26fb-466f-ab91-daf2b44e148d tempest-CreateVolumesFromSnapshotTest-202843157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-402ff7f6-b067-4adb-84f3-57c7475fa870 1073741824" returned: 0 in 0.909s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:11 devstack sudo[104423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:11 devstack sudo[104414]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b528ac19-bc49-4309-a584-306d6b493cfd" returned: 0 in 0.864s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b528ac19-bc49-4309-a584-306d6b493cfd {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-a575d788-26fb-466f-ab91-daf2b44e148d tempest-CreateVolumesFromSnapshotTest-202843157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-402ff7f6-b067-4adb-84f3-57c7475fa870 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:12 devstack sudo[104426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-402ff7f6-b067-4adb-84f3-57c7475fa870 Jul 08 18:57:12 devstack sudo[104426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:12 devstack sudo[104425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b528ac19-bc49-4309-a584-306d6b493cfd Jul 08 18:57:12 devstack sudo[104425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:12 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-36be357c-9697-42d4-ac8c-c3933f000ab3 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Acquiring lock "cinder-76a0405e-2021-470b-924e-eced5b1b70d3-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:12 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-36be357c-9697-42d4-ac8c-c3933f000ab3 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Lock "cinder-76a0405e-2021-470b-924e-eced5b1b70d3-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:12 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-36be357c-9697-42d4-ac8c-c3933f000ab3 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Acquiring lock "cinder-quobyte-76a0405e-2021-470b-924e-eced5b1b70d3" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:12 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-36be357c-9697-42d4-ac8c-c3933f000ab3 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Lock "cinder-quobyte-76a0405e-2021-470b-924e-eced5b1b70d3" acquired by "delete_volume" :: waited 0.016s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:12 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8a66d9-33a9-492b-b2b1-1d52d3673af7]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-36be357c-9697-42d4-ac8c-c3933f000ab3 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-76a0405e-2021-470b-924e-eced5b1b70d3 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:12 devstack sudo[104429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-76a0405e-2021-470b-924e-eced5b1b70d3 Jul 08 18:57:12 devstack sudo[104429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:12 devstack sudo[104423]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e8731489-3ad8-4903-8baa-c9e208c55201 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.848s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:12 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-e8731489-3ad8-4903-8baa-c9e208c55201 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:57:12 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-e8731489-3ad8-4903-8baa-c9e208c55201 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Deleted volume successfully. Jul 08 18:57:12 devstack sudo[104425]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b528ac19-bc49-4309-a584-306d6b493cfd" returned: 1 in 0.810s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b528ac19-bc49-4309-a584-306d6b493cfd' failed. Not Retrying. {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:57:12 devstack cinder-volume[86873]: DEBUG cinder.volume.volume_utils [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Downloaded image c23945cd-25bb-4024-a63e-5851735ebb07 ((None, [{'url': 'file:///opt/stack/data/glance/images/c23945cd-25bb-4024-a63e-5851735ebb07', 'metadata': {}}])) to volume b528ac19-bc49-4309-a584-306d6b493cfd successfully. {{(pid=86873) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 18:57:12 devstack cinder-volume[86873]: DEBUG cinder.image.image_utils [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Temporary image c23945cd-25bb-4024-a63e-5851735ebb07 for user 0296d00de27c4244ba8a78815d60196e is deleted. {{(pid=86873) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 18:57:12 devstack cinder-volume[86873]: DEBUG cinder.volume.volume_utils [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Marking volume b528ac19-bc49-4309-a584-306d6b493cfd as bootable. {{(pid=86873) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 18:57:12 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Copying metadata from image c23945cd-25bb-4024-a63e-5851735ebb07 to b528ac19-bc49-4309-a584-306d6b493cfd. {{(pid=86873) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 18:57:12 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Creating volume glance metadata for volume b528ac19-bc49-4309-a584-306d6b493cfd backed by image c23945cd-25bb-4024-a63e-5851735ebb07 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'c23945cd-25bb-4024-a63e-5851735ebb07', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '29b52e6f70284dd74ae305133623fc27', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86873) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 18:57:12 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-e8731489-3ad8-4903-8baa-c9e208c55201 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Lock "cinder-114bae0e-e140-415b-a016-b81f1250e216-delete_volume" released by "delete_volume" :: held 2.925s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:12 devstack sudo[104426]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-a575d788-26fb-466f-ab91-daf2b44e148d tempest-CreateVolumesFromSnapshotTest-202843157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-402ff7f6-b067-4adb-84f3-57c7475fa870" returned: 0 in 0.845s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:12 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-a575d788-26fb-466f-ab91-daf2b44e148d tempest-CreateVolumesFromSnapshotTest-202843157 None] <== create_volume: return (1808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:57:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-a575d788-26fb-466f-ab91-daf2b44e148d tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.810s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-51acaa72-caf4-4d15-8911-582266fb01d8 tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.634s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:12 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-51acaa72-caf4-4d15-8911-582266fb01d8 tempest-CreateVolumesFromSnapshotTest-202843157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:56:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-490706073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f53733c7-17d8-4e99-9ff5-a19226eecb33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f58dd594e6704f04aa670507ae860614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:56:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:56:54Z,use_quota=True,user_id='18dfc796e05642b8bcaf789a3d9f411c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:57:12 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-51acaa72-caf4-4d15-8911-582266fb01d8 tempest-CreateVolumesFromSnapshotTest-202843157 None] Creating volume f53733c7-17d8-4e99-9ff5-a19226eecb33 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:57:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-51acaa72-caf4-4d15-8911-582266fb01d8 tempest-CreateVolumesFromSnapshotTest-202843157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-51acaa72-caf4-4d15-8911-582266fb01d8 tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:12 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-51acaa72-caf4-4d15-8911-582266fb01d8 tempest-CreateVolumesFromSnapshotTest-202843157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:12 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-51acaa72-caf4-4d15-8911-582266fb01d8 tempest-CreateVolumesFromSnapshotTest-202843157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-51acaa72-caf4-4d15-8911-582266fb01d8 tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:12 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-51acaa72-caf4-4d15-8911-582266fb01d8 tempest-CreateVolumesFromSnapshotTest-202843157 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:57:12 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-51acaa72-caf4-4d15-8911-582266fb01d8 tempest-CreateVolumesFromSnapshotTest-202843157 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:57:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-51acaa72-caf4-4d15-8911-582266fb01d8 tempest-CreateVolumesFromSnapshotTest-202843157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f53733c7-17d8-4e99-9ff5-a19226eecb33 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:12 devstack sudo[104437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f53733c7-17d8-4e99-9ff5-a19226eecb33 1073741824 Jul 08 18:57:12 devstack sudo[104437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:12 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-a575d788-26fb-466f-ab91-daf2b44e148d tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b79a56b-f383-4fe4-b04d-d0717e5dd692) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-402ff7f6-b067-4adb-84f3-57c7475fa870', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:12 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-a575d788-26fb-466f-ab91-daf2b44e148d tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab0af539-b888-497e-93fb-c08f10af8d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:12 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-a575d788-26fb-466f-ab91-daf2b44e148d tempest-CreateVolumesFromSnapshotTest-202843157 None] Volume volume-402ff7f6-b067-4adb-84f3-57c7475fa870 (402ff7f6-b067-4adb-84f3-57c7475fa870): created successfully Jul 08 18:57:12 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-a575d788-26fb-466f-ab91-daf2b44e148d tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab0af539-b888-497e-93fb-c08f10af8d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:12 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-a575d788-26fb-466f-ab91-daf2b44e148d tempest-CreateVolumesFromSnapshotTest-202843157 None] Flow 'volume_create_manager' (a1017761-ac70-4354-bb4f-5a5419950fe6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:57:12 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-a575d788-26fb-466f-ab91-daf2b44e148d tempest-CreateVolumesFromSnapshotTest-202843157 None] Created volume successfully. Jul 08 18:57:12 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b2823e6-71f8-49b8-8e7b-dde2b3fef3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b528ac19-bc49-4309-a584-306d6b493cfd', 'volume_size': 1, 'image_id': 'c23945cd-25bb-4024-a63e-5851735ebb07', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c23945cd-25bb-4024-a63e-5851735ebb07', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '29b52e6f70284dd74ae305133623fc27', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0c104a13ac714249b976201d15b64a3e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '486f52a98e846c5f520199f659b80c9e8d22f8cf917fc13c9033865b18df87c833d39ce546caa6163ea3f33a6b9164fa2f8e92a1a8890c18c28723ba49e7f26a', 'id': 'c23945cd-25bb-4024-a63e-5851735ebb07', 'created_at': datetime.datetime(2026, 7, 8, 16, 56, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 56, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c23945cd-25bb-4024-a63e-5851735ebb07/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:12 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31cfc7da-332d-4007-b7e7-70dbd2ab8f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:12 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Volume volume-b528ac19-bc49-4309-a584-306d6b493cfd (b528ac19-bc49-4309-a584-306d6b493cfd): created successfully Jul 08 18:57:12 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31cfc7da-332d-4007-b7e7-70dbd2ab8f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:12 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Flow 'volume_create_manager' (222d970b-5b4e-47d4-a9f1-1b58367baa52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:57:12 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-1686c5f0-1aee-4bb3-bdc2-01e2352fa39e tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Created volume successfully. Jul 08 18:57:13 devstack sudo[104429]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-36be357c-9697-42d4-ac8c-c3933f000ab3 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-76a0405e-2021-470b-924e-eced5b1b70d3" returned: 0 in 0.923s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-36be357c-9697-42d4-ac8c-c3933f000ab3 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-76a0405e-2021-470b-924e-eced5b1b70d3 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:13 devstack sudo[104442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-76a0405e-2021-470b-924e-eced5b1b70d3 Jul 08 18:57:13 devstack sudo[104442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:13 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-eb91f919-3651-4f8b-a36e-9b80e113c826 tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Acquiring lock "cinder-b528ac19-bc49-4309-a584-306d6b493cfd-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:13 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-eb91f919-3651-4f8b-a36e-9b80e113c826 tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Lock "cinder-b528ac19-bc49-4309-a584-306d6b493cfd-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:13 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-eb91f919-3651-4f8b-a36e-9b80e113c826 tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Acquiring lock "cinder-quobyte-b528ac19-bc49-4309-a584-306d6b493cfd" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:13 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-eb91f919-3651-4f8b-a36e-9b80e113c826 tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Lock "cinder-quobyte-b528ac19-bc49-4309-a584-306d6b493cfd" acquired by "delete_volume" :: waited 0.016s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:13 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1962d2c-2e9f-4a1a-800d-ef02178595f9]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-eb91f919-3651-4f8b-a36e-9b80e113c826 tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b528ac19-bc49-4309-a584-306d6b493cfd {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:13 devstack sudo[104437]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-51acaa72-caf4-4d15-8911-582266fb01d8 tempest-CreateVolumesFromSnapshotTest-202843157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f53733c7-17d8-4e99-9ff5-a19226eecb33 1073741824" returned: 0 in 1.021s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-51acaa72-caf4-4d15-8911-582266fb01d8 tempest-CreateVolumesFromSnapshotTest-202843157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f53733c7-17d8-4e99-9ff5-a19226eecb33 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:13 devstack sudo[104450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f53733c7-17d8-4e99-9ff5-a19226eecb33 Jul 08 18:57:13 devstack sudo[104450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:13 devstack sudo[104442]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-36be357c-9697-42d4-ac8c-c3933f000ab3 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-76a0405e-2021-470b-924e-eced5b1b70d3" returned: 0 in 0.761s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:13 devstack sudo[104449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b528ac19-bc49-4309-a584-306d6b493cfd Jul 08 18:57:13 devstack sudo[104449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:13 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-36be357c-9697-42d4-ac8c-c3933f000ab3 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Lock "cinder-quobyte-76a0405e-2021-470b-924e-eced5b1b70d3" released by "delete_volume" :: held 1.736s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:14 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-36be357c-9697-42d4-ac8c-c3933f000ab3 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Created reservations ['adc1e023-1be3-4078-a171-1a5d912d337a', 'e54c5077-b6db-48ce-a66c-f0deb3f54f5e', '64069959-35cf-494d-b675-2c203ecd347a', '89d62bf7-1583-4fb7-9b93-8f24b0124e4c'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:57:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-36be357c-9697-42d4-ac8c-c3933f000ab3 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-36be357c-9697-42d4-ac8c-c3933f000ab3 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:14 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-36be357c-9697-42d4-ac8c-c3933f000ab3 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:14 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-36be357c-9697-42d4-ac8c-c3933f000ab3 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-36be357c-9697-42d4-ac8c-c3933f000ab3 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-36be357c-9697-42d4-ac8c-c3933f000ab3 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:14 devstack sudo[104453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:57:14 devstack sudo[104453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:14 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-1b9f4bf1-d1b5-4bf1-933a-8e890b8ca883 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Acquiring lock "cinder-d4db6527-86b6-4764-bdc2-c350190d739a-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:14 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-1b9f4bf1-d1b5-4bf1-933a-8e890b8ca883 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Lock "cinder-d4db6527-86b6-4764-bdc2-c350190d739a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:14 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-1b9f4bf1-d1b5-4bf1-933a-8e890b8ca883 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Acquiring lock "cinder-quobyte-d4db6527-86b6-4764-bdc2-c350190d739a" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:14 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-1b9f4bf1-d1b5-4bf1-933a-8e890b8ca883 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Lock "cinder-quobyte-d4db6527-86b6-4764-bdc2-c350190d739a" acquired by "delete_volume" :: waited 0.018s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:14 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e63955-8a48-4257-964c-4c66fe687165]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1b9f4bf1-d1b5-4bf1-933a-8e890b8ca883 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4db6527-86b6-4764-bdc2-c350190d739a {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:14 devstack sudo[104458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4db6527-86b6-4764-bdc2-c350190d739a Jul 08 18:57:14 devstack sudo[104458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:14 devstack sudo[104450]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-51acaa72-caf4-4d15-8911-582266fb01d8 tempest-CreateVolumesFromSnapshotTest-202843157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f53733c7-17d8-4e99-9ff5-a19226eecb33" returned: 0 in 0.789s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:14 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-51acaa72-caf4-4d15-8911-582266fb01d8 tempest-CreateVolumesFromSnapshotTest-202843157 None] <== create_volume: return (1851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:57:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-51acaa72-caf4-4d15-8911-582266fb01d8 tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.854s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f1586f5e-6035-4ac6-929f-bfedd4580e4d tempest-VolumeDependencyTests-1321967090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 10.692s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:14 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-f1586f5e-6035-4ac6-929f-bfedd4580e4d tempest-VolumeDependencyTests-1321967090 None] Acquiring lock "cinder-quobyte-657b870a-b2d6-4d4a-b36d-233151045e40-7db732b1-cc7a-4238-a7a8-6650b389986c" by "_create_volume_from_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:14 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-51acaa72-caf4-4d15-8911-582266fb01d8 tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e57bbbdf-e605-4743-bf84-35c529d14f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f53733c7-17d8-4e99-9ff5-a19226eecb33', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:14 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-51acaa72-caf4-4d15-8911-582266fb01d8 tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f9f684b-d011-427d-b7f6-b6c2c193a404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:14 devstack sudo[104449]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:14 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-f1586f5e-6035-4ac6-929f-bfedd4580e4d tempest-VolumeDependencyTests-1321967090 None] Lock "cinder-quobyte-657b870a-b2d6-4d4a-b36d-233151045e40-7db732b1-cc7a-4238-a7a8-6650b389986c" acquired by "_create_volume_from_snapshot" :: waited 0.059s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:14 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-f1586f5e-6035-4ac6-929f-bfedd4580e4d tempest-VolumeDependencyTests-1321967090 None] Creating volume 7db732b1-cc7a-4238-a7a8-6650b389986c from snapshot 657b870a-b2d6-4d4a-b36d-233151045e40 {{(pid=86873) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 18:57:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f1586f5e-6035-4ac6-929f-bfedd4580e4d tempest-VolumeDependencyTests-1321967090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f1586f5e-6035-4ac6-929f-bfedd4580e4d tempest-VolumeDependencyTests-1321967090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:14 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-f1586f5e-6035-4ac6-929f-bfedd4580e4d tempest-VolumeDependencyTests-1321967090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:14 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-f1586f5e-6035-4ac6-929f-bfedd4580e4d tempest-VolumeDependencyTests-1321967090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f1586f5e-6035-4ac6-929f-bfedd4580e4d tempest-VolumeDependencyTests-1321967090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:14 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-f1586f5e-6035-4ac6-929f-bfedd4580e4d tempest-VolumeDependencyTests-1321967090 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:57:14 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-f1586f5e-6035-4ac6-929f-bfedd4580e4d tempest-VolumeDependencyTests-1321967090 None] Acquiring lock "cinder-quobyte-7db732b1-cc7a-4238-a7a8-6650b389986c" by "_copy_volume_from_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-eb91f919-3651-4f8b-a36e-9b80e113c826 tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b528ac19-bc49-4309-a584-306d6b493cfd" returned: 0 in 0.937s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-eb91f919-3651-4f8b-a36e-9b80e113c826 tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b528ac19-bc49-4309-a584-306d6b493cfd {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:14 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-51acaa72-caf4-4d15-8911-582266fb01d8 tempest-CreateVolumesFromSnapshotTest-202843157 None] Volume volume-f53733c7-17d8-4e99-9ff5-a19226eecb33 (f53733c7-17d8-4e99-9ff5-a19226eecb33): created successfully Jul 08 18:57:14 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-51acaa72-caf4-4d15-8911-582266fb01d8 tempest-CreateVolumesFromSnapshotTest-202843157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f9f684b-d011-427d-b7f6-b6c2c193a404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:14 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-51acaa72-caf4-4d15-8911-582266fb01d8 tempest-CreateVolumesFromSnapshotTest-202843157 None] Flow 'volume_create_manager' (9383f930-3ae5-4ca0-8ad9-12f3943da8bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:57:14 devstack sudo[104453]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:14 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-f1586f5e-6035-4ac6-929f-bfedd4580e4d tempest-VolumeDependencyTests-1321967090 None] Lock "cinder-quobyte-7db732b1-cc7a-4238-a7a8-6650b389986c" acquired by "_copy_volume_from_snapshot" :: waited 0.081s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:14 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-f1586f5e-6035-4ac6-929f-bfedd4580e4d tempest-VolumeDependencyTests-1321967090 None] snapshot: 657b870a-b2d6-4d4a-b36d-233151045e40, volume: 7db732b1-cc7a-4238-a7a8-6650b389986c, {{(pid=86873) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 18:57:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-36be357c-9697-42d4-ac8c-c3933f000ab3 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.765s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:14 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-36be357c-9697-42d4-ac8c-c3933f000ab3 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:57:14 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-51acaa72-caf4-4d15-8911-582266fb01d8 tempest-CreateVolumesFromSnapshotTest-202843157 None] Created volume successfully. Jul 08 18:57:14 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-36be357c-9697-42d4-ac8c-c3933f000ab3 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Deleted volume successfully. Jul 08 18:57:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f1586f5e-6035-4ac6-929f-bfedd4580e4d tempest-VolumeDependencyTests-1321967090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f1586f5e-6035-4ac6-929f-bfedd4580e4d tempest-VolumeDependencyTests-1321967090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:14 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-f1586f5e-6035-4ac6-929f-bfedd4580e4d tempest-VolumeDependencyTests-1321967090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:14 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-f1586f5e-6035-4ac6-929f-bfedd4580e4d tempest-VolumeDependencyTests-1321967090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f1586f5e-6035-4ac6-929f-bfedd4580e4d tempest-VolumeDependencyTests-1321967090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:14 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab562128-e7fb-4c36-b52e-5bff043705d7]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f1586f5e-6035-4ac6-929f-bfedd4580e4d tempest-VolumeDependencyTests-1321967090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a56282f-de69-4d61-835e-5ab241a6b719.657b870a-b2d6-4d4a-b36d-233151045e40 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:14 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-36be357c-9697-42d4-ac8c-c3933f000ab3 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Lock "cinder-76a0405e-2021-470b-924e-eced5b1b70d3-delete_volume" released by "delete_volume" :: held 2.787s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:14 devstack sudo[104461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b528ac19-bc49-4309-a584-306d6b493cfd Jul 08 18:57:14 devstack sudo[104461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:15 devstack sudo[104462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a56282f-de69-4d61-835e-5ab241a6b719.657b870a-b2d6-4d4a-b36d-233151045e40 Jul 08 18:57:15 devstack sudo[104462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:15 devstack sudo[104458]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1b9f4bf1-d1b5-4bf1-933a-8e890b8ca883 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4db6527-86b6-4764-bdc2-c350190d739a" returned: 0 in 0.894s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1b9f4bf1-d1b5-4bf1-933a-8e890b8ca883 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4db6527-86b6-4764-bdc2-c350190d739a {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:15 devstack sudo[104468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4db6527-86b6-4764-bdc2-c350190d739a Jul 08 18:57:15 devstack sudo[104468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:15 devstack sudo[104461]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-eb91f919-3651-4f8b-a36e-9b80e113c826 tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b528ac19-bc49-4309-a584-306d6b493cfd" returned: 1 in 0.908s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-eb91f919-3651-4f8b-a36e-9b80e113c826 tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b528ac19-bc49-4309-a584-306d6b493cfd' failed. Not Retrying. {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:57:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-eb91f919-3651-4f8b-a36e-9b80e113c826 tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b528ac19-bc49-4309-a584-306d6b493cfd {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:15 devstack sudo[104476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b528ac19-bc49-4309-a584-306d6b493cfd Jul 08 18:57:15 devstack sudo[104476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:15 devstack sudo[104462]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f1586f5e-6035-4ac6-929f-bfedd4580e4d tempest-VolumeDependencyTests-1321967090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a56282f-de69-4d61-835e-5ab241a6b719.657b870a-b2d6-4d4a-b36d-233151045e40" returned: 0 in 0.857s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:15 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-f1586f5e-6035-4ac6-929f-bfedd4580e4d tempest-VolumeDependencyTests-1321967090 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a56282f-de69-4d61-835e-5ab241a6b719(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:57:15 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-f1586f5e-6035-4ac6-929f-bfedd4580e4d tempest-VolumeDependencyTests-1321967090 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a56282f-de69-4d61-835e-5ab241a6b719 {{(pid=86873) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 18:57:15 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-f1586f5e-6035-4ac6-929f-bfedd4580e4d tempest-VolumeDependencyTests-1321967090 None] Creating direct copy from snapshot {{(pid=86873) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 18:57:15 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[466f4c59-f07b-4d70-beb7-e3749564796a]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f1586f5e-6035-4ac6-929f-bfedd4580e4d tempest-VolumeDependencyTests-1321967090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a56282f-de69-4d61-835e-5ab241a6b719 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:15 devstack sudo[104478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a56282f-de69-4d61-835e-5ab241a6b719 Jul 08 18:57:15 devstack sudo[104478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:15 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-7f0b3cfb-b868-4b6b-a1f6-e732753c4829 tempest-CreateVolumesFromSnapshotTest-202843157 None] Acquiring lock "cinder-f53733c7-17d8-4e99-9ff5-a19226eecb33-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:16 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-7f0b3cfb-b868-4b6b-a1f6-e732753c4829 tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "cinder-f53733c7-17d8-4e99-9ff5-a19226eecb33-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:16 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-7f0b3cfb-b868-4b6b-a1f6-e732753c4829 tempest-CreateVolumesFromSnapshotTest-202843157 None] Acquiring lock "cinder-quobyte-f53733c7-17d8-4e99-9ff5-a19226eecb33" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:16 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-7f0b3cfb-b868-4b6b-a1f6-e732753c4829 tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "cinder-quobyte-f53733c7-17d8-4e99-9ff5-a19226eecb33" acquired by "delete_volume" :: waited 0.024s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:16 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[80adf220-65fe-4eaf-b6dc-4604a16b3f29]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-7f0b3cfb-b868-4b6b-a1f6-e732753c4829 tempest-CreateVolumesFromSnapshotTest-202843157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f53733c7-17d8-4e99-9ff5-a19226eecb33 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:16 devstack sudo[104468]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1b9f4bf1-d1b5-4bf1-933a-8e890b8ca883 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d4db6527-86b6-4764-bdc2-c350190d739a" returned: 0 in 0.749s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:16 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-1b9f4bf1-d1b5-4bf1-933a-8e890b8ca883 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Lock "cinder-quobyte-d4db6527-86b6-4764-bdc2-c350190d739a" released by "delete_volume" :: held 1.703s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:16 devstack sudo[104481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f53733c7-17d8-4e99-9ff5-a19226eecb33 Jul 08 18:57:16 devstack sudo[104481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:16 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-1b9f4bf1-d1b5-4bf1-933a-8e890b8ca883 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Created reservations ['89a447ce-c5d6-481d-8a18-0e5e7c17faa1', '83a01c7f-3aa4-4968-b24e-e938234c035c', 'ca765558-54e7-4347-88ec-109f7f9a878c', 'abbc0c5f-d0c7-473c-94d3-779e09ac67fd'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:57:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1b9f4bf1-d1b5-4bf1-933a-8e890b8ca883 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1b9f4bf1-d1b5-4bf1-933a-8e890b8ca883 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:16 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-1b9f4bf1-d1b5-4bf1-933a-8e890b8ca883 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:16 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-1b9f4bf1-d1b5-4bf1-933a-8e890b8ca883 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1b9f4bf1-d1b5-4bf1-933a-8e890b8ca883 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1b9f4bf1-d1b5-4bf1-933a-8e890b8ca883 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:16 devstack sudo[104484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:57:16 devstack sudo[104484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:16 devstack sudo[104476]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-eb91f919-3651-4f8b-a36e-9b80e113c826 tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b528ac19-bc49-4309-a584-306d6b493cfd" returned: 0 in 0.761s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:16 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-eb91f919-3651-4f8b-a36e-9b80e113c826 tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Lock "cinder-quobyte-b528ac19-bc49-4309-a584-306d6b493cfd" released by "delete_volume" :: held 2.672s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:16 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-eb91f919-3651-4f8b-a36e-9b80e113c826 tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Created reservations ['74d114e9-dc89-4f70-9c22-9745b718f372', '2eabc172-d721-48b3-a3b4-8040eb9e9ce0', 'abfb908c-8cf1-432c-878d-d06d311b65cb', '207a5af5-e03a-43cd-aadd-ee84d6d145aa'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:57:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-eb91f919-3651-4f8b-a36e-9b80e113c826 tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-eb91f919-3651-4f8b-a36e-9b80e113c826 tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:16 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-eb91f919-3651-4f8b-a36e-9b80e113c826 tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:16 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-eb91f919-3651-4f8b-a36e-9b80e113c826 tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-eb91f919-3651-4f8b-a36e-9b80e113c826 tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-eb91f919-3651-4f8b-a36e-9b80e113c826 tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:16 devstack sudo[104492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:57:16 devstack sudo[104492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:16 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6a700f59-9471-428e-9f7a-f02cd51ecf33 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Acquiring lock "cinder-ab928dd2-09f4-4c0e-835a-07c84344127b-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:16 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6a700f59-9471-428e-9f7a-f02cd51ecf33 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Lock "cinder-ab928dd2-09f4-4c0e-835a-07c84344127b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:16 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6a700f59-9471-428e-9f7a-f02cd51ecf33 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Acquiring lock "cinder-quobyte-ab928dd2-09f4-4c0e-835a-07c84344127b" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:16 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6a700f59-9471-428e-9f7a-f02cd51ecf33 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Lock "cinder-quobyte-ab928dd2-09f4-4c0e-835a-07c84344127b" acquired by "delete_volume" :: waited 0.014s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:16 devstack sudo[104478]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:16 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4ba586-daf9-4773-b503-becf2b52840f]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6a700f59-9471-428e-9f7a-f02cd51ecf33 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ab928dd2-09f4-4c0e-835a-07c84344127b {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f1586f5e-6035-4ac6-929f-bfedd4580e4d tempest-VolumeDependencyTests-1321967090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a56282f-de69-4d61-835e-5ab241a6b719" returned: 0 in 1.113s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:16 devstack cinder-volume[86873]: DEBUG cinder.utils [None req-f1586f5e-6035-4ac6-929f-bfedd4580e4d tempest-VolumeDependencyTests-1321967090 None] Path /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7db732b1-cc7a-4238-a7a8-6650b389986c not found in is_blk_device check {{(pid=86873) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 18:57:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f1586f5e-6035-4ac6-929f-bfedd4580e4d tempest-VolumeDependencyTests-1321967090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a56282f-de69-4d61-835e-5ab241a6b719 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7db732b1-cc7a-4238-a7a8-6650b389986c {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:16 devstack sudo[104499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a56282f-de69-4d61-835e-5ab241a6b719 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7db732b1-cc7a-4238-a7a8-6650b389986c Jul 08 18:57:16 devstack sudo[104499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:17 devstack sudo[104497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ab928dd2-09f4-4c0e-835a-07c84344127b Jul 08 18:57:17 devstack sudo[104497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:17 devstack sudo[104481]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-7f0b3cfb-b868-4b6b-a1f6-e732753c4829 tempest-CreateVolumesFromSnapshotTest-202843157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f53733c7-17d8-4e99-9ff5-a19226eecb33" returned: 0 in 1.114s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-7f0b3cfb-b868-4b6b-a1f6-e732753c4829 tempest-CreateVolumesFromSnapshotTest-202843157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f53733c7-17d8-4e99-9ff5-a19226eecb33 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:17 devstack sudo[104504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f53733c7-17d8-4e99-9ff5-a19226eecb33 Jul 08 18:57:17 devstack sudo[104504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:17 devstack sudo[104484]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1b9f4bf1-d1b5-4bf1-933a-8e890b8ca883 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 1.294s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:17 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-1b9f4bf1-d1b5-4bf1-933a-8e890b8ca883 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:57:17 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-1b9f4bf1-d1b5-4bf1-933a-8e890b8ca883 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Deleted volume successfully. Jul 08 18:57:17 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-1b9f4bf1-d1b5-4bf1-933a-8e890b8ca883 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Lock "cinder-d4db6527-86b6-4764-bdc2-c350190d739a-delete_volume" released by "delete_volume" :: held 3.284s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:17 devstack sudo[104492]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-eb91f919-3651-4f8b-a36e-9b80e113c826 tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 1.219s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:17 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-eb91f919-3651-4f8b-a36e-9b80e113c826 tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:57:17 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-eb91f919-3651-4f8b-a36e-9b80e113c826 tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Deleted volume successfully. Jul 08 18:57:17 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-eb91f919-3651-4f8b-a36e-9b80e113c826 tempest-VolumeAndVolumeTypeFromImageTest-2024897765 None] Lock "cinder-b528ac19-bc49-4309-a584-306d6b493cfd-delete_volume" released by "delete_volume" :: held 4.191s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:18 devstack sudo[104497]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6a700f59-9471-428e-9f7a-f02cd51ecf33 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ab928dd2-09f4-4c0e-835a-07c84344127b" returned: 0 in 1.186s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6a700f59-9471-428e-9f7a-f02cd51ecf33 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ab928dd2-09f4-4c0e-835a-07c84344127b {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:18 devstack sudo[104516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ab928dd2-09f4-4c0e-835a-07c84344127b Jul 08 18:57:18 devstack sudo[104516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:18 devstack sudo[104504]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-7f0b3cfb-b868-4b6b-a1f6-e732753c4829 tempest-CreateVolumesFromSnapshotTest-202843157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-f53733c7-17d8-4e99-9ff5-a19226eecb33" returned: 0 in 0.959s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:18 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-7f0b3cfb-b868-4b6b-a1f6-e732753c4829 tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "cinder-quobyte-f53733c7-17d8-4e99-9ff5-a19226eecb33" released by "delete_volume" :: held 2.153s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:18 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-7f0b3cfb-b868-4b6b-a1f6-e732753c4829 tempest-CreateVolumesFromSnapshotTest-202843157 None] Created reservations ['b78fedd3-a092-43e5-9efa-2bba9aa1aab1', 'c93b571e-5861-4cfa-a97f-2954ef286d26', '1a78e64d-ee0c-4717-aec0-c81b894ef3ce', 'bf186d79-e56e-4bf0-bc77-9f305a128f0f'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:57:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-7f0b3cfb-b868-4b6b-a1f6-e732753c4829 tempest-CreateVolumesFromSnapshotTest-202843157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-7f0b3cfb-b868-4b6b-a1f6-e732753c4829 tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:18 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-7f0b3cfb-b868-4b6b-a1f6-e732753c4829 tempest-CreateVolumesFromSnapshotTest-202843157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:18 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-7f0b3cfb-b868-4b6b-a1f6-e732753c4829 tempest-CreateVolumesFromSnapshotTest-202843157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-7f0b3cfb-b868-4b6b-a1f6-e732753c4829 tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-7f0b3cfb-b868-4b6b-a1f6-e732753c4829 tempest-CreateVolumesFromSnapshotTest-202843157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:18 devstack sudo[104524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:57:18 devstack sudo[104524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:19 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-be2b23f7-0325-476b-b35a-31c7262dfa92 tempest-CreateVolumesFromSnapshotTest-202843157 None] Acquiring lock "cinder-402ff7f6-b067-4adb-84f3-57c7475fa870-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:19 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-be2b23f7-0325-476b-b35a-31c7262dfa92 tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "cinder-402ff7f6-b067-4adb-84f3-57c7475fa870-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:19 devstack sudo[104516]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:19 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6a700f59-9471-428e-9f7a-f02cd51ecf33 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ab928dd2-09f4-4c0e-835a-07c84344127b" returned: 0 in 1.768s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:19 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-be2b23f7-0325-476b-b35a-31c7262dfa92 tempest-CreateVolumesFromSnapshotTest-202843157 None] Acquiring lock "cinder-quobyte-402ff7f6-b067-4adb-84f3-57c7475fa870" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:19 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6a700f59-9471-428e-9f7a-f02cd51ecf33 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Lock "cinder-quobyte-ab928dd2-09f4-4c0e-835a-07c84344127b" released by "delete_volume" :: held 3.076s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:19 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-be2b23f7-0325-476b-b35a-31c7262dfa92 tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "cinder-quobyte-402ff7f6-b067-4adb-84f3-57c7475fa870" acquired by "delete_volume" :: waited 0.045s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:20 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[e427b0c7-b168-43a4-a9c8-13855c718251]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-be2b23f7-0325-476b-b35a-31c7262dfa92 tempest-CreateVolumesFromSnapshotTest-202843157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-402ff7f6-b067-4adb-84f3-57c7475fa870 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:20 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-6a700f59-9471-428e-9f7a-f02cd51ecf33 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Created reservations ['812db79d-bb81-469f-9205-a6ff4a6d8194', '59ef46be-24a7-4ebf-ada1-19f67a4a06fa', '74dab89e-5519-4f7d-9ef0-dde7b3272db0', '31d01888-7647-4cde-aea6-949580ccd174'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:57:20 devstack sudo[104524]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-7f0b3cfb-b868-4b6b-a1f6-e732753c4829 tempest-CreateVolumesFromSnapshotTest-202843157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 1.605s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:20 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-7f0b3cfb-b868-4b6b-a1f6-e732753c4829 tempest-CreateVolumesFromSnapshotTest-202843157 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:57:20 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-7f0b3cfb-b868-4b6b-a1f6-e732753c4829 tempest-CreateVolumesFromSnapshotTest-202843157 None] Deleted volume successfully. Jul 08 18:57:20 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-7f0b3cfb-b868-4b6b-a1f6-e732753c4829 tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "cinder-f53733c7-17d8-4e99-9ff5-a19226eecb33-delete_volume" released by "delete_volume" :: held 4.433s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6a700f59-9471-428e-9f7a-f02cd51ecf33 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6a700f59-9471-428e-9f7a-f02cd51ecf33 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:20 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-6a700f59-9471-428e-9f7a-f02cd51ecf33 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:20 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-6a700f59-9471-428e-9f7a-f02cd51ecf33 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6a700f59-9471-428e-9f7a-f02cd51ecf33 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6a700f59-9471-428e-9f7a-f02cd51ecf33 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:20 devstack sudo[104529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-402ff7f6-b067-4adb-84f3-57c7475fa870 Jul 08 18:57:20 devstack sudo[104529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:20 devstack sudo[104531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:57:20 devstack sudo[104531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:22 devstack sudo[104531]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6a700f59-9471-428e-9f7a-f02cd51ecf33 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 1.525s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:22 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-6a700f59-9471-428e-9f7a-f02cd51ecf33 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:57:22 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-6a700f59-9471-428e-9f7a-f02cd51ecf33 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Deleted volume successfully. Jul 08 18:57:22 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6a700f59-9471-428e-9f7a-f02cd51ecf33 tempest-CreateVolumesFromSourceVolumeTest-106813322 None] Lock "cinder-ab928dd2-09f4-4c0e-835a-07c84344127b-delete_volume" released by "delete_volume" :: held 5.345s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:22 devstack sudo[104529]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-be2b23f7-0325-476b-b35a-31c7262dfa92 tempest-CreateVolumesFromSnapshotTest-202843157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-402ff7f6-b067-4adb-84f3-57c7475fa870" returned: 0 in 2.433s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-be2b23f7-0325-476b-b35a-31c7262dfa92 tempest-CreateVolumesFromSnapshotTest-202843157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-402ff7f6-b067-4adb-84f3-57c7475fa870 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:22 devstack sudo[104540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-402ff7f6-b067-4adb-84f3-57c7475fa870 Jul 08 18:57:22 devstack sudo[104540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:23 devstack sudo[104540]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-be2b23f7-0325-476b-b35a-31c7262dfa92 tempest-CreateVolumesFromSnapshotTest-202843157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-402ff7f6-b067-4adb-84f3-57c7475fa870" returned: 0 in 1.144s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:23 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-be2b23f7-0325-476b-b35a-31c7262dfa92 tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "cinder-quobyte-402ff7f6-b067-4adb-84f3-57c7475fa870" released by "delete_volume" :: held 3.734s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:23 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-be2b23f7-0325-476b-b35a-31c7262dfa92 tempest-CreateVolumesFromSnapshotTest-202843157 None] Created reservations ['c243ed32-2a9e-494d-bbff-02a11715a581', 'c1812586-71bc-45cb-b511-fa14ee2ad2a1', '165fa9b7-ed0c-4c5a-8b66-4d2633656513', '2ad61f36-9aa4-4cc1-9453-bdf93e591f7d'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:57:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-be2b23f7-0325-476b-b35a-31c7262dfa92 tempest-CreateVolumesFromSnapshotTest-202843157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-be2b23f7-0325-476b-b35a-31c7262dfa92 tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:23 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-be2b23f7-0325-476b-b35a-31c7262dfa92 tempest-CreateVolumesFromSnapshotTest-202843157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:23 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-be2b23f7-0325-476b-b35a-31c7262dfa92 tempest-CreateVolumesFromSnapshotTest-202843157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-be2b23f7-0325-476b-b35a-31c7262dfa92 tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-be2b23f7-0325-476b-b35a-31c7262dfa92 tempest-CreateVolumesFromSnapshotTest-202843157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:24 devstack sudo[104544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:57:24 devstack sudo[104544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:24 devstack sudo[104499]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f1586f5e-6035-4ac6-929f-bfedd4580e4d tempest-VolumeDependencyTests-1321967090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a56282f-de69-4d61-835e-5ab241a6b719 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7db732b1-cc7a-4238-a7a8-6650b389986c" returned: 0 in 7.599s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:24 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9c734f-8719-43cf-a012-6dc7724af774]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f1586f5e-6035-4ac6-929f-bfedd4580e4d tempest-VolumeDependencyTests-1321967090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a56282f-de69-4d61-835e-5ab241a6b719 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:24 devstack sudo[104546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a56282f-de69-4d61-835e-5ab241a6b719 Jul 08 18:57:24 devstack sudo[104546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:24 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-86cc2dfd-6eaa-4140-80ff-65bc175805ec tempest-CreateVolumesFromSnapshotTest-202843157 None] Acquiring lock "cinder-45cde405-e75c-48da-a2f8-cd6d5dd82eda-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:24 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-86cc2dfd-6eaa-4140-80ff-65bc175805ec tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "cinder-45cde405-e75c-48da-a2f8-cd6d5dd82eda-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:24 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-86cc2dfd-6eaa-4140-80ff-65bc175805ec tempest-CreateVolumesFromSnapshotTest-202843157 None] Acquiring lock "cinder-quobyte-45cde405-e75c-48da-a2f8-cd6d5dd82eda" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:24 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-86cc2dfd-6eaa-4140-80ff-65bc175805ec tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "cinder-quobyte-45cde405-e75c-48da-a2f8-cd6d5dd82eda" acquired by "delete_volume" :: waited 0.032s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:24 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0dce113-4af2-4b5d-b64a-b76fde7ac614]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-86cc2dfd-6eaa-4140-80ff-65bc175805ec tempest-CreateVolumesFromSnapshotTest-202843157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-45cde405-e75c-48da-a2f8-cd6d5dd82eda {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:24 devstack sudo[104549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-45cde405-e75c-48da-a2f8-cd6d5dd82eda Jul 08 18:57:24 devstack sudo[104549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:25 devstack sudo[104544]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-be2b23f7-0325-476b-b35a-31c7262dfa92 tempest-CreateVolumesFromSnapshotTest-202843157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 1.055s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:25 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-be2b23f7-0325-476b-b35a-31c7262dfa92 tempest-CreateVolumesFromSnapshotTest-202843157 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:57:25 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-be2b23f7-0325-476b-b35a-31c7262dfa92 tempest-CreateVolumesFromSnapshotTest-202843157 None] Deleted volume successfully. Jul 08 18:57:25 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-be2b23f7-0325-476b-b35a-31c7262dfa92 tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "cinder-402ff7f6-b067-4adb-84f3-57c7475fa870-delete_volume" released by "delete_volume" :: held 5.315s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:25 devstack sudo[104546]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f1586f5e-6035-4ac6-929f-bfedd4580e4d tempest-VolumeDependencyTests-1321967090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a56282f-de69-4d61-835e-5ab241a6b719" returned: 0 in 1.149s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:25 devstack cinder-volume[86873]: DEBUG cinder.image.image_utils [None req-f1586f5e-6035-4ac6-929f-bfedd4580e4d tempest-VolumeDependencyTests-1321967090 None] Image conversion details: src /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a56282f-de69-4d61-835e-5ab241a6b719, size 1024.00 MB, duration 7.60 sec, destination /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7db732b1-cc7a-4238-a7a8-6650b389986c {{(pid=86873) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:57:25 devstack cinder-volume[86873]: INFO cinder.image.image_utils [None req-f1586f5e-6035-4ac6-929f-bfedd4580e4d tempest-VolumeDependencyTests-1321967090 None] Converted 1024.00 MB image at 134.73 MB/s Jul 08 18:57:25 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-f1586f5e-6035-4ac6-929f-bfedd4580e4d tempest-VolumeDependencyTests-1321967090 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7db732b1-cc7a-4238-a7a8-6650b389986c is being set with open permissions: ugo+rw Jul 08 18:57:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f1586f5e-6035-4ac6-929f-bfedd4580e4d tempest-VolumeDependencyTests-1321967090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7db732b1-cc7a-4238-a7a8-6650b389986c {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:25 devstack sudo[104558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7db732b1-cc7a-4238-a7a8-6650b389986c Jul 08 18:57:25 devstack sudo[104558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:25 devstack sudo[104549]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-86cc2dfd-6eaa-4140-80ff-65bc175805ec tempest-CreateVolumesFromSnapshotTest-202843157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-45cde405-e75c-48da-a2f8-cd6d5dd82eda" returned: 0 in 0.923s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-86cc2dfd-6eaa-4140-80ff-65bc175805ec tempest-CreateVolumesFromSnapshotTest-202843157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-45cde405-e75c-48da-a2f8-cd6d5dd82eda {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:25 devstack sudo[104560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-45cde405-e75c-48da-a2f8-cd6d5dd82eda Jul 08 18:57:25 devstack sudo[104560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:26 devstack sudo[104558]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f1586f5e-6035-4ac6-929f-bfedd4580e4d tempest-VolumeDependencyTests-1321967090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7db732b1-cc7a-4238-a7a8-6650b389986c" returned: 0 in 0.792s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:26 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-f1586f5e-6035-4ac6-929f-bfedd4580e4d tempest-VolumeDependencyTests-1321967090 None] Lock "cinder-quobyte-7db732b1-cc7a-4238-a7a8-6650b389986c" released by "_copy_volume_from_snapshot" :: held 11.663s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:26 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-f1586f5e-6035-4ac6-929f-bfedd4580e4d tempest-VolumeDependencyTests-1321967090 None] Lock "cinder-quobyte-657b870a-b2d6-4d4a-b36d-233151045e40-7db732b1-cc7a-4238-a7a8-6650b389986c" released by "_create_volume_from_snapshot" :: held 11.764s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f1586f5e-6035-4ac6-929f-bfedd4580e4d tempest-VolumeDependencyTests-1321967090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.824s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:26 devstack sudo[104560]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-86cc2dfd-6eaa-4140-80ff-65bc175805ec tempest-CreateVolumesFromSnapshotTest-202843157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-45cde405-e75c-48da-a2f8-cd6d5dd82eda" returned: 0 in 0.794s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:26 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-86cc2dfd-6eaa-4140-80ff-65bc175805ec tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "cinder-quobyte-45cde405-e75c-48da-a2f8-cd6d5dd82eda" released by "delete_volume" :: held 1.773s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:26 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f1586f5e-6035-4ac6-929f-bfedd4580e4d tempest-VolumeDependencyTests-1321967090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3309604-32b2-447f-b6f1-de0221f4ddb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7db732b1-cc7a-4238-a7a8-6650b389986c', 'volume_size': 1, 'snapshot_id': '657b870a-b2d6-4d4a-b36d-233151045e40'}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:26 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f1586f5e-6035-4ac6-929f-bfedd4580e4d tempest-VolumeDependencyTests-1321967090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ed0a426-f398-4850-8711-6598519a69f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:26 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-f1586f5e-6035-4ac6-929f-bfedd4580e4d tempest-VolumeDependencyTests-1321967090 None] Volume volume-7db732b1-cc7a-4238-a7a8-6650b389986c (7db732b1-cc7a-4238-a7a8-6650b389986c): created successfully Jul 08 18:57:26 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f1586f5e-6035-4ac6-929f-bfedd4580e4d tempest-VolumeDependencyTests-1321967090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ed0a426-f398-4850-8711-6598519a69f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:26 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f1586f5e-6035-4ac6-929f-bfedd4580e4d tempest-VolumeDependencyTests-1321967090 None] Flow 'volume_create_manager' (4e56d1dc-7fe9-4e21-9949-45cbc8b6d9a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:57:26 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-86cc2dfd-6eaa-4140-80ff-65bc175805ec tempest-CreateVolumesFromSnapshotTest-202843157 None] Created reservations ['1a9459c2-557a-498d-8de8-c9d611320f08', '2bb7ade2-911b-4962-ba0d-55b7ce5dfa54', 'a0d4531d-b4e4-4150-935f-de75875b77bb', 'ae916d01-223b-4fa0-b2de-41372e55d694'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:57:26 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-f1586f5e-6035-4ac6-929f-bfedd4580e4d tempest-VolumeDependencyTests-1321967090 None] Created volume successfully. Jul 08 18:57:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-86cc2dfd-6eaa-4140-80ff-65bc175805ec tempest-CreateVolumesFromSnapshotTest-202843157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-86cc2dfd-6eaa-4140-80ff-65bc175805ec tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:27 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-86cc2dfd-6eaa-4140-80ff-65bc175805ec tempest-CreateVolumesFromSnapshotTest-202843157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:27 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-86cc2dfd-6eaa-4140-80ff-65bc175805ec tempest-CreateVolumesFromSnapshotTest-202843157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-86cc2dfd-6eaa-4140-80ff-65bc175805ec tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-86cc2dfd-6eaa-4140-80ff-65bc175805ec tempest-CreateVolumesFromSnapshotTest-202843157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:27 devstack sudo[104564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:57:27 devstack sudo[104564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:27 devstack sudo[104564]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-86cc2dfd-6eaa-4140-80ff-65bc175805ec tempest-CreateVolumesFromSnapshotTest-202843157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.701s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:27 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-86cc2dfd-6eaa-4140-80ff-65bc175805ec tempest-CreateVolumesFromSnapshotTest-202843157 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:57:27 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-86cc2dfd-6eaa-4140-80ff-65bc175805ec tempest-CreateVolumesFromSnapshotTest-202843157 None] Deleted volume successfully. Jul 08 18:57:27 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-86cc2dfd-6eaa-4140-80ff-65bc175805ec tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "cinder-45cde405-e75c-48da-a2f8-cd6d5dd82eda-delete_volume" released by "delete_volume" :: held 3.126s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:27 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b290e60f-0b2f-4c58-a6fe-2dc8a8c53cd7 tempest-CreateVolumesFromSnapshotTest-202843157 None] Acquiring lock "cinder-96de88df-5d88-43da-8031-e1d1fc041d99-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:28 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b290e60f-0b2f-4c58-a6fe-2dc8a8c53cd7 tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "cinder-96de88df-5d88-43da-8031-e1d1fc041d99-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:28 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b290e60f-0b2f-4c58-a6fe-2dc8a8c53cd7 tempest-CreateVolumesFromSnapshotTest-202843157 None] Acquiring lock "cinder-quobyte-96de88df-5d88-43da-8031-e1d1fc041d99" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:28 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b290e60f-0b2f-4c58-a6fe-2dc8a8c53cd7 tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "cinder-quobyte-96de88df-5d88-43da-8031-e1d1fc041d99" acquired by "delete_volume" :: waited 0.020s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:28 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6fffc9a6-1213-4f33-ba6c-eb801b755b39 tempest-VolumeDependencyTests-1321967090 None] Acquiring lock "cinder-657b870a-b2d6-4d4a-b36d-233151045e40-delete_snapshot" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:28 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf52b5a-f7ac-4026-b7f7-7c57a4deb2b8]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b290e60f-0b2f-4c58-a6fe-2dc8a8c53cd7 tempest-CreateVolumesFromSnapshotTest-202843157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-96de88df-5d88-43da-8031-e1d1fc041d99 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:28 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6fffc9a6-1213-4f33-ba6c-eb801b755b39 tempest-VolumeDependencyTests-1321967090 None] Lock "cinder-657b870a-b2d6-4d4a-b36d-233151045e40-delete_snapshot" acquired by "delete_snapshot" :: waited 0.073s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:28 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6fffc9a6-1213-4f33-ba6c-eb801b755b39 tempest-VolumeDependencyTests-1321967090 None] Acquiring lock "cinder-quobyte-5a56282f-de69-4d61-835e-5ab241a6b719" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:28 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6fffc9a6-1213-4f33-ba6c-eb801b755b39 tempest-VolumeDependencyTests-1321967090 None] Lock "cinder-quobyte-5a56282f-de69-4d61-835e-5ab241a6b719" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:28 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6fffc9a6-1213-4f33-ba6c-eb801b755b39 tempest-VolumeDependencyTests-1321967090 None] Acquiring lock "cinder-quobyte-657b870a-b2d6-4d4a-b36d-233151045e40" by "_delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:28 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6fffc9a6-1213-4f33-ba6c-eb801b755b39 tempest-VolumeDependencyTests-1321967090 None] Lock "cinder-quobyte-657b870a-b2d6-4d4a-b36d-233151045e40" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:28 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-6fffc9a6-1213-4f33-ba6c-eb801b755b39 tempest-VolumeDependencyTests-1321967090 None] Deleting offline snapshot 657b870a-b2d6-4d4a-b36d-233151045e40 of volume 5a56282f-de69-4d61-835e-5ab241a6b719 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:57:28 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-6fffc9a6-1213-4f33-ba6c-eb801b755b39 tempest-VolumeDependencyTests-1321967090 None] snapshot_file for this snap is: volume-5a56282f-de69-4d61-835e-5ab241a6b719.657b870a-b2d6-4d4a-b36d-233151045e40 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:57:28 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2508292-ff4a-4031-928a-ec8323160732 tempest-CreateVolumesFromImageTest-687116459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:57:28 devstack sudo[104568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-96de88df-5d88-43da-8031-e1d1fc041d99 Jul 08 18:57:28 devstack sudo[104568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b2508292-ff4a-4031-928a-ec8323160732 tempest-CreateVolumesFromImageTest-687116459 None] Flow 'volume_create_manager' (d7903705-5772-473b-932f-cc4022b486d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:57:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b2508292-ff4a-4031-928a-ec8323160732 tempest-CreateVolumesFromImageTest-687116459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e62d75c-f0f2-45ee-8b36-d74bf32b694b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:28 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[242cbeb3-39c9-4ebd-8d5c-617c5eeab500]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6fffc9a6-1213-4f33-ba6c-eb801b755b39 tempest-VolumeDependencyTests-1321967090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a56282f-de69-4d61-835e-5ab241a6b719.657b870a-b2d6-4d4a-b36d-233151045e40 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b2508292-ff4a-4031-928a-ec8323160732 tempest-CreateVolumesFromImageTest-687116459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e62d75c-f0f2-45ee-8b36-d74bf32b694b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-896810753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5e5cf6c-bd89-4dae-a961-fb18873aa234,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='386f13f78ef14b719c3078e32e912fe2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:57:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:57:28Z,use_quota=True,user_id='e0de4e62b3474ea29dc64088832deb4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b2508292-ff4a-4031-928a-ec8323160732 tempest-CreateVolumesFromImageTest-687116459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3cb0e3a-55f3-4280-bdf7-0e9ddd73e8b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b2508292-ff4a-4031-928a-ec8323160732 tempest-CreateVolumesFromImageTest-687116459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3cb0e3a-55f3-4280-bdf7-0e9ddd73e8b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b2508292-ff4a-4031-928a-ec8323160732 tempest-CreateVolumesFromImageTest-687116459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb58ee3c-dad2-4a8e-abb7-e6fd52a18ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b2508292-ff4a-4031-928a-ec8323160732 tempest-CreateVolumesFromImageTest-687116459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb58ee3c-dad2-4a8e-abb7-e6fd52a18ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5e5cf6c-bd89-4dae-a961-fb18873aa234', 'volume_name': 'volume-b5e5cf6c-bd89-4dae-a961-fb18873aa234', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b2508292-ff4a-4031-928a-ec8323160732 tempest-CreateVolumesFromImageTest-687116459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72e8e37b-1537-414d-96e3-9e9033b93b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b2508292-ff4a-4031-928a-ec8323160732 tempest-CreateVolumesFromImageTest-687116459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72e8e37b-1537-414d-96e3-9e9033b93b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b2508292-ff4a-4031-928a-ec8323160732 tempest-CreateVolumesFromImageTest-687116459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44a04da0-2432-4836-b8f2-aec627410573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:28 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-b2508292-ff4a-4031-928a-ec8323160732 tempest-CreateVolumesFromImageTest-687116459 None] Volume b5e5cf6c-bd89-4dae-a961-fb18873aa234: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5e5cf6c-bd89-4dae-a961-fb18873aa234', 'volume_size': 1} Jul 08 18:57:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b2508292-ff4a-4031-928a-ec8323160732 tempest-CreateVolumesFromImageTest-687116459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b2508292-ff4a-4031-928a-ec8323160732 tempest-CreateVolumesFromImageTest-687116459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:28 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b2508292-ff4a-4031-928a-ec8323160732 tempest-CreateVolumesFromImageTest-687116459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-896810753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5e5cf6c-bd89-4dae-a961-fb18873aa234,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='386f13f78ef14b719c3078e32e912fe2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:57:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:57:28Z,use_quota=True,user_id='e0de4e62b3474ea29dc64088832deb4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:57:28 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-b2508292-ff4a-4031-928a-ec8323160732 tempest-CreateVolumesFromImageTest-687116459 None] Creating volume b5e5cf6c-bd89-4dae-a961-fb18873aa234 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:57:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b2508292-ff4a-4031-928a-ec8323160732 tempest-CreateVolumesFromImageTest-687116459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b2508292-ff4a-4031-928a-ec8323160732 tempest-CreateVolumesFromImageTest-687116459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:28 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b2508292-ff4a-4031-928a-ec8323160732 tempest-CreateVolumesFromImageTest-687116459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:28 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b2508292-ff4a-4031-928a-ec8323160732 tempest-CreateVolumesFromImageTest-687116459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b2508292-ff4a-4031-928a-ec8323160732 tempest-CreateVolumesFromImageTest-687116459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:28 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b2508292-ff4a-4031-928a-ec8323160732 tempest-CreateVolumesFromImageTest-687116459 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:57:28 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-b2508292-ff4a-4031-928a-ec8323160732 tempest-CreateVolumesFromImageTest-687116459 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:57:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b2508292-ff4a-4031-928a-ec8323160732 tempest-CreateVolumesFromImageTest-687116459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b5e5cf6c-bd89-4dae-a961-fb18873aa234 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:28 devstack sudo[104572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b5e5cf6c-bd89-4dae-a961-fb18873aa234 1073741824 Jul 08 18:57:28 devstack sudo[104572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:28 devstack sudo[104571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a56282f-de69-4d61-835e-5ab241a6b719.657b870a-b2d6-4d4a-b36d-233151045e40 Jul 08 18:57:28 devstack sudo[104571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:28 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-01e97044-c41b-4c92-a4c9-6113d531000e tempest-CinderUnicodeTest-784859172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:57:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-01e97044-c41b-4c92-a4c9-6113d531000e tempest-CinderUnicodeTest-784859172 None] Flow 'volume_create_manager' (30ca2207-30a5-4409-ae6f-aeee158c40f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:57:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-01e97044-c41b-4c92-a4c9-6113d531000e tempest-CinderUnicodeTest-784859172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80b0c5ad-6b01-4780-96e8-430bcf2c3eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-01e97044-c41b-4c92-a4c9-6113d531000e tempest-CinderUnicodeTest-784859172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80b0c5ad-6b01-4780-96e8-430bcf2c3eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4a0d3e5-6577-49f7-9975-7ccd42000cca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5abb279cda64e4fb678beeb1f38825c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:57:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:57:28Z,use_quota=True,user_id='c9761621dee14d778b41612f148bc882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-01e97044-c41b-4c92-a4c9-6113d531000e tempest-CinderUnicodeTest-784859172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6799cd94-eb4f-4cce-ad04-f783c7309f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-01e97044-c41b-4c92-a4c9-6113d531000e tempest-CinderUnicodeTest-784859172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6799cd94-eb4f-4cce-ad04-f783c7309f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-01e97044-c41b-4c92-a4c9-6113d531000e tempest-CinderUnicodeTest-784859172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63ad0051-4094-4539-8517-cde47934da4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-01e97044-c41b-4c92-a4c9-6113d531000e tempest-CinderUnicodeTest-784859172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63ad0051-4094-4539-8517-cde47934da4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4a0d3e5-6577-49f7-9975-7ccd42000cca', 'volume_name': 'volume-e4a0d3e5-6577-49f7-9975-7ccd42000cca', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-01e97044-c41b-4c92-a4c9-6113d531000e tempest-CinderUnicodeTest-784859172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fb4feff-ac58-4691-b29a-e56dadfcab11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-01e97044-c41b-4c92-a4c9-6113d531000e tempest-CinderUnicodeTest-784859172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fb4feff-ac58-4691-b29a-e56dadfcab11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-01e97044-c41b-4c92-a4c9-6113d531000e tempest-CinderUnicodeTest-784859172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84192f2b-95c8-4a16-b138-be52669ce2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:28 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-01e97044-c41b-4c92-a4c9-6113d531000e tempest-CinderUnicodeTest-784859172 None] Volume e4a0d3e5-6577-49f7-9975-7ccd42000cca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4a0d3e5-6577-49f7-9975-7ccd42000cca', 'volume_size': 1} Jul 08 18:57:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-01e97044-c41b-4c92-a4c9-6113d531000e tempest-CinderUnicodeTest-784859172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:28 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1e7c517-2e99-4f41-974a-b48ac315b708 tempest-CreateVolumesFromImageTest-687116459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:57:28 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-a1e7c517-2e99-4f41-974a-b48ac315b708 tempest-CreateVolumesFromImageTest-687116459 None] Flow 'volume_create_manager' (94c9c34d-1343-4c75-bcc2-997b8ac0c317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:57:29 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-a1e7c517-2e99-4f41-974a-b48ac315b708 tempest-CreateVolumesFromImageTest-687116459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (514ff91c-5cb3-4ed6-9896-36445d5b5108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:29 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-a1e7c517-2e99-4f41-974a-b48ac315b708 tempest-CreateVolumesFromImageTest-687116459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (514ff91c-5cb3-4ed6-9896-36445d5b5108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:57:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1295994028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=714bb8d1-10c4-4c40-b518-8d0a0c9e63f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='386f13f78ef14b719c3078e32e912fe2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:57:29Z,use_quota=True,user_id='e0de4e62b3474ea29dc64088832deb4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:29 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-a1e7c517-2e99-4f41-974a-b48ac315b708 tempest-CreateVolumesFromImageTest-687116459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baed8903-c778-4d4b-a0b0-edbf3943f71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:29 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-a1e7c517-2e99-4f41-974a-b48ac315b708 tempest-CreateVolumesFromImageTest-687116459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baed8903-c778-4d4b-a0b0-edbf3943f71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:29 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-a1e7c517-2e99-4f41-974a-b48ac315b708 tempest-CreateVolumesFromImageTest-687116459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (206873e2-b754-456b-834e-c82832d4c2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:29 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-a1e7c517-2e99-4f41-974a-b48ac315b708 tempest-CreateVolumesFromImageTest-687116459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (206873e2-b754-456b-834e-c82832d4c2f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '714bb8d1-10c4-4c40-b518-8d0a0c9e63f2', 'volume_name': 'volume-714bb8d1-10c4-4c40-b518-8d0a0c9e63f2', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:29 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-a1e7c517-2e99-4f41-974a-b48ac315b708 tempest-CreateVolumesFromImageTest-687116459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19019e66-fd3e-4d25-a207-5310d4320eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:29 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-a1e7c517-2e99-4f41-974a-b48ac315b708 tempest-CreateVolumesFromImageTest-687116459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19019e66-fd3e-4d25-a207-5310d4320eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:29 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-a1e7c517-2e99-4f41-974a-b48ac315b708 tempest-CreateVolumesFromImageTest-687116459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8ff8dcb-b1d2-4bce-8cab-747b126d2462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:29 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-a1e7c517-2e99-4f41-974a-b48ac315b708 tempest-CreateVolumesFromImageTest-687116459 None] Volume 714bb8d1-10c4-4c40-b518-8d0a0c9e63f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-714bb8d1-10c4-4c40-b518-8d0a0c9e63f2', 'volume_size': 1} Jul 08 18:57:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-a1e7c517-2e99-4f41-974a-b48ac315b708 tempest-CreateVolumesFromImageTest-687116459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:29 devstack sudo[104568]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b290e60f-0b2f-4c58-a6fe-2dc8a8c53cd7 tempest-CreateVolumesFromSnapshotTest-202843157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-96de88df-5d88-43da-8031-e1d1fc041d99" returned: 0 in 1.238s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b290e60f-0b2f-4c58-a6fe-2dc8a8c53cd7 tempest-CreateVolumesFromSnapshotTest-202843157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-96de88df-5d88-43da-8031-e1d1fc041d99 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:29 devstack sudo[104587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-96de88df-5d88-43da-8031-e1d1fc041d99 Jul 08 18:57:29 devstack sudo[104587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:29 devstack sudo[104571]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6fffc9a6-1213-4f33-ba6c-eb801b755b39 tempest-VolumeDependencyTests-1321967090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a56282f-de69-4d61-835e-5ab241a6b719.657b870a-b2d6-4d4a-b36d-233151045e40" returned: 0 in 1.084s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:29 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-6fffc9a6-1213-4f33-ba6c-eb801b755b39 tempest-VolumeDependencyTests-1321967090 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a56282f-de69-4d61-835e-5ab241a6b719(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:57:29 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc7bd56-5d97-4bf8-bb82-647e12670caa]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6fffc9a6-1213-4f33-ba6c-eb801b755b39 tempest-VolumeDependencyTests-1321967090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a56282f-de69-4d61-835e-5ab241a6b719 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:29 devstack sudo[104572]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b2508292-ff4a-4031-928a-ec8323160732 tempest-CreateVolumesFromImageTest-687116459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b5e5cf6c-bd89-4dae-a961-fb18873aa234 1073741824" returned: 0 in 1.038s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:29 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-87dd0277-881c-46b9-bcaf-eb8cc4b3fe68 tempest-CreateVolumesFromImageTest-687116459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:57:29 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-87dd0277-881c-46b9-bcaf-eb8cc4b3fe68 tempest-CreateVolumesFromImageTest-687116459 None] Flow 'volume_create_manager' (4d611118-2cfd-45b1-93de-decb2ee9711a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:57:29 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-87dd0277-881c-46b9-bcaf-eb8cc4b3fe68 tempest-CreateVolumesFromImageTest-687116459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9c63fd2-b4c1-4735-b359-bb63bc5419aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:29 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-87dd0277-881c-46b9-bcaf-eb8cc4b3fe68 tempest-CreateVolumesFromImageTest-687116459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9c63fd2-b4c1-4735-b359-bb63bc5419aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-690642402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d748e16-f019-456e-a4fc-22ba40e1f160,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='386f13f78ef14b719c3078e32e912fe2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:57:29Z,use_quota=True,user_id='e0de4e62b3474ea29dc64088832deb4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:29 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-87dd0277-881c-46b9-bcaf-eb8cc4b3fe68 tempest-CreateVolumesFromImageTest-687116459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08725bc4-cdbd-4317-8a7b-e0df19bdf13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:29 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-87dd0277-881c-46b9-bcaf-eb8cc4b3fe68 tempest-CreateVolumesFromImageTest-687116459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08725bc4-cdbd-4317-8a7b-e0df19bdf13d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:29 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-87dd0277-881c-46b9-bcaf-eb8cc4b3fe68 tempest-CreateVolumesFromImageTest-687116459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43a362e5-f81a-44b2-8e6c-05c57c0f941f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:29 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-87dd0277-881c-46b9-bcaf-eb8cc4b3fe68 tempest-CreateVolumesFromImageTest-687116459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43a362e5-f81a-44b2-8e6c-05c57c0f941f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d748e16-f019-456e-a4fc-22ba40e1f160', 'volume_name': 'volume-1d748e16-f019-456e-a4fc-22ba40e1f160', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:29 devstack sudo[104589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a56282f-de69-4d61-835e-5ab241a6b719 Jul 08 18:57:29 devstack sudo[104589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:29 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-87dd0277-881c-46b9-bcaf-eb8cc4b3fe68 tempest-CreateVolumesFromImageTest-687116459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ca7cad2-9228-4037-b03f-12286c7e2a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:29 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-87dd0277-881c-46b9-bcaf-eb8cc4b3fe68 tempest-CreateVolumesFromImageTest-687116459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ca7cad2-9228-4037-b03f-12286c7e2a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:29 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-87dd0277-881c-46b9-bcaf-eb8cc4b3fe68 tempest-CreateVolumesFromImageTest-687116459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b60838e-e5ca-462e-8408-d228b9bc1216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:29 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-87dd0277-881c-46b9-bcaf-eb8cc4b3fe68 tempest-CreateVolumesFromImageTest-687116459 None] Volume 1d748e16-f019-456e-a4fc-22ba40e1f160: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d748e16-f019-456e-a4fc-22ba40e1f160', 'volume_size': 1} Jul 08 18:57:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-87dd0277-881c-46b9-bcaf-eb8cc4b3fe68 tempest-CreateVolumesFromImageTest-687116459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b2508292-ff4a-4031-928a-ec8323160732 tempest-CreateVolumesFromImageTest-687116459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b5e5cf6c-bd89-4dae-a961-fb18873aa234 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:29 devstack sudo[104591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b5e5cf6c-bd89-4dae-a961-fb18873aa234 Jul 08 18:57:29 devstack sudo[104591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:30 devstack sudo[104587]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b290e60f-0b2f-4c58-a6fe-2dc8a8c53cd7 tempest-CreateVolumesFromSnapshotTest-202843157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-96de88df-5d88-43da-8031-e1d1fc041d99" returned: 0 in 0.859s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:30 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b290e60f-0b2f-4c58-a6fe-2dc8a8c53cd7 tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "cinder-quobyte-96de88df-5d88-43da-8031-e1d1fc041d99" released by "delete_volume" :: held 2.166s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:30 devstack sudo[104589]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6fffc9a6-1213-4f33-ba6c-eb801b755b39 tempest-VolumeDependencyTests-1321967090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a56282f-de69-4d61-835e-5ab241a6b719" returned: 0 in 0.842s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6fffc9a6-1213-4f33-ba6c-eb801b755b39 tempest-VolumeDependencyTests-1321967090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a56282f-de69-4d61-835e-5ab241a6b719.657b870a-b2d6-4d4a-b36d-233151045e40 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:30 devstack sudo[104597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a56282f-de69-4d61-835e-5ab241a6b719.657b870a-b2d6-4d4a-b36d-233151045e40 Jul 08 18:57:30 devstack sudo[104597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:30 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ef24353-3a91-4329-b37c-a45e6574d544 tempest-CreateVolumesFromImageTest-687116459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:57:30 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2ef24353-3a91-4329-b37c-a45e6574d544 tempest-CreateVolumesFromImageTest-687116459 None] Flow 'volume_create_manager' (76c52be7-802a-41bb-bb64-5ff113076192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:57:30 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2ef24353-3a91-4329-b37c-a45e6574d544 tempest-CreateVolumesFromImageTest-687116459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (042582e5-d142-42b6-a064-3f15c3de7f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:30 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2ef24353-3a91-4329-b37c-a45e6574d544 tempest-CreateVolumesFromImageTest-687116459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (042582e5-d142-42b6-a064-3f15c3de7f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-841123797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3a4d2b2-b4c2-4f85-94b1-01c6903e9cb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='386f13f78ef14b719c3078e32e912fe2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:57:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:57:30Z,use_quota=True,user_id='e0de4e62b3474ea29dc64088832deb4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:30 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2ef24353-3a91-4329-b37c-a45e6574d544 tempest-CreateVolumesFromImageTest-687116459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd512ef1-351a-469c-8f2e-afd2c5443266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:30 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2ef24353-3a91-4329-b37c-a45e6574d544 tempest-CreateVolumesFromImageTest-687116459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd512ef1-351a-469c-8f2e-afd2c5443266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:30 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2ef24353-3a91-4329-b37c-a45e6574d544 tempest-CreateVolumesFromImageTest-687116459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1a20167-5023-4eb0-86f3-c8fe6fe9ee18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:30 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2ef24353-3a91-4329-b37c-a45e6574d544 tempest-CreateVolumesFromImageTest-687116459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1a20167-5023-4eb0-86f3-c8fe6fe9ee18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3a4d2b2-b4c2-4f85-94b1-01c6903e9cb5', 'volume_name': 'volume-c3a4d2b2-b4c2-4f85-94b1-01c6903e9cb5', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:30 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2ef24353-3a91-4329-b37c-a45e6574d544 tempest-CreateVolumesFromImageTest-687116459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee4d3e69-b74d-4110-ae3b-73bda570c984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:30 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2ef24353-3a91-4329-b37c-a45e6574d544 tempest-CreateVolumesFromImageTest-687116459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee4d3e69-b74d-4110-ae3b-73bda570c984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:30 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2ef24353-3a91-4329-b37c-a45e6574d544 tempest-CreateVolumesFromImageTest-687116459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99a99408-1ca5-46fe-8682-75eb66ee31dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:30 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-2ef24353-3a91-4329-b37c-a45e6574d544 tempest-CreateVolumesFromImageTest-687116459 None] Volume c3a4d2b2-b4c2-4f85-94b1-01c6903e9cb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3a4d2b2-b4c2-4f85-94b1-01c6903e9cb5', 'volume_size': 1} Jul 08 18:57:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-2ef24353-3a91-4329-b37c-a45e6574d544 tempest-CreateVolumesFromImageTest-687116459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:30 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-b290e60f-0b2f-4c58-a6fe-2dc8a8c53cd7 tempest-CreateVolumesFromSnapshotTest-202843157 None] Created reservations ['64223fc2-f5ac-470e-874c-897f2d16e3ea', 'e886296d-db71-4a7b-bf89-7b450b655993', 'f3b09f32-60db-4a59-84f6-18bda1f6404f', 'ea7f06f2-e089-44ba-a602-0008795dd688'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:57:30 devstack sudo[104591]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b2508292-ff4a-4031-928a-ec8323160732 tempest-CreateVolumesFromImageTest-687116459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b5e5cf6c-bd89-4dae-a961-fb18873aa234" returned: 0 in 0.816s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:30 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b2508292-ff4a-4031-928a-ec8323160732 tempest-CreateVolumesFromImageTest-687116459 None] <== create_volume: return (2128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:57:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b2508292-ff4a-4031-928a-ec8323160732 tempest-CreateVolumesFromImageTest-687116459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.130s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-01e97044-c41b-4c92-a4c9-6113d531000e tempest-CinderUnicodeTest-784859172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.843s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:30 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-01e97044-c41b-4c92-a4c9-6113d531000e tempest-CinderUnicodeTest-784859172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4a0d3e5-6577-49f7-9975-7ccd42000cca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5abb279cda64e4fb678beeb1f38825c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:57:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:57:28Z,use_quota=True,user_id='c9761621dee14d778b41612f148bc882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:57:30 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-01e97044-c41b-4c92-a4c9-6113d531000e tempest-CinderUnicodeTest-784859172 None] Creating volume e4a0d3e5-6577-49f7-9975-7ccd42000cca {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:57:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-01e97044-c41b-4c92-a4c9-6113d531000e tempest-CinderUnicodeTest-784859172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-01e97044-c41b-4c92-a4c9-6113d531000e tempest-CinderUnicodeTest-784859172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:30 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-01e97044-c41b-4c92-a4c9-6113d531000e tempest-CinderUnicodeTest-784859172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:30 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-01e97044-c41b-4c92-a4c9-6113d531000e tempest-CinderUnicodeTest-784859172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-01e97044-c41b-4c92-a4c9-6113d531000e tempest-CinderUnicodeTest-784859172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:30 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-01e97044-c41b-4c92-a4c9-6113d531000e tempest-CinderUnicodeTest-784859172 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:57:30 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-01e97044-c41b-4c92-a4c9-6113d531000e tempest-CinderUnicodeTest-784859172 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:57:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-01e97044-c41b-4c92-a4c9-6113d531000e tempest-CinderUnicodeTest-784859172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e4a0d3e5-6577-49f7-9975-7ccd42000cca 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:30 devstack sudo[104600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e4a0d3e5-6577-49f7-9975-7ccd42000cca 1073741824 Jul 08 18:57:30 devstack sudo[104600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:30 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b2508292-ff4a-4031-928a-ec8323160732 tempest-CreateVolumesFromImageTest-687116459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44a04da0-2432-4836-b8f2-aec627410573) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5e5cf6c-bd89-4dae-a961-fb18873aa234', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:30 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b2508292-ff4a-4031-928a-ec8323160732 tempest-CreateVolumesFromImageTest-687116459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93f11251-1630-4975-b49e-383919ef6249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b290e60f-0b2f-4c58-a6fe-2dc8a8c53cd7 tempest-CreateVolumesFromSnapshotTest-202843157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b290e60f-0b2f-4c58-a6fe-2dc8a8c53cd7 tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:30 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b290e60f-0b2f-4c58-a6fe-2dc8a8c53cd7 tempest-CreateVolumesFromSnapshotTest-202843157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:30 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b290e60f-0b2f-4c58-a6fe-2dc8a8c53cd7 tempest-CreateVolumesFromSnapshotTest-202843157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b290e60f-0b2f-4c58-a6fe-2dc8a8c53cd7 tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b290e60f-0b2f-4c58-a6fe-2dc8a8c53cd7 tempest-CreateVolumesFromSnapshotTest-202843157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:31 devstack sudo[104602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:57:31 devstack sudo[104602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:31 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-b2508292-ff4a-4031-928a-ec8323160732 tempest-CreateVolumesFromImageTest-687116459 None] Volume volume-b5e5cf6c-bd89-4dae-a961-fb18873aa234 (b5e5cf6c-bd89-4dae-a961-fb18873aa234): created successfully Jul 08 18:57:31 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b2508292-ff4a-4031-928a-ec8323160732 tempest-CreateVolumesFromImageTest-687116459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93f11251-1630-4975-b49e-383919ef6249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:31 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b2508292-ff4a-4031-928a-ec8323160732 tempest-CreateVolumesFromImageTest-687116459 None] Flow 'volume_create_manager' (d7903705-5772-473b-932f-cc4022b486d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:57:31 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-b2508292-ff4a-4031-928a-ec8323160732 tempest-CreateVolumesFromImageTest-687116459 None] Created volume successfully. Jul 08 18:57:31 devstack sudo[104597]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6fffc9a6-1213-4f33-ba6c-eb801b755b39 tempest-VolumeDependencyTests-1321967090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a56282f-de69-4d61-835e-5ab241a6b719.657b870a-b2d6-4d4a-b36d-233151045e40" returned: 0 in 0.923s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6fffc9a6-1213-4f33-ba6c-eb801b755b39 tempest-VolumeDependencyTests-1321967090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a56282f-de69-4d61-835e-5ab241a6b719.657b870a-b2d6-4d4a-b36d-233151045e40 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:31 devstack sudo[104611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a56282f-de69-4d61-835e-5ab241a6b719.657b870a-b2d6-4d4a-b36d-233151045e40 Jul 08 18:57:31 devstack sudo[104611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:31 devstack sudo[104600]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-01e97044-c41b-4c92-a4c9-6113d531000e tempest-CinderUnicodeTest-784859172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e4a0d3e5-6577-49f7-9975-7ccd42000cca 1073741824" returned: 0 in 0.896s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:31 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba13aeb5-7c5d-4630-83d4-7446ddfac70d tempest-CreateVolumesFromImageTest-687116459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:57:31 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ba13aeb5-7c5d-4630-83d4-7446ddfac70d tempest-CreateVolumesFromImageTest-687116459 None] Flow 'volume_create_manager' (4adbda82-a8db-47cf-b57e-0570e25f7609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:57:31 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ba13aeb5-7c5d-4630-83d4-7446ddfac70d tempest-CreateVolumesFromImageTest-687116459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (934fb7e7-9121-4641-8431-a004ffc5dc82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:31 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ba13aeb5-7c5d-4630-83d4-7446ddfac70d tempest-CreateVolumesFromImageTest-687116459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (934fb7e7-9121-4641-8431-a004ffc5dc82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:57:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-602852067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1bd1c94-bbb0-493a-8118-d16d4641769f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='386f13f78ef14b719c3078e32e912fe2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:57:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:57:31Z,use_quota=True,user_id='e0de4e62b3474ea29dc64088832deb4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:31 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ba13aeb5-7c5d-4630-83d4-7446ddfac70d tempest-CreateVolumesFromImageTest-687116459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7283593-8564-45a0-9659-4b9637d4c6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:31 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ba13aeb5-7c5d-4630-83d4-7446ddfac70d tempest-CreateVolumesFromImageTest-687116459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7283593-8564-45a0-9659-4b9637d4c6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:31 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ba13aeb5-7c5d-4630-83d4-7446ddfac70d tempest-CreateVolumesFromImageTest-687116459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (899706cb-a556-4cf5-a177-0d0fec38aa00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:31 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ba13aeb5-7c5d-4630-83d4-7446ddfac70d tempest-CreateVolumesFromImageTest-687116459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (899706cb-a556-4cf5-a177-0d0fec38aa00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1bd1c94-bbb0-493a-8118-d16d4641769f', 'volume_name': 'volume-c1bd1c94-bbb0-493a-8118-d16d4641769f', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:31 devstack sudo[104602]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:31 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ba13aeb5-7c5d-4630-83d4-7446ddfac70d tempest-CreateVolumesFromImageTest-687116459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03a5a7f1-4736-4446-bfe6-75455f83947a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:31 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ba13aeb5-7c5d-4630-83d4-7446ddfac70d tempest-CreateVolumesFromImageTest-687116459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03a5a7f1-4736-4446-bfe6-75455f83947a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:31 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ba13aeb5-7c5d-4630-83d4-7446ddfac70d tempest-CreateVolumesFromImageTest-687116459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc89dc1b-e38f-4f28-9872-df4927344818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:31 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-ba13aeb5-7c5d-4630-83d4-7446ddfac70d tempest-CreateVolumesFromImageTest-687116459 None] Volume c1bd1c94-bbb0-493a-8118-d16d4641769f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1bd1c94-bbb0-493a-8118-d16d4641769f', 'volume_size': 1} Jul 08 18:57:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-ba13aeb5-7c5d-4630-83d4-7446ddfac70d tempest-CreateVolumesFromImageTest-687116459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b290e60f-0b2f-4c58-a6fe-2dc8a8c53cd7 tempest-CreateVolumesFromSnapshotTest-202843157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.806s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:31 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-b290e60f-0b2f-4c58-a6fe-2dc8a8c53cd7 tempest-CreateVolumesFromSnapshotTest-202843157 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:57:31 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-b290e60f-0b2f-4c58-a6fe-2dc8a8c53cd7 tempest-CreateVolumesFromSnapshotTest-202843157 None] Deleted volume successfully. Jul 08 18:57:31 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b1807417-b83f-4e30-9a5e-6d55582a18ec tempest-CreateVolumesFromSnapshotTest-202843157 None] Acquiring lock "cinder-cf841f53-ae69-415b-a18a-8613b270e125-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-01e97044-c41b-4c92-a4c9-6113d531000e tempest-CinderUnicodeTest-784859172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e4a0d3e5-6577-49f7-9975-7ccd42000cca {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:31 devstack sudo[104614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e4a0d3e5-6577-49f7-9975-7ccd42000cca Jul 08 18:57:31 devstack sudo[104614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:31 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b1807417-b83f-4e30-9a5e-6d55582a18ec tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "cinder-cf841f53-ae69-415b-a18a-8613b270e125-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:31 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b290e60f-0b2f-4c58-a6fe-2dc8a8c53cd7 tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "cinder-96de88df-5d88-43da-8031-e1d1fc041d99-delete_volume" released by "delete_volume" :: held 3.854s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:31 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b1807417-b83f-4e30-9a5e-6d55582a18ec tempest-CreateVolumesFromSnapshotTest-202843157 None] Acquiring lock "cinder-quobyte-cf841f53-ae69-415b-a18a-8613b270e125" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:31 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b1807417-b83f-4e30-9a5e-6d55582a18ec tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "cinder-quobyte-cf841f53-ae69-415b-a18a-8613b270e125" acquired by "delete_volume" :: waited 0.024s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:31 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[0238e02c-69d8-4674-ab59-7229ee41acd0]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b1807417-b83f-4e30-9a5e-6d55582a18ec tempest-CreateVolumesFromSnapshotTest-202843157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cf841f53-ae69-415b-a18a-8613b270e125 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:32 devstack sudo[104616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cf841f53-ae69-415b-a18a-8613b270e125 Jul 08 18:57:32 devstack sudo[104616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:32 devstack sudo[104611]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:32 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6fffc9a6-1213-4f33-ba6c-eb801b755b39 tempest-VolumeDependencyTests-1321967090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a56282f-de69-4d61-835e-5ab241a6b719.657b870a-b2d6-4d4a-b36d-233151045e40" returned: 0 in 0.832s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:32 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:SELECT=109,cinder:UPDATE=150,cinder:DELETE=14,cinder:INSERT=37 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:57:32 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6fffc9a6-1213-4f33-ba6c-eb801b755b39 tempest-VolumeDependencyTests-1321967090 None] Lock "cinder-quobyte-657b870a-b2d6-4d4a-b36d-233151045e40" released by "_delete_snapshot" :: held 3.874s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:32 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6fffc9a6-1213-4f33-ba6c-eb801b755b39 tempest-VolumeDependencyTests-1321967090 None] Lock "cinder-quobyte-5a56282f-de69-4d61-835e-5ab241a6b719" released by "delete_snapshot" :: held 3.912s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:32 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-6fffc9a6-1213-4f33-ba6c-eb801b755b39 tempest-VolumeDependencyTests-1321967090 None] Created reservations ['56375e46-5dd5-4b35-bf94-89e3d4a5f1a0', '6c2f4c9d-c586-4040-8e65-e0326545b0e3', '39ae812b-4b4a-4a15-9503-b6e286b9cffb', 'e6ae9545-b30f-4e42-9032-39ae0c18e390'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:57:32 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-6fffc9a6-1213-4f33-ba6c-eb801b755b39 tempest-VolumeDependencyTests-1321967090 None] Delete snapshot completed successfully. Jul 08 18:57:32 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6fffc9a6-1213-4f33-ba6c-eb801b755b39 tempest-VolumeDependencyTests-1321967090 None] Lock "cinder-657b870a-b2d6-4d4a-b36d-233151045e40-delete_snapshot" released by "delete_snapshot" :: held 4.086s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:32 devstack sudo[104614]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:32 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-01e97044-c41b-4c92-a4c9-6113d531000e tempest-CinderUnicodeTest-784859172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e4a0d3e5-6577-49f7-9975-7ccd42000cca" returned: 0 in 0.712s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:32 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-01e97044-c41b-4c92-a4c9-6113d531000e tempest-CinderUnicodeTest-784859172 None] <== create_volume: return (1833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:57:32 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-01e97044-c41b-4c92-a4c9-6113d531000e tempest-CinderUnicodeTest-784859172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.836s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:32 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-a1e7c517-2e99-4f41-974a-b48ac315b708 tempest-CreateVolumesFromImageTest-687116459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.471s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:32 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-a1e7c517-2e99-4f41-974a-b48ac315b708 tempest-CreateVolumesFromImageTest-687116459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:57:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1295994028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=714bb8d1-10c4-4c40-b518-8d0a0c9e63f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='386f13f78ef14b719c3078e32e912fe2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:57:29Z,use_quota=True,user_id='e0de4e62b3474ea29dc64088832deb4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:57:32 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-a1e7c517-2e99-4f41-974a-b48ac315b708 tempest-CreateVolumesFromImageTest-687116459 None] Creating volume 714bb8d1-10c4-4c40-b518-8d0a0c9e63f2 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:57:32 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-a1e7c517-2e99-4f41-974a-b48ac315b708 tempest-CreateVolumesFromImageTest-687116459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:32 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-a1e7c517-2e99-4f41-974a-b48ac315b708 tempest-CreateVolumesFromImageTest-687116459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:32 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-a1e7c517-2e99-4f41-974a-b48ac315b708 tempest-CreateVolumesFromImageTest-687116459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:32 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-a1e7c517-2e99-4f41-974a-b48ac315b708 tempest-CreateVolumesFromImageTest-687116459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:32 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-a1e7c517-2e99-4f41-974a-b48ac315b708 tempest-CreateVolumesFromImageTest-687116459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:32 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-a1e7c517-2e99-4f41-974a-b48ac315b708 tempest-CreateVolumesFromImageTest-687116459 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:57:32 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-a1e7c517-2e99-4f41-974a-b48ac315b708 tempest-CreateVolumesFromImageTest-687116459 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:57:32 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-a1e7c517-2e99-4f41-974a-b48ac315b708 tempest-CreateVolumesFromImageTest-687116459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-714bb8d1-10c4-4c40-b518-8d0a0c9e63f2 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:32 devstack sudo[104620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-714bb8d1-10c4-4c40-b518-8d0a0c9e63f2 1073741824 Jul 08 18:57:32 devstack sudo[104620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:32 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-01e97044-c41b-4c92-a4c9-6113d531000e tempest-CinderUnicodeTest-784859172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84192f2b-95c8-4a16-b138-be52669ce2c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4a0d3e5-6577-49f7-9975-7ccd42000cca', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:32 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-01e97044-c41b-4c92-a4c9-6113d531000e tempest-CinderUnicodeTest-784859172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da246ee3-b89e-404d-af28-1c6064630d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:32 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-01e97044-c41b-4c92-a4c9-6113d531000e tempest-CinderUnicodeTest-784859172 None] Volume volume-e4a0d3e5-6577-49f7-9975-7ccd42000cca (e4a0d3e5-6577-49f7-9975-7ccd42000cca): created successfully Jul 08 18:57:32 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-01e97044-c41b-4c92-a4c9-6113d531000e tempest-CinderUnicodeTest-784859172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da246ee3-b89e-404d-af28-1c6064630d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:32 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-01e97044-c41b-4c92-a4c9-6113d531000e tempest-CinderUnicodeTest-784859172 None] Flow 'volume_create_manager' (30ca2207-30a5-4409-ae6f-aeee158c40f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:57:32 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-01e97044-c41b-4c92-a4c9-6113d531000e tempest-CinderUnicodeTest-784859172 None] Created volume successfully. Jul 08 18:57:32 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-dbf63a9d-9f6d-4408-aac6-2078e1200466 tempest-VolumeDependencyTests-1321967090 None] Acquiring lock "cinder-5a56282f-de69-4d61-835e-5ab241a6b719-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:32 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-dbf63a9d-9f6d-4408-aac6-2078e1200466 tempest-VolumeDependencyTests-1321967090 None] Lock "cinder-5a56282f-de69-4d61-835e-5ab241a6b719-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:32 devstack sudo[104616]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:32 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:SELECT=114,cinder:UPDATE=143,cinder:INSERT=37,cinder:DELETE=16 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:57:32 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b1807417-b83f-4e30-9a5e-6d55582a18ec tempest-CreateVolumesFromSnapshotTest-202843157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cf841f53-ae69-415b-a18a-8613b270e125" returned: 0 in 0.933s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:32 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b1807417-b83f-4e30-9a5e-6d55582a18ec tempest-CreateVolumesFromSnapshotTest-202843157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cf841f53-ae69-415b-a18a-8613b270e125 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:32 devstack sudo[104626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cf841f53-ae69-415b-a18a-8613b270e125 Jul 08 18:57:32 devstack sudo[104626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:32 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-dbf63a9d-9f6d-4408-aac6-2078e1200466 tempest-VolumeDependencyTests-1321967090 None] Acquiring lock "cinder-quobyte-5a56282f-de69-4d61-835e-5ab241a6b719" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:33 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-dbf63a9d-9f6d-4408-aac6-2078e1200466 tempest-VolumeDependencyTests-1321967090 None] Lock "cinder-quobyte-5a56282f-de69-4d61-835e-5ab241a6b719" acquired by "delete_volume" :: waited 0.031s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:33 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[050e1d4d-609c-45ec-b569-229646c22490]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dbf63a9d-9f6d-4408-aac6-2078e1200466 tempest-VolumeDependencyTests-1321967090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a56282f-de69-4d61-835e-5ab241a6b719 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:33 devstack sudo[104628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a56282f-de69-4d61-835e-5ab241a6b719 Jul 08 18:57:33 devstack sudo[104628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:33 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbfa076a-2856-44ad-9396-f157f76f7d2b tempest-CinderUnicodeTest-784859172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:57:33 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-cbfa076a-2856-44ad-9396-f157f76f7d2b tempest-CinderUnicodeTest-784859172 None] Flow 'volume_create_manager' (84e53d6d-a867-41a0-94bf-3faac2da5443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:57:33 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-cbfa076a-2856-44ad-9396-f157f76f7d2b tempest-CinderUnicodeTest-784859172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21429c14-1843-461c-ad18-a04021399af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:33 devstack sudo[104620]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-a1e7c517-2e99-4f41-974a-b48ac315b708 tempest-CreateVolumesFromImageTest-687116459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-714bb8d1-10c4-4c40-b518-8d0a0c9e63f2 1073741824" returned: 0 in 1.077s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:33 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-cbfa076a-2856-44ad-9396-f157f76f7d2b tempest-CinderUnicodeTest-784859172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21429c14-1843-461c-ad18-a04021399af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:57:33Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-925219284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf2794dc-0eba-4f06-8ff7-b68531386aaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5abb279cda64e4fb678beeb1f38825c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:57:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:57:34Z,use_quota=True,user_id='c9761621dee14d778b41612f148bc882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:33 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-cbfa076a-2856-44ad-9396-f157f76f7d2b tempest-CinderUnicodeTest-784859172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2a14ad4-0b8e-4328-9808-65c5788ff19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:33 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-cbfa076a-2856-44ad-9396-f157f76f7d2b tempest-CinderUnicodeTest-784859172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2a14ad4-0b8e-4328-9808-65c5788ff19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:33 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-cbfa076a-2856-44ad-9396-f157f76f7d2b tempest-CinderUnicodeTest-784859172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4189472-de32-47bc-b912-e25c5e62996c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:33 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-cbfa076a-2856-44ad-9396-f157f76f7d2b tempest-CinderUnicodeTest-784859172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4189472-de32-47bc-b912-e25c5e62996c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf2794dc-0eba-4f06-8ff7-b68531386aaf', 'volume_name': 'volume-cf2794dc-0eba-4f06-8ff7-b68531386aaf', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:33 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-cbfa076a-2856-44ad-9396-f157f76f7d2b tempest-CinderUnicodeTest-784859172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36c2e608-7ee1-4c5d-aedd-85c3ae0eae83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:33 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-cbfa076a-2856-44ad-9396-f157f76f7d2b tempest-CinderUnicodeTest-784859172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36c2e608-7ee1-4c5d-aedd-85c3ae0eae83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:33 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-cbfa076a-2856-44ad-9396-f157f76f7d2b tempest-CinderUnicodeTest-784859172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d44449db-0dde-408f-a74c-756afe848992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:33 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-cbfa076a-2856-44ad-9396-f157f76f7d2b tempest-CinderUnicodeTest-784859172 None] Volume cf2794dc-0eba-4f06-8ff7-b68531386aaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf2794dc-0eba-4f06-8ff7-b68531386aaf', 'volume_size': 1} Jul 08 18:57:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-cbfa076a-2856-44ad-9396-f157f76f7d2b tempest-CinderUnicodeTest-784859172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-a1e7c517-2e99-4f41-974a-b48ac315b708 tempest-CreateVolumesFromImageTest-687116459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-714bb8d1-10c4-4c40-b518-8d0a0c9e63f2 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:33 devstack sudo[104635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-714bb8d1-10c4-4c40-b518-8d0a0c9e63f2 Jul 08 18:57:33 devstack sudo[104635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:33 devstack sudo[104626]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b1807417-b83f-4e30-9a5e-6d55582a18ec tempest-CreateVolumesFromSnapshotTest-202843157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cf841f53-ae69-415b-a18a-8613b270e125" returned: 0 in 0.852s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:33 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b1807417-b83f-4e30-9a5e-6d55582a18ec tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "cinder-quobyte-cf841f53-ae69-415b-a18a-8613b270e125" released by "delete_volume" :: held 1.844s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:33 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-b1807417-b83f-4e30-9a5e-6d55582a18ec tempest-CreateVolumesFromSnapshotTest-202843157 None] Created reservations ['dbcb8221-8da3-4d4d-bd37-df6756dfd6d2', '2dca0863-4099-4841-9c30-494c8d8748dc', 'fcb52758-340b-4c4b-9701-3847d3b8167d', 'fc28c826-e913-4594-8e0e-0413a2e79943'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:57:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b1807417-b83f-4e30-9a5e-6d55582a18ec tempest-CreateVolumesFromSnapshotTest-202843157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b1807417-b83f-4e30-9a5e-6d55582a18ec tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:33 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b1807417-b83f-4e30-9a5e-6d55582a18ec tempest-CreateVolumesFromSnapshotTest-202843157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:33 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b1807417-b83f-4e30-9a5e-6d55582a18ec tempest-CreateVolumesFromSnapshotTest-202843157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b1807417-b83f-4e30-9a5e-6d55582a18ec tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b1807417-b83f-4e30-9a5e-6d55582a18ec tempest-CreateVolumesFromSnapshotTest-202843157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:33 devstack sudo[104640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:57:33 devstack sudo[104640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:34 devstack sudo[104628]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:34 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-babb113c-f98d-47ba-b309-2564f781eba8 tempest-CreateVolumesFromSnapshotTest-202843157 None] Acquiring lock "cinder-349364ed-be44-4349-b6d2-afb1daa53c88-delete_snapshot" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dbf63a9d-9f6d-4408-aac6-2078e1200466 tempest-VolumeDependencyTests-1321967090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a56282f-de69-4d61-835e-5ab241a6b719" returned: 0 in 0.963s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dbf63a9d-9f6d-4408-aac6-2078e1200466 tempest-VolumeDependencyTests-1321967090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a56282f-de69-4d61-835e-5ab241a6b719 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:34 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-babb113c-f98d-47ba-b309-2564f781eba8 tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "cinder-349364ed-be44-4349-b6d2-afb1daa53c88-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:34 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-babb113c-f98d-47ba-b309-2564f781eba8 tempest-CreateVolumesFromSnapshotTest-202843157 None] Acquiring lock "cinder-quobyte-10e47c5a-6525-47f1-aca8-8672ada2f3f5" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:34 devstack sudo[104642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a56282f-de69-4d61-835e-5ab241a6b719 Jul 08 18:57:34 devstack sudo[104642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:34 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-babb113c-f98d-47ba-b309-2564f781eba8 tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "cinder-quobyte-10e47c5a-6525-47f1-aca8-8672ada2f3f5" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:34 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-babb113c-f98d-47ba-b309-2564f781eba8 tempest-CreateVolumesFromSnapshotTest-202843157 None] Acquiring lock "cinder-quobyte-349364ed-be44-4349-b6d2-afb1daa53c88" by "_delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:34 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-babb113c-f98d-47ba-b309-2564f781eba8 tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "cinder-quobyte-349364ed-be44-4349-b6d2-afb1daa53c88" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:34 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-babb113c-f98d-47ba-b309-2564f781eba8 tempest-CreateVolumesFromSnapshotTest-202843157 None] Deleting offline snapshot 349364ed-be44-4349-b6d2-afb1daa53c88 of volume 10e47c5a-6525-47f1-aca8-8672ada2f3f5 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:57:34 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-babb113c-f98d-47ba-b309-2564f781eba8 tempest-CreateVolumesFromSnapshotTest-202843157 None] snapshot_file for this snap is: volume-10e47c5a-6525-47f1-aca8-8672ada2f3f5.349364ed-be44-4349-b6d2-afb1daa53c88 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:57:34 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[7936fd61-71f3-4659-9040-b1010876560d]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-babb113c-f98d-47ba-b309-2564f781eba8 tempest-CreateVolumesFromSnapshotTest-202843157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-10e47c5a-6525-47f1-aca8-8672ada2f3f5.349364ed-be44-4349-b6d2-afb1daa53c88 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:34 devstack sudo[104644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-10e47c5a-6525-47f1-aca8-8672ada2f3f5.349364ed-be44-4349-b6d2-afb1daa53c88 Jul 08 18:57:34 devstack sudo[104644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:34 devstack sudo[104635]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-a1e7c517-2e99-4f41-974a-b48ac315b708 tempest-CreateVolumesFromImageTest-687116459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-714bb8d1-10c4-4c40-b518-8d0a0c9e63f2" returned: 0 in 0.807s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:34 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-a1e7c517-2e99-4f41-974a-b48ac315b708 tempest-CreateVolumesFromImageTest-687116459 None] <== create_volume: return (1979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:57:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-a1e7c517-2e99-4f41-974a-b48ac315b708 tempest-CreateVolumesFromImageTest-687116459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.982s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-87dd0277-881c-46b9-bcaf-eb8cc4b3fe68 tempest-CreateVolumesFromImageTest-687116459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.775s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:34 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-87dd0277-881c-46b9-bcaf-eb8cc4b3fe68 tempest-CreateVolumesFromImageTest-687116459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-690642402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d748e16-f019-456e-a4fc-22ba40e1f160,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='386f13f78ef14b719c3078e32e912fe2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:57:29Z,use_quota=True,user_id='e0de4e62b3474ea29dc64088832deb4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:57:34 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-87dd0277-881c-46b9-bcaf-eb8cc4b3fe68 tempest-CreateVolumesFromImageTest-687116459 None] Creating volume 1d748e16-f019-456e-a4fc-22ba40e1f160 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:57:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-87dd0277-881c-46b9-bcaf-eb8cc4b3fe68 tempest-CreateVolumesFromImageTest-687116459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-87dd0277-881c-46b9-bcaf-eb8cc4b3fe68 tempest-CreateVolumesFromImageTest-687116459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:34 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-87dd0277-881c-46b9-bcaf-eb8cc4b3fe68 tempest-CreateVolumesFromImageTest-687116459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:34 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-87dd0277-881c-46b9-bcaf-eb8cc4b3fe68 tempest-CreateVolumesFromImageTest-687116459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-87dd0277-881c-46b9-bcaf-eb8cc4b3fe68 tempest-CreateVolumesFromImageTest-687116459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:34 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-87dd0277-881c-46b9-bcaf-eb8cc4b3fe68 tempest-CreateVolumesFromImageTest-687116459 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:57:34 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-87dd0277-881c-46b9-bcaf-eb8cc4b3fe68 tempest-CreateVolumesFromImageTest-687116459 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:57:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-87dd0277-881c-46b9-bcaf-eb8cc4b3fe68 tempest-CreateVolumesFromImageTest-687116459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-1d748e16-f019-456e-a4fc-22ba40e1f160 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:34 devstack sudo[104647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-1d748e16-f019-456e-a4fc-22ba40e1f160 1073741824 Jul 08 18:57:34 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-a1e7c517-2e99-4f41-974a-b48ac315b708 tempest-CreateVolumesFromImageTest-687116459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8ff8dcb-b1d2-4bce-8cab-747b126d2462) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-714bb8d1-10c4-4c40-b518-8d0a0c9e63f2', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:34 devstack sudo[104647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:34 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-a1e7c517-2e99-4f41-974a-b48ac315b708 tempest-CreateVolumesFromImageTest-687116459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7672b5e-cc9e-444a-b118-4ba1b07d5325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:34 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-a1e7c517-2e99-4f41-974a-b48ac315b708 tempest-CreateVolumesFromImageTest-687116459 None] Volume volume-714bb8d1-10c4-4c40-b518-8d0a0c9e63f2 (714bb8d1-10c4-4c40-b518-8d0a0c9e63f2): created successfully Jul 08 18:57:34 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-a1e7c517-2e99-4f41-974a-b48ac315b708 tempest-CreateVolumesFromImageTest-687116459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7672b5e-cc9e-444a-b118-4ba1b07d5325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:34 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-a1e7c517-2e99-4f41-974a-b48ac315b708 tempest-CreateVolumesFromImageTest-687116459 None] Flow 'volume_create_manager' (94c9c34d-1343-4c75-bcc2-997b8ac0c317) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:57:34 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-a1e7c517-2e99-4f41-974a-b48ac315b708 tempest-CreateVolumesFromImageTest-687116459 None] Created volume successfully. Jul 08 18:57:34 devstack sudo[104640]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b1807417-b83f-4e30-9a5e-6d55582a18ec tempest-CreateVolumesFromSnapshotTest-202843157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.881s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:34 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-b1807417-b83f-4e30-9a5e-6d55582a18ec tempest-CreateVolumesFromSnapshotTest-202843157 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:57:34 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-b1807417-b83f-4e30-9a5e-6d55582a18ec tempest-CreateVolumesFromSnapshotTest-202843157 None] Deleted volume successfully. Jul 08 18:57:34 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b1807417-b83f-4e30-9a5e-6d55582a18ec tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "cinder-cf841f53-ae69-415b-a18a-8613b270e125-delete_volume" released by "delete_volume" :: held 2.975s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:34 devstack sudo[104642]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dbf63a9d-9f6d-4408-aac6-2078e1200466 tempest-VolumeDependencyTests-1321967090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5a56282f-de69-4d61-835e-5ab241a6b719" returned: 0 in 0.767s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:34 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-dbf63a9d-9f6d-4408-aac6-2078e1200466 tempest-VolumeDependencyTests-1321967090 None] Lock "cinder-quobyte-5a56282f-de69-4d61-835e-5ab241a6b719" released by "delete_volume" :: held 1.867s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:34 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-dbf63a9d-9f6d-4408-aac6-2078e1200466 tempest-VolumeDependencyTests-1321967090 None] Created reservations ['2321107c-32bf-4943-a9f2-d8b952363896', '13690a1f-303b-43d0-b9af-7f704643a787', 'b5815499-8658-44dc-9673-0f1ed7106f0d', 'aebe9188-8a8c-4f3c-be62-155bc9326b47'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:57:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-dbf63a9d-9f6d-4408-aac6-2078e1200466 tempest-VolumeDependencyTests-1321967090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-dbf63a9d-9f6d-4408-aac6-2078e1200466 tempest-VolumeDependencyTests-1321967090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:35 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-dbf63a9d-9f6d-4408-aac6-2078e1200466 tempest-VolumeDependencyTests-1321967090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:35 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-dbf63a9d-9f6d-4408-aac6-2078e1200466 tempest-VolumeDependencyTests-1321967090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-dbf63a9d-9f6d-4408-aac6-2078e1200466 tempest-VolumeDependencyTests-1321967090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dbf63a9d-9f6d-4408-aac6-2078e1200466 tempest-VolumeDependencyTests-1321967090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:35 devstack sudo[104654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:57:35 devstack sudo[104654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:35 devstack sudo[104644]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:35 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-21dd205e-7fed-4eb3-9862-bb810c113ea8 tempest-VolumeDependencyTests-1321967090 None] Acquiring lock "cinder-7db732b1-cc7a-4238-a7a8-6650b389986c-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-babb113c-f98d-47ba-b309-2564f781eba8 tempest-CreateVolumesFromSnapshotTest-202843157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-10e47c5a-6525-47f1-aca8-8672ada2f3f5.349364ed-be44-4349-b6d2-afb1daa53c88" returned: 0 in 0.932s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:35 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-babb113c-f98d-47ba-b309-2564f781eba8 tempest-CreateVolumesFromSnapshotTest-202843157 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10e47c5a-6525-47f1-aca8-8672ada2f3f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:57:35 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-21dd205e-7fed-4eb3-9862-bb810c113ea8 tempest-VolumeDependencyTests-1321967090 None] Lock "cinder-7db732b1-cc7a-4238-a7a8-6650b389986c-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:35 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[114c6f60-33ed-4976-977f-24199e24f4e4]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-babb113c-f98d-47ba-b309-2564f781eba8 tempest-CreateVolumesFromSnapshotTest-202843157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-10e47c5a-6525-47f1-aca8-8672ada2f3f5 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:35 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-21dd205e-7fed-4eb3-9862-bb810c113ea8 tempest-VolumeDependencyTests-1321967090 None] Acquiring lock "cinder-quobyte-7db732b1-cc7a-4238-a7a8-6650b389986c" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:35 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-21dd205e-7fed-4eb3-9862-bb810c113ea8 tempest-VolumeDependencyTests-1321967090 None] Lock "cinder-quobyte-7db732b1-cc7a-4238-a7a8-6650b389986c" acquired by "delete_volume" :: waited 0.023s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:35 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c65085-3d32-48fb-b2cd-6476f0879a2d]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-21dd205e-7fed-4eb3-9862-bb810c113ea8 tempest-VolumeDependencyTests-1321967090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7db732b1-cc7a-4238-a7a8-6650b389986c {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:35 devstack sudo[104657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-10e47c5a-6525-47f1-aca8-8672ada2f3f5 Jul 08 18:57:35 devstack sudo[104657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:35 devstack sudo[104660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7db732b1-cc7a-4238-a7a8-6650b389986c Jul 08 18:57:35 devstack sudo[104660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:35 devstack sudo[104647]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-87dd0277-881c-46b9-bcaf-eb8cc4b3fe68 tempest-CreateVolumesFromImageTest-687116459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-1d748e16-f019-456e-a4fc-22ba40e1f160 1073741824" returned: 0 in 1.159s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-87dd0277-881c-46b9-bcaf-eb8cc4b3fe68 tempest-CreateVolumesFromImageTest-687116459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-1d748e16-f019-456e-a4fc-22ba40e1f160 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:35 devstack sudo[104664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-1d748e16-f019-456e-a4fc-22ba40e1f160 Jul 08 18:57:35 devstack sudo[104664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:35 devstack sudo[104654]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dbf63a9d-9f6d-4408-aac6-2078e1200466 tempest-VolumeDependencyTests-1321967090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.853s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:35 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-dbf63a9d-9f6d-4408-aac6-2078e1200466 tempest-VolumeDependencyTests-1321967090 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:57:35 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-dbf63a9d-9f6d-4408-aac6-2078e1200466 tempest-VolumeDependencyTests-1321967090 None] Deleted volume successfully. Jul 08 18:57:35 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-dbf63a9d-9f6d-4408-aac6-2078e1200466 tempest-VolumeDependencyTests-1321967090 None] Lock "cinder-5a56282f-de69-4d61-835e-5ab241a6b719-delete_volume" released by "delete_volume" :: held 3.010s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:36 devstack sudo[104657]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-babb113c-f98d-47ba-b309-2564f781eba8 tempest-CreateVolumesFromSnapshotTest-202843157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-10e47c5a-6525-47f1-aca8-8672ada2f3f5" returned: 0 in 0.853s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-babb113c-f98d-47ba-b309-2564f781eba8 tempest-CreateVolumesFromSnapshotTest-202843157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-10e47c5a-6525-47f1-aca8-8672ada2f3f5.349364ed-be44-4349-b6d2-afb1daa53c88 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:36 devstack sudo[104672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-10e47c5a-6525-47f1-aca8-8672ada2f3f5.349364ed-be44-4349-b6d2-afb1daa53c88 Jul 08 18:57:36 devstack sudo[104672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:36 devstack sudo[104660]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-21dd205e-7fed-4eb3-9862-bb810c113ea8 tempest-VolumeDependencyTests-1321967090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7db732b1-cc7a-4238-a7a8-6650b389986c" returned: 0 in 0.905s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-21dd205e-7fed-4eb3-9862-bb810c113ea8 tempest-VolumeDependencyTests-1321967090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7db732b1-cc7a-4238-a7a8-6650b389986c {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:36 devstack sudo[104675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7db732b1-cc7a-4238-a7a8-6650b389986c Jul 08 18:57:36 devstack sudo[104675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:36 devstack sudo[104664]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-87dd0277-881c-46b9-bcaf-eb8cc4b3fe68 tempest-CreateVolumesFromImageTest-687116459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-1d748e16-f019-456e-a4fc-22ba40e1f160" returned: 0 in 0.727s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:36 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-87dd0277-881c-46b9-bcaf-eb8cc4b3fe68 tempest-CreateVolumesFromImageTest-687116459 None] <== create_volume: return (1933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:57:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-87dd0277-881c-46b9-bcaf-eb8cc4b3fe68 tempest-CreateVolumesFromImageTest-687116459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.938s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-2ef24353-3a91-4329-b37c-a45e6574d544 tempest-CreateVolumesFromImageTest-687116459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.872s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:36 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-2ef24353-3a91-4329-b37c-a45e6574d544 tempest-CreateVolumesFromImageTest-687116459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-841123797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3a4d2b2-b4c2-4f85-94b1-01c6903e9cb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='386f13f78ef14b719c3078e32e912fe2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:57:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:57:30Z,use_quota=True,user_id='e0de4e62b3474ea29dc64088832deb4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:57:36 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-2ef24353-3a91-4329-b37c-a45e6574d544 tempest-CreateVolumesFromImageTest-687116459 None] Creating volume c3a4d2b2-b4c2-4f85-94b1-01c6903e9cb5 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:57:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-2ef24353-3a91-4329-b37c-a45e6574d544 tempest-CreateVolumesFromImageTest-687116459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-2ef24353-3a91-4329-b37c-a45e6574d544 tempest-CreateVolumesFromImageTest-687116459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:36 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-2ef24353-3a91-4329-b37c-a45e6574d544 tempest-CreateVolumesFromImageTest-687116459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:36 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-2ef24353-3a91-4329-b37c-a45e6574d544 tempest-CreateVolumesFromImageTest-687116459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-2ef24353-3a91-4329-b37c-a45e6574d544 tempest-CreateVolumesFromImageTest-687116459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:36 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-2ef24353-3a91-4329-b37c-a45e6574d544 tempest-CreateVolumesFromImageTest-687116459 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:57:36 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-2ef24353-3a91-4329-b37c-a45e6574d544 tempest-CreateVolumesFromImageTest-687116459 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:57:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2ef24353-3a91-4329-b37c-a45e6574d544 tempest-CreateVolumesFromImageTest-687116459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c3a4d2b2-b4c2-4f85-94b1-01c6903e9cb5 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:36 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-87dd0277-881c-46b9-bcaf-eb8cc4b3fe68 tempest-CreateVolumesFromImageTest-687116459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b60838e-e5ca-462e-8408-d228b9bc1216) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d748e16-f019-456e-a4fc-22ba40e1f160', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:36 devstack sudo[104678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c3a4d2b2-b4c2-4f85-94b1-01c6903e9cb5 1073741824 Jul 08 18:57:36 devstack sudo[104678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:36 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-87dd0277-881c-46b9-bcaf-eb8cc4b3fe68 tempest-CreateVolumesFromImageTest-687116459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a27db3f3-f6cd-46a2-8047-6d3f4a92b7e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:36 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-87dd0277-881c-46b9-bcaf-eb8cc4b3fe68 tempest-CreateVolumesFromImageTest-687116459 None] Volume volume-1d748e16-f019-456e-a4fc-22ba40e1f160 (1d748e16-f019-456e-a4fc-22ba40e1f160): created successfully Jul 08 18:57:36 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-87dd0277-881c-46b9-bcaf-eb8cc4b3fe68 tempest-CreateVolumesFromImageTest-687116459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a27db3f3-f6cd-46a2-8047-6d3f4a92b7e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:36 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-87dd0277-881c-46b9-bcaf-eb8cc4b3fe68 tempest-CreateVolumesFromImageTest-687116459 None] Flow 'volume_create_manager' (4d611118-2cfd-45b1-93de-decb2ee9711a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:57:36 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-87dd0277-881c-46b9-bcaf-eb8cc4b3fe68 tempest-CreateVolumesFromImageTest-687116459 None] Created volume successfully. Jul 08 18:57:36 devstack sudo[104672]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-babb113c-f98d-47ba-b309-2564f781eba8 tempest-CreateVolumesFromSnapshotTest-202843157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-10e47c5a-6525-47f1-aca8-8672ada2f3f5.349364ed-be44-4349-b6d2-afb1daa53c88" returned: 0 in 0.842s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-babb113c-f98d-47ba-b309-2564f781eba8 tempest-CreateVolumesFromSnapshotTest-202843157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-10e47c5a-6525-47f1-aca8-8672ada2f3f5.349364ed-be44-4349-b6d2-afb1daa53c88 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:36 devstack sudo[104685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-10e47c5a-6525-47f1-aca8-8672ada2f3f5.349364ed-be44-4349-b6d2-afb1daa53c88 Jul 08 18:57:36 devstack sudo[104685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:37 devstack sudo[104675]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-21dd205e-7fed-4eb3-9862-bb810c113ea8 tempest-VolumeDependencyTests-1321967090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7db732b1-cc7a-4238-a7a8-6650b389986c" returned: 0 in 0.776s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:37 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-21dd205e-7fed-4eb3-9862-bb810c113ea8 tempest-VolumeDependencyTests-1321967090 None] Lock "cinder-quobyte-7db732b1-cc7a-4238-a7a8-6650b389986c" released by "delete_volume" :: held 1.733s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:37 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-21dd205e-7fed-4eb3-9862-bb810c113ea8 tempest-VolumeDependencyTests-1321967090 None] Created reservations ['478d53f1-4d7e-44e5-9dca-54b882586276', '5c7f590e-29e9-40be-8f17-8a2fed4da3af', '275d9883-5c90-4cda-98a1-d8e64172813e', 'bcaed834-d8a7-4cf2-9c70-21dffe5b8967'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:57:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-21dd205e-7fed-4eb3-9862-bb810c113ea8 tempest-VolumeDependencyTests-1321967090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-21dd205e-7fed-4eb3-9862-bb810c113ea8 tempest-VolumeDependencyTests-1321967090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:37 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-21dd205e-7fed-4eb3-9862-bb810c113ea8 tempest-VolumeDependencyTests-1321967090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:37 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-21dd205e-7fed-4eb3-9862-bb810c113ea8 tempest-VolumeDependencyTests-1321967090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-21dd205e-7fed-4eb3-9862-bb810c113ea8 tempest-VolumeDependencyTests-1321967090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-21dd205e-7fed-4eb3-9862-bb810c113ea8 tempest-VolumeDependencyTests-1321967090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:37 devstack sudo[104690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:57:37 devstack sudo[104690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:37 devstack sudo[104678]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2ef24353-3a91-4329-b37c-a45e6574d544 tempest-CreateVolumesFromImageTest-687116459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c3a4d2b2-b4c2-4f85-94b1-01c6903e9cb5 1073741824" returned: 0 in 1.012s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2ef24353-3a91-4329-b37c-a45e6574d544 tempest-CreateVolumesFromImageTest-687116459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c3a4d2b2-b4c2-4f85-94b1-01c6903e9cb5 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:37 devstack sudo[104693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c3a4d2b2-b4c2-4f85-94b1-01c6903e9cb5 Jul 08 18:57:37 devstack sudo[104693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:37 devstack sudo[104685]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-babb113c-f98d-47ba-b309-2564f781eba8 tempest-CreateVolumesFromSnapshotTest-202843157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-10e47c5a-6525-47f1-aca8-8672ada2f3f5.349364ed-be44-4349-b6d2-afb1daa53c88" returned: 0 in 0.800s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:37 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-babb113c-f98d-47ba-b309-2564f781eba8 tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "cinder-quobyte-349364ed-be44-4349-b6d2-afb1daa53c88" released by "_delete_snapshot" :: held 3.624s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:37 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-babb113c-f98d-47ba-b309-2564f781eba8 tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "cinder-quobyte-10e47c5a-6525-47f1-aca8-8672ada2f3f5" released by "delete_snapshot" :: held 3.669s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:37 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-babb113c-f98d-47ba-b309-2564f781eba8 tempest-CreateVolumesFromSnapshotTest-202843157 None] Created reservations ['212e87f9-bc24-4369-ab0e-7a039110de07', 'bc756e56-e318-4c10-8234-37b1f4b292b0', 'cb901f0c-08a1-4b0c-9e94-3e37373a242a', '7684dc01-e551-4cdf-adfa-9edfd3e341a6'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:57:37 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-babb113c-f98d-47ba-b309-2564f781eba8 tempest-CreateVolumesFromSnapshotTest-202843157 None] Delete snapshot completed successfully. Jul 08 18:57:37 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-babb113c-f98d-47ba-b309-2564f781eba8 tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "cinder-349364ed-be44-4349-b6d2-afb1daa53c88-delete_snapshot" released by "delete_snapshot" :: held 3.854s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:38 devstack sudo[104690]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:38 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-21dd205e-7fed-4eb3-9862-bb810c113ea8 tempest-VolumeDependencyTests-1321967090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.929s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:38 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-21dd205e-7fed-4eb3-9862-bb810c113ea8 tempest-VolumeDependencyTests-1321967090 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:57:38 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-21dd205e-7fed-4eb3-9862-bb810c113ea8 tempest-VolumeDependencyTests-1321967090 None] Deleted volume successfully. Jul 08 18:57:38 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-21dd205e-7fed-4eb3-9862-bb810c113ea8 tempest-VolumeDependencyTests-1321967090 None] Lock "cinder-7db732b1-cc7a-4238-a7a8-6650b389986c-delete_volume" released by "delete_volume" :: held 2.945s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:38 devstack sudo[104693]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:38 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2ef24353-3a91-4329-b37c-a45e6574d544 tempest-CreateVolumesFromImageTest-687116459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c3a4d2b2-b4c2-4f85-94b1-01c6903e9cb5" returned: 0 in 0.816s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:38 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-2ef24353-3a91-4329-b37c-a45e6574d544 tempest-CreateVolumesFromImageTest-687116459 None] <== create_volume: return (1886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:57:38 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-2ef24353-3a91-4329-b37c-a45e6574d544 tempest-CreateVolumesFromImageTest-687116459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.891s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:38 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-ba13aeb5-7c5d-4630-83d4-7446ddfac70d tempest-CreateVolumesFromImageTest-687116459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.585s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:38 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-ba13aeb5-7c5d-4630-83d4-7446ddfac70d tempest-CreateVolumesFromImageTest-687116459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:57:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-602852067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1bd1c94-bbb0-493a-8118-d16d4641769f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='386f13f78ef14b719c3078e32e912fe2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:57:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:57:31Z,use_quota=True,user_id='e0de4e62b3474ea29dc64088832deb4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:57:38 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-ba13aeb5-7c5d-4630-83d4-7446ddfac70d tempest-CreateVolumesFromImageTest-687116459 None] Creating volume c1bd1c94-bbb0-493a-8118-d16d4641769f {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:57:38 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-ba13aeb5-7c5d-4630-83d4-7446ddfac70d tempest-CreateVolumesFromImageTest-687116459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:38 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-ba13aeb5-7c5d-4630-83d4-7446ddfac70d tempest-CreateVolumesFromImageTest-687116459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:38 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-ba13aeb5-7c5d-4630-83d4-7446ddfac70d tempest-CreateVolumesFromImageTest-687116459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:38 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-ba13aeb5-7c5d-4630-83d4-7446ddfac70d tempest-CreateVolumesFromImageTest-687116459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:38 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-ba13aeb5-7c5d-4630-83d4-7446ddfac70d tempest-CreateVolumesFromImageTest-687116459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:38 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-ba13aeb5-7c5d-4630-83d4-7446ddfac70d tempest-CreateVolumesFromImageTest-687116459 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:57:38 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-ba13aeb5-7c5d-4630-83d4-7446ddfac70d tempest-CreateVolumesFromImageTest-687116459 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:57:38 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ba13aeb5-7c5d-4630-83d4-7446ddfac70d tempest-CreateVolumesFromImageTest-687116459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c1bd1c94-bbb0-493a-8118-d16d4641769f 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:38 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2ef24353-3a91-4329-b37c-a45e6574d544 tempest-CreateVolumesFromImageTest-687116459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99a99408-1ca5-46fe-8682-75eb66ee31dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3a4d2b2-b4c2-4f85-94b1-01c6903e9cb5', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:38 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2ef24353-3a91-4329-b37c-a45e6574d544 tempest-CreateVolumesFromImageTest-687116459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5e3ee45-c36c-424d-933a-34395d706d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:38 devstack sudo[104698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c1bd1c94-bbb0-493a-8118-d16d4641769f 1073741824 Jul 08 18:57:38 devstack sudo[104698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:38 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-f2686fdd-cca2-4fc1-8825-48c6961138b0 tempest-CreateVolumesFromSnapshotTest-202843157 None] Acquiring lock "cinder-10e47c5a-6525-47f1-aca8-8672ada2f3f5-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:38 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-2ef24353-3a91-4329-b37c-a45e6574d544 tempest-CreateVolumesFromImageTest-687116459 None] Volume volume-c3a4d2b2-b4c2-4f85-94b1-01c6903e9cb5 (c3a4d2b2-b4c2-4f85-94b1-01c6903e9cb5): created successfully Jul 08 18:57:38 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2ef24353-3a91-4329-b37c-a45e6574d544 tempest-CreateVolumesFromImageTest-687116459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5e3ee45-c36c-424d-933a-34395d706d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:38 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2ef24353-3a91-4329-b37c-a45e6574d544 tempest-CreateVolumesFromImageTest-687116459 None] Flow 'volume_create_manager' (76c52be7-802a-41bb-bb64-5ff113076192) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:57:38 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-f2686fdd-cca2-4fc1-8825-48c6961138b0 tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "cinder-10e47c5a-6525-47f1-aca8-8672ada2f3f5-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:38 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-2ef24353-3a91-4329-b37c-a45e6574d544 tempest-CreateVolumesFromImageTest-687116459 None] Created volume successfully. Jul 08 18:57:38 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-f2686fdd-cca2-4fc1-8825-48c6961138b0 tempest-CreateVolumesFromSnapshotTest-202843157 None] Acquiring lock "cinder-quobyte-10e47c5a-6525-47f1-aca8-8672ada2f3f5" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:38 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-f2686fdd-cca2-4fc1-8825-48c6961138b0 tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "cinder-quobyte-10e47c5a-6525-47f1-aca8-8672ada2f3f5" acquired by "delete_volume" :: waited 0.018s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:38 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf43333-89ae-4e90-9260-0a740510a109]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:38 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f2686fdd-cca2-4fc1-8825-48c6961138b0 tempest-CreateVolumesFromSnapshotTest-202843157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-10e47c5a-6525-47f1-aca8-8672ada2f3f5 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:38 devstack sudo[104700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-10e47c5a-6525-47f1-aca8-8672ada2f3f5 Jul 08 18:57:38 devstack sudo[104700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:39 devstack sudo[104698]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:39 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ba13aeb5-7c5d-4630-83d4-7446ddfac70d tempest-CreateVolumesFromImageTest-687116459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c1bd1c94-bbb0-493a-8118-d16d4641769f 1073741824" returned: 0 in 1.088s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:39 devstack sudo[104700]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:39 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f2686fdd-cca2-4fc1-8825-48c6961138b0 tempest-CreateVolumesFromSnapshotTest-202843157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-10e47c5a-6525-47f1-aca8-8672ada2f3f5" returned: 0 in 0.896s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:39 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f2686fdd-cca2-4fc1-8825-48c6961138b0 tempest-CreateVolumesFromSnapshotTest-202843157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-10e47c5a-6525-47f1-aca8-8672ada2f3f5 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:39 devstack sudo[104709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-10e47c5a-6525-47f1-aca8-8672ada2f3f5 Jul 08 18:57:39 devstack sudo[104709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:39 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ba13aeb5-7c5d-4630-83d4-7446ddfac70d tempest-CreateVolumesFromImageTest-687116459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c1bd1c94-bbb0-493a-8118-d16d4641769f {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:39 devstack sudo[104711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c1bd1c94-bbb0-493a-8118-d16d4641769f Jul 08 18:57:39 devstack sudo[104711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:40 devstack sudo[104709]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f2686fdd-cca2-4fc1-8825-48c6961138b0 tempest-CreateVolumesFromSnapshotTest-202843157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-10e47c5a-6525-47f1-aca8-8672ada2f3f5" returned: 0 in 0.770s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:40 devstack sudo[104711]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ba13aeb5-7c5d-4630-83d4-7446ddfac70d tempest-CreateVolumesFromImageTest-687116459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c1bd1c94-bbb0-493a-8118-d16d4641769f" returned: 0 in 0.734s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:40 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-ba13aeb5-7c5d-4630-83d4-7446ddfac70d tempest-CreateVolumesFromImageTest-687116459 None] <== create_volume: return (1896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:57:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-ba13aeb5-7c5d-4630-83d4-7446ddfac70d tempest-CreateVolumesFromImageTest-687116459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.898s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:40 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-f2686fdd-cca2-4fc1-8825-48c6961138b0 tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "cinder-quobyte-10e47c5a-6525-47f1-aca8-8672ada2f3f5" released by "delete_volume" :: held 1.737s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-cbfa076a-2856-44ad-9396-f157f76f7d2b tempest-CinderUnicodeTest-784859172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.597s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:40 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-cbfa076a-2856-44ad-9396-f157f76f7d2b tempest-CinderUnicodeTest-784859172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:57:33Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-925219284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf2794dc-0eba-4f06-8ff7-b68531386aaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5abb279cda64e4fb678beeb1f38825c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:57:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:57:34Z,use_quota=True,user_id='c9761621dee14d778b41612f148bc882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:57:40 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-cbfa076a-2856-44ad-9396-f157f76f7d2b tempest-CinderUnicodeTest-784859172 None] Creating volume cf2794dc-0eba-4f06-8ff7-b68531386aaf {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:57:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-cbfa076a-2856-44ad-9396-f157f76f7d2b tempest-CinderUnicodeTest-784859172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-cbfa076a-2856-44ad-9396-f157f76f7d2b tempest-CinderUnicodeTest-784859172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:40 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-cbfa076a-2856-44ad-9396-f157f76f7d2b tempest-CinderUnicodeTest-784859172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:40 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-cbfa076a-2856-44ad-9396-f157f76f7d2b tempest-CinderUnicodeTest-784859172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-cbfa076a-2856-44ad-9396-f157f76f7d2b tempest-CinderUnicodeTest-784859172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:40 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-cbfa076a-2856-44ad-9396-f157f76f7d2b tempest-CinderUnicodeTest-784859172 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:57:40 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-cbfa076a-2856-44ad-9396-f157f76f7d2b tempest-CinderUnicodeTest-784859172 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:57:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-cbfa076a-2856-44ad-9396-f157f76f7d2b tempest-CinderUnicodeTest-784859172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cf2794dc-0eba-4f06-8ff7-b68531386aaf 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:40 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ba13aeb5-7c5d-4630-83d4-7446ddfac70d tempest-CreateVolumesFromImageTest-687116459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc89dc1b-e38f-4f28-9872-df4927344818) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1bd1c94-bbb0-493a-8118-d16d4641769f', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:40 devstack sudo[104715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cf2794dc-0eba-4f06-8ff7-b68531386aaf 1073741824 Jul 08 18:57:40 devstack sudo[104715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:40 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ba13aeb5-7c5d-4630-83d4-7446ddfac70d tempest-CreateVolumesFromImageTest-687116459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d6d4892-120a-4f53-83b9-4b1e8ac0dc4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:40 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-ba13aeb5-7c5d-4630-83d4-7446ddfac70d tempest-CreateVolumesFromImageTest-687116459 None] Volume volume-c1bd1c94-bbb0-493a-8118-d16d4641769f (c1bd1c94-bbb0-493a-8118-d16d4641769f): created successfully Jul 08 18:57:40 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ba13aeb5-7c5d-4630-83d4-7446ddfac70d tempest-CreateVolumesFromImageTest-687116459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d6d4892-120a-4f53-83b9-4b1e8ac0dc4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:40 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-ba13aeb5-7c5d-4630-83d4-7446ddfac70d tempest-CreateVolumesFromImageTest-687116459 None] Flow 'volume_create_manager' (4adbda82-a8db-47cf-b57e-0570e25f7609) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:57:40 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-ba13aeb5-7c5d-4630-83d4-7446ddfac70d tempest-CreateVolumesFromImageTest-687116459 None] Created volume successfully. Jul 08 18:57:40 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-f2686fdd-cca2-4fc1-8825-48c6961138b0 tempest-CreateVolumesFromSnapshotTest-202843157 None] Created reservations ['f60d0241-ef76-4f54-bb8d-af7b1f852e27', '016b6c8a-b1c8-41fd-94b6-eb24b3229bb8', '5314ad82-3c31-4bd6-b84d-6b728fc7a421', 'b2ef57ec-002a-49b3-9c12-21919896200e'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:57:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f2686fdd-cca2-4fc1-8825-48c6961138b0 tempest-CreateVolumesFromSnapshotTest-202843157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f2686fdd-cca2-4fc1-8825-48c6961138b0 tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:40 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-f2686fdd-cca2-4fc1-8825-48c6961138b0 tempest-CreateVolumesFromSnapshotTest-202843157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:40 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-f2686fdd-cca2-4fc1-8825-48c6961138b0 tempest-CreateVolumesFromSnapshotTest-202843157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f2686fdd-cca2-4fc1-8825-48c6961138b0 tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f2686fdd-cca2-4fc1-8825-48c6961138b0 tempest-CreateVolumesFromSnapshotTest-202843157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:40 devstack sudo[104717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:57:40 devstack sudo[104717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:41 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b8c93c20-561b-4311-9f5e-b721e596a590 tempest-CreateVolumesFromImageTest-687116459 None] Acquiring lock "cinder-c1bd1c94-bbb0-493a-8118-d16d4641769f-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:41 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b8c93c20-561b-4311-9f5e-b721e596a590 tempest-CreateVolumesFromImageTest-687116459 None] Lock "cinder-c1bd1c94-bbb0-493a-8118-d16d4641769f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:41 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b8c93c20-561b-4311-9f5e-b721e596a590 tempest-CreateVolumesFromImageTest-687116459 None] Acquiring lock "cinder-quobyte-c1bd1c94-bbb0-493a-8118-d16d4641769f" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:41 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b8c93c20-561b-4311-9f5e-b721e596a590 tempest-CreateVolumesFromImageTest-687116459 None] Lock "cinder-quobyte-c1bd1c94-bbb0-493a-8118-d16d4641769f" acquired by "delete_volume" :: waited 0.028s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:41 devstack sudo[104715]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-cbfa076a-2856-44ad-9396-f157f76f7d2b tempest-CinderUnicodeTest-784859172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cf2794dc-0eba-4f06-8ff7-b68531386aaf 1073741824" returned: 0 in 1.124s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:41 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3c5c35-506d-4df0-8d80-6b31321e5ab1]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b8c93c20-561b-4311-9f5e-b721e596a590 tempest-CreateVolumesFromImageTest-687116459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c1bd1c94-bbb0-493a-8118-d16d4641769f {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:41 devstack sudo[104717]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f2686fdd-cca2-4fc1-8825-48c6961138b0 tempest-CreateVolumesFromSnapshotTest-202843157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.985s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:41 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-f2686fdd-cca2-4fc1-8825-48c6961138b0 tempest-CreateVolumesFromSnapshotTest-202843157 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:57:41 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-f2686fdd-cca2-4fc1-8825-48c6961138b0 tempest-CreateVolumesFromSnapshotTest-202843157 None] Deleted volume successfully. Jul 08 18:57:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-cbfa076a-2856-44ad-9396-f157f76f7d2b tempest-CinderUnicodeTest-784859172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cf2794dc-0eba-4f06-8ff7-b68531386aaf {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:41 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-f2686fdd-cca2-4fc1-8825-48c6961138b0 tempest-CreateVolumesFromSnapshotTest-202843157 None] Lock "cinder-10e47c5a-6525-47f1-aca8-8672ada2f3f5-delete_volume" released by "delete_volume" :: held 3.062s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:41 devstack sudo[104725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cf2794dc-0eba-4f06-8ff7-b68531386aaf Jul 08 18:57:41 devstack sudo[104725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:41 devstack sudo[104724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c1bd1c94-bbb0-493a-8118-d16d4641769f Jul 08 18:57:41 devstack sudo[104724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:41 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c3b9212-b17b-49f6-838d-51a6b53dd5c9 tempest-ProjectMemberTests-704047872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:57:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3c3b9212-b17b-49f6-838d-51a6b53dd5c9 tempest-ProjectMemberTests-704047872 None] Flow 'volume_create_manager' (110f2852-00b6-4c0b-b795-68470e5fa04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:57:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3c3b9212-b17b-49f6-838d-51a6b53dd5c9 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef81c94e-56aa-49fb-af56-8bf5e6864f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3c3b9212-b17b-49f6-838d-51a6b53dd5c9 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef81c94e-56aa-49fb-af56-8bf5e6864f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:57:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-916480906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d293d45e-745c-440b-9c88-d871c227c724,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23f6feda0dc341ae9dff1be67ef4c54c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:57:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:57:42Z,use_quota=True,user_id='ebff52e9980446ed8de939cd8116db5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3c3b9212-b17b-49f6-838d-51a6b53dd5c9 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98160645-3629-40f0-be24-bdf15c94dac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3c3b9212-b17b-49f6-838d-51a6b53dd5c9 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98160645-3629-40f0-be24-bdf15c94dac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3c3b9212-b17b-49f6-838d-51a6b53dd5c9 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d210c64-3ae0-454a-b328-4250103feb2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3c3b9212-b17b-49f6-838d-51a6b53dd5c9 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d210c64-3ae0-454a-b328-4250103feb2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd293d45e-745c-440b-9c88-d871c227c724', 'volume_name': 'volume-d293d45e-745c-440b-9c88-d871c227c724', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3c3b9212-b17b-49f6-838d-51a6b53dd5c9 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e73039c4-2e64-4f35-8c95-5107b2b147ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3c3b9212-b17b-49f6-838d-51a6b53dd5c9 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e73039c4-2e64-4f35-8c95-5107b2b147ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3c3b9212-b17b-49f6-838d-51a6b53dd5c9 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2f46142-e88b-46e4-bb40-7ebc8c8c8c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:42 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-3c3b9212-b17b-49f6-838d-51a6b53dd5c9 tempest-ProjectMemberTests-704047872 None] Volume d293d45e-745c-440b-9c88-d871c227c724: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d293d45e-745c-440b-9c88-d871c227c724', 'volume_size': 1} Jul 08 18:57:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3c3b9212-b17b-49f6-838d-51a6b53dd5c9 tempest-ProjectMemberTests-704047872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:42 devstack sudo[104725]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-cbfa076a-2856-44ad-9396-f157f76f7d2b tempest-CinderUnicodeTest-784859172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cf2794dc-0eba-4f06-8ff7-b68531386aaf" returned: 0 in 0.857s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:42 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-cbfa076a-2856-44ad-9396-f157f76f7d2b tempest-CinderUnicodeTest-784859172 None] <== create_volume: return (2081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:57:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-cbfa076a-2856-44ad-9396-f157f76f7d2b tempest-CinderUnicodeTest-784859172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.085s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3c3b9212-b17b-49f6-838d-51a6b53dd5c9 tempest-ProjectMemberTests-704047872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.229s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:42 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-3c3b9212-b17b-49f6-838d-51a6b53dd5c9 tempest-ProjectMemberTests-704047872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:57:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-916480906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d293d45e-745c-440b-9c88-d871c227c724,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23f6feda0dc341ae9dff1be67ef4c54c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:57:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:57:42Z,use_quota=True,user_id='ebff52e9980446ed8de939cd8116db5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:57:42 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-3c3b9212-b17b-49f6-838d-51a6b53dd5c9 tempest-ProjectMemberTests-704047872 None] Creating volume d293d45e-745c-440b-9c88-d871c227c724 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:57:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3c3b9212-b17b-49f6-838d-51a6b53dd5c9 tempest-ProjectMemberTests-704047872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3c3b9212-b17b-49f6-838d-51a6b53dd5c9 tempest-ProjectMemberTests-704047872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:42 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-3c3b9212-b17b-49f6-838d-51a6b53dd5c9 tempest-ProjectMemberTests-704047872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:42 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-3c3b9212-b17b-49f6-838d-51a6b53dd5c9 tempest-ProjectMemberTests-704047872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3c3b9212-b17b-49f6-838d-51a6b53dd5c9 tempest-ProjectMemberTests-704047872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:42 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-3c3b9212-b17b-49f6-838d-51a6b53dd5c9 tempest-ProjectMemberTests-704047872 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:57:42 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-3c3b9212-b17b-49f6-838d-51a6b53dd5c9 tempest-ProjectMemberTests-704047872 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:57:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3c3b9212-b17b-49f6-838d-51a6b53dd5c9 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d293d45e-745c-440b-9c88-d871c227c724 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-cbfa076a-2856-44ad-9396-f157f76f7d2b tempest-CinderUnicodeTest-784859172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d44449db-0dde-408f-a74c-756afe848992) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf2794dc-0eba-4f06-8ff7-b68531386aaf', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-cbfa076a-2856-44ad-9396-f157f76f7d2b tempest-CinderUnicodeTest-784859172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7514e0ca-82c9-43f0-b3b9-5cb19516807f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:42 devstack sudo[104732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d293d45e-745c-440b-9c88-d871c227c724 1073741824 Jul 08 18:57:42 devstack sudo[104732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:42 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-cbfa076a-2856-44ad-9396-f157f76f7d2b tempest-CinderUnicodeTest-784859172 None] Volume volume-cf2794dc-0eba-4f06-8ff7-b68531386aaf (cf2794dc-0eba-4f06-8ff7-b68531386aaf): created successfully Jul 08 18:57:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-cbfa076a-2856-44ad-9396-f157f76f7d2b tempest-CinderUnicodeTest-784859172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7514e0ca-82c9-43f0-b3b9-5cb19516807f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-cbfa076a-2856-44ad-9396-f157f76f7d2b tempest-CinderUnicodeTest-784859172 None] Flow 'volume_create_manager' (84e53d6d-a867-41a0-94bf-3faac2da5443) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:57:42 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-cbfa076a-2856-44ad-9396-f157f76f7d2b tempest-CinderUnicodeTest-784859172 None] Created volume successfully. Jul 08 18:57:42 devstack sudo[104724]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b8c93c20-561b-4311-9f5e-b721e596a590 tempest-CreateVolumesFromImageTest-687116459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c1bd1c94-bbb0-493a-8118-d16d4641769f" returned: 0 in 1.128s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b8c93c20-561b-4311-9f5e-b721e596a590 tempest-CreateVolumesFromImageTest-687116459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c1bd1c94-bbb0-493a-8118-d16d4641769f {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:42 devstack sudo[104734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c1bd1c94-bbb0-493a-8118-d16d4641769f Jul 08 18:57:42 devstack sudo[104734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:43 devstack sudo[104734]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b8c93c20-561b-4311-9f5e-b721e596a590 tempest-CreateVolumesFromImageTest-687116459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c1bd1c94-bbb0-493a-8118-d16d4641769f" returned: 0 in 0.723s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:43 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b8c93c20-561b-4311-9f5e-b721e596a590 tempest-CreateVolumesFromImageTest-687116459 None] Lock "cinder-quobyte-c1bd1c94-bbb0-493a-8118-d16d4641769f" released by "delete_volume" :: held 1.930s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:43 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-b8c93c20-561b-4311-9f5e-b721e596a590 tempest-CreateVolumesFromImageTest-687116459 None] Created reservations ['553fc484-9433-448e-b9ad-a44b0da1467a', '0ed28202-1f9b-4503-b555-bfd3d3a05ac8', '93fe2fae-3330-42e9-a8a6-edd7980f37a8', 'd1e337f3-80d2-40a7-9389-068f555a4f69'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:57:43 devstack sudo[104732]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3c3b9212-b17b-49f6-838d-51a6b53dd5c9 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d293d45e-745c-440b-9c88-d871c227c724 1073741824" returned: 0 in 1.040s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3c3b9212-b17b-49f6-838d-51a6b53dd5c9 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d293d45e-745c-440b-9c88-d871c227c724 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b8c93c20-561b-4311-9f5e-b721e596a590 tempest-CreateVolumesFromImageTest-687116459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b8c93c20-561b-4311-9f5e-b721e596a590 tempest-CreateVolumesFromImageTest-687116459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:43 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b8c93c20-561b-4311-9f5e-b721e596a590 tempest-CreateVolumesFromImageTest-687116459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:43 devstack sudo[104742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d293d45e-745c-440b-9c88-d871c227c724 Jul 08 18:57:43 devstack sudo[104742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:43 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b8c93c20-561b-4311-9f5e-b721e596a590 tempest-CreateVolumesFromImageTest-687116459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b8c93c20-561b-4311-9f5e-b721e596a590 tempest-CreateVolumesFromImageTest-687116459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b8c93c20-561b-4311-9f5e-b721e596a590 tempest-CreateVolumesFromImageTest-687116459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:43 devstack sudo[104744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:57:43 devstack sudo[104744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:43 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-24243917-2eb1-41cc-96bc-658e2642af3e tempest-CreateVolumesFromImageTest-687116459 None] Acquiring lock "cinder-c3a4d2b2-b4c2-4f85-94b1-01c6903e9cb5-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:43 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-24243917-2eb1-41cc-96bc-658e2642af3e tempest-CreateVolumesFromImageTest-687116459 None] Lock "cinder-c3a4d2b2-b4c2-4f85-94b1-01c6903e9cb5-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-526ac01f-6fde-447e-911b-7e4c52f7140b tempest-CinderUnicodeTest-784859172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:43 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-24243917-2eb1-41cc-96bc-658e2642af3e tempest-CreateVolumesFromImageTest-687116459 None] Acquiring lock "cinder-quobyte-c3a4d2b2-b4c2-4f85-94b1-01c6903e9cb5" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:43 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-24243917-2eb1-41cc-96bc-658e2642af3e tempest-CreateVolumesFromImageTest-687116459 None] Lock "cinder-quobyte-c3a4d2b2-b4c2-4f85-94b1-01c6903e9cb5" acquired by "delete_volume" :: waited 0.025s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:43 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[39442901-5893-4f3d-9676-bcdd225ddbde]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-24243917-2eb1-41cc-96bc-658e2642af3e tempest-CreateVolumesFromImageTest-687116459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c3a4d2b2-b4c2-4f85-94b1-01c6903e9cb5 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:43 devstack sudo[104746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c3a4d2b2-b4c2-4f85-94b1-01c6903e9cb5 Jul 08 18:57:43 devstack sudo[104746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:44 devstack sudo[104742]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3c3b9212-b17b-49f6-838d-51a6b53dd5c9 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d293d45e-745c-440b-9c88-d871c227c724" returned: 0 in 0.813s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:44 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-3c3b9212-b17b-49f6-838d-51a6b53dd5c9 tempest-ProjectMemberTests-704047872 None] <== create_volume: return (1923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:57:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3c3b9212-b17b-49f6-838d-51a6b53dd5c9 tempest-ProjectMemberTests-704047872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.926s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-526ac01f-6fde-447e-911b-7e4c52f7140b tempest-CinderUnicodeTest-784859172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.541s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:44 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-526ac01f-6fde-447e-911b-7e4c52f7140b tempest-CinderUnicodeTest-784859172 None] Creating offline snapshot 9a9ab516-e826-450a-aa40-7b4651574d5f of volume cf2794dc-0eba-4f06-8ff7-b68531386aaf {{(pid=86873) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:57:44 devstack sudo[104744]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:44 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3c3b9212-b17b-49f6-838d-51a6b53dd5c9 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2f46142-e88b-46e4-bb40-7ebc8c8c8c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d293d45e-745c-440b-9c88-d871c227c724', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:44 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3c3b9212-b17b-49f6-838d-51a6b53dd5c9 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8d058f0-72f1-44e6-a514-d0ece7599aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:44 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff113d91-3fbd-48ad-88c6-f80edad247f0]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-526ac01f-6fde-447e-911b-7e4c52f7140b tempest-CinderUnicodeTest-784859172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cf2794dc-0eba-4f06-8ff7-b68531386aaf {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b8c93c20-561b-4311-9f5e-b721e596a590 tempest-CreateVolumesFromImageTest-687116459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.855s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:44 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-b8c93c20-561b-4311-9f5e-b721e596a590 tempest-CreateVolumesFromImageTest-687116459 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:57:44 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-b8c93c20-561b-4311-9f5e-b721e596a590 tempest-CreateVolumesFromImageTest-687116459 None] Deleted volume successfully. Jul 08 18:57:44 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-3c3b9212-b17b-49f6-838d-51a6b53dd5c9 tempest-ProjectMemberTests-704047872 None] Volume volume-d293d45e-745c-440b-9c88-d871c227c724 (d293d45e-745c-440b-9c88-d871c227c724): created successfully Jul 08 18:57:44 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3c3b9212-b17b-49f6-838d-51a6b53dd5c9 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8d058f0-72f1-44e6-a514-d0ece7599aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:44 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-3c3b9212-b17b-49f6-838d-51a6b53dd5c9 tempest-ProjectMemberTests-704047872 None] Flow 'volume_create_manager' (110f2852-00b6-4c0b-b795-68470e5fa04f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:57:44 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-3c3b9212-b17b-49f6-838d-51a6b53dd5c9 tempest-ProjectMemberTests-704047872 None] Created volume successfully. Jul 08 18:57:44 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b8c93c20-561b-4311-9f5e-b721e596a590 tempest-CreateVolumesFromImageTest-687116459 None] Lock "cinder-c1bd1c94-bbb0-493a-8118-d16d4641769f-delete_volume" released by "delete_volume" :: held 3.140s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:44 devstack sudo[104750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cf2794dc-0eba-4f06-8ff7-b68531386aaf Jul 08 18:57:44 devstack sudo[104750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:44 devstack sudo[104746]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-24243917-2eb1-41cc-96bc-658e2642af3e tempest-CreateVolumesFromImageTest-687116459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c3a4d2b2-b4c2-4f85-94b1-01c6903e9cb5" returned: 0 in 1.012s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-24243917-2eb1-41cc-96bc-658e2642af3e tempest-CreateVolumesFromImageTest-687116459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c3a4d2b2-b4c2-4f85-94b1-01c6903e9cb5 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:44 devstack sudo[104755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c3a4d2b2-b4c2-4f85-94b1-01c6903e9cb5 Jul 08 18:57:44 devstack sudo[104755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:45 devstack sudo[104750]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-526ac01f-6fde-447e-911b-7e4c52f7140b tempest-CinderUnicodeTest-784859172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cf2794dc-0eba-4f06-8ff7-b68531386aaf" returned: 0 in 0.888s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-526ac01f-6fde-447e-911b-7e4c52f7140b tempest-CinderUnicodeTest-784859172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cf2794dc-0eba-4f06-8ff7-b68531386aaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cf2794dc-0eba-4f06-8ff7-b68531386aaf.9a9ab516-e826-450a-aa40-7b4651574d5f 1G {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:45 devstack sudo[104760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cf2794dc-0eba-4f06-8ff7-b68531386aaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cf2794dc-0eba-4f06-8ff7-b68531386aaf.9a9ab516-e826-450a-aa40-7b4651574d5f 1G Jul 08 18:57:45 devstack sudo[104760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:45 devstack sudo[104755]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-24243917-2eb1-41cc-96bc-658e2642af3e tempest-CreateVolumesFromImageTest-687116459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c3a4d2b2-b4c2-4f85-94b1-01c6903e9cb5" returned: 0 in 0.758s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:45 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-24243917-2eb1-41cc-96bc-658e2642af3e tempest-CreateVolumesFromImageTest-687116459 None] Lock "cinder-quobyte-c3a4d2b2-b4c2-4f85-94b1-01c6903e9cb5" released by "delete_volume" :: held 1.835s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-0f73e10a-c02a-4635-bf25-b5988bbeb675 tempest-ProjectMemberTests-704047872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:45 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-24243917-2eb1-41cc-96bc-658e2642af3e tempest-CreateVolumesFromImageTest-687116459 None] Created reservations ['e88f0482-7e95-4084-a4f1-614b7858a7c1', '766288b8-d82b-4bb5-935e-090af429ffa7', '98a1ea9f-aad4-4789-b56f-b28a1f00443b', 'feceb0e0-6adb-42dc-ac6c-be9986f0f919'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:57:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-24243917-2eb1-41cc-96bc-658e2642af3e tempest-CreateVolumesFromImageTest-687116459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-24243917-2eb1-41cc-96bc-658e2642af3e tempest-CreateVolumesFromImageTest-687116459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:45 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-24243917-2eb1-41cc-96bc-658e2642af3e tempest-CreateVolumesFromImageTest-687116459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:45 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-24243917-2eb1-41cc-96bc-658e2642af3e tempest-CreateVolumesFromImageTest-687116459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-24243917-2eb1-41cc-96bc-658e2642af3e tempest-CreateVolumesFromImageTest-687116459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-24243917-2eb1-41cc-96bc-658e2642af3e tempest-CreateVolumesFromImageTest-687116459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:45 devstack sudo[104763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:57:45 devstack sudo[104763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:45 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-36f5992f-54b8-44de-bab7-880c8ceb728d tempest-CreateVolumesFromImageTest-687116459 None] Acquiring lock "cinder-1d748e16-f019-456e-a4fc-22ba40e1f160-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:46 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-36f5992f-54b8-44de-bab7-880c8ceb728d tempest-CreateVolumesFromImageTest-687116459 None] Lock "cinder-1d748e16-f019-456e-a4fc-22ba40e1f160-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:46 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-36f5992f-54b8-44de-bab7-880c8ceb728d tempest-CreateVolumesFromImageTest-687116459 None] Acquiring lock "cinder-quobyte-1d748e16-f019-456e-a4fc-22ba40e1f160" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:46 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-36f5992f-54b8-44de-bab7-880c8ceb728d tempest-CreateVolumesFromImageTest-687116459 None] Lock "cinder-quobyte-1d748e16-f019-456e-a4fc-22ba40e1f160" acquired by "delete_volume" :: waited 0.014s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:46 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e6de6e-6879-4f27-a2b5-c2e3e000cb2d]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-36f5992f-54b8-44de-bab7-880c8ceb728d tempest-CreateVolumesFromImageTest-687116459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-1d748e16-f019-456e-a4fc-22ba40e1f160 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:46 devstack sudo[104768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-1d748e16-f019-456e-a4fc-22ba40e1f160 Jul 08 18:57:46 devstack sudo[104768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:46 devstack sudo[104760]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-526ac01f-6fde-447e-911b-7e4c52f7140b tempest-CinderUnicodeTest-784859172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cf2794dc-0eba-4f06-8ff7-b68531386aaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cf2794dc-0eba-4f06-8ff7-b68531386aaf.9a9ab516-e826-450a-aa40-7b4651574d5f 1G" returned: 0 in 1.120s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-526ac01f-6fde-447e-911b-7e4c52f7140b tempest-CinderUnicodeTest-784859172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf2794dc-0eba-4f06-8ff7-b68531386aaf -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cf2794dc-0eba-4f06-8ff7-b68531386aaf.9a9ab516-e826-450a-aa40-7b4651574d5f {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:46 devstack sudo[104771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf2794dc-0eba-4f06-8ff7-b68531386aaf -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cf2794dc-0eba-4f06-8ff7-b68531386aaf.9a9ab516-e826-450a-aa40-7b4651574d5f Jul 08 18:57:46 devstack sudo[104771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:46 devstack sudo[104763]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-24243917-2eb1-41cc-96bc-658e2642af3e tempest-CreateVolumesFromImageTest-687116459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.804s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:46 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-24243917-2eb1-41cc-96bc-658e2642af3e tempest-CreateVolumesFromImageTest-687116459 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:57:46 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-24243917-2eb1-41cc-96bc-658e2642af3e tempest-CreateVolumesFromImageTest-687116459 None] Deleted volume successfully. Jul 08 18:57:46 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-24243917-2eb1-41cc-96bc-658e2642af3e tempest-CreateVolumesFromImageTest-687116459 None] Lock "cinder-c3a4d2b2-b4c2-4f85-94b1-01c6903e9cb5-delete_volume" released by "delete_volume" :: held 2.971s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:46 devstack sudo[104768]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-36f5992f-54b8-44de-bab7-880c8ceb728d tempest-CreateVolumesFromImageTest-687116459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-1d748e16-f019-456e-a4fc-22ba40e1f160" returned: 0 in 0.844s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-36f5992f-54b8-44de-bab7-880c8ceb728d tempest-CreateVolumesFromImageTest-687116459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-1d748e16-f019-456e-a4fc-22ba40e1f160 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:47 devstack sudo[104777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-1d748e16-f019-456e-a4fc-22ba40e1f160 Jul 08 18:57:47 devstack sudo[104777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:47 devstack sudo[104771]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-526ac01f-6fde-447e-911b-7e4c52f7140b tempest-CinderUnicodeTest-784859172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf2794dc-0eba-4f06-8ff7-b68531386aaf -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cf2794dc-0eba-4f06-8ff7-b68531386aaf.9a9ab516-e826-450a-aa40-7b4651574d5f" returned: 0 in 0.899s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:47 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-526ac01f-6fde-447e-911b-7e4c52f7140b tempest-CinderUnicodeTest-784859172 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cf2794dc-0eba-4f06-8ff7-b68531386aaf.9a9ab516-e826-450a-aa40-7b4651574d5f is being set with open permissions: ugo+rw Jul 08 18:57:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-526ac01f-6fde-447e-911b-7e4c52f7140b tempest-CinderUnicodeTest-784859172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cf2794dc-0eba-4f06-8ff7-b68531386aaf.9a9ab516-e826-450a-aa40-7b4651574d5f {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:47 devstack sudo[104783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cf2794dc-0eba-4f06-8ff7-b68531386aaf.9a9ab516-e826-450a-aa40-7b4651574d5f Jul 08 18:57:47 devstack sudo[104783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:47 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:57:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] Flow 'volume_create_manager' (20d9ccc5-cbbb-47b3-89d2-35456e5afe36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:57:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6895737a-7f68-403b-bbf9-76cfd2ea13cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6895737a-7f68-403b-bbf9-76cfd2ea13cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:57:47Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=273fdfd2-4a3f-4a26-97b9-b3304f86b282,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a01988ed2ee4456abd65a917576d7c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:57:47Z,use_quota=True,user_id='1d9a4c357fed4e79aa9ae6d22e7ded73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13686945-333d-4302-99cf-4f33a59335e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13686945-333d-4302-99cf-4f33a59335e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (850ea3cb-9ba4-49d5-8b4f-72225f010459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:47 devstack cinder-volume[86873]: DEBUG cinder.image.glance [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] Creating Keystone auth plugin from conf {{(pid=86873) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 18:57:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (850ea3cb-9ba4-49d5-8b4f-72225f010459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '273fdfd2-4a3f-4a26-97b9-b3304f86b282', 'volume_name': 'volume-273fdfd2-4a3f-4a26-97b9-b3304f86b282', 'volume_size': 1, 'image_id': 'f832758e-8657-4a6a-9c4d-572ab5cd832e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f832758e-8657-4a6a-9c4d-572ab5cd832e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f86305f40de5ddb28c909bdee33cf104', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0a01988ed2ee4456abd65a917576d7c8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b34cb22332863f6c1412ada25b144c1d5ae4e197ee4d10cafa8612ad13c7670ad7a2562c8fd20a66b716a5a3bce8c97b07dde3899684ea0aac1a93de0926f0f9', 'id': 'f832758e-8657-4a6a-9c4d-572ab5cd832e', 'created_at': datetime.datetime(2026, 7, 8, 16, 57, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 57, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f832758e-8657-4a6a-9c4d-572ab5cd832e/file', 'properties': {}}, 'image_service': }' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39e37dfe-b474-43b9-9c56-f19a01b9f70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:47 devstack sudo[104777]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39e37dfe-b474-43b9-9c56-f19a01b9f70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:47 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7823075-76f3-49df-b3ba-f5b167a30676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:47 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] Volume 273fdfd2-4a3f-4a26-97b9-b3304f86b282: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-273fdfd2-4a3f-4a26-97b9-b3304f86b282', 'volume_size': 1, 'image_id': 'f832758e-8657-4a6a-9c4d-572ab5cd832e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f832758e-8657-4a6a-9c4d-572ab5cd832e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f86305f40de5ddb28c909bdee33cf104', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0a01988ed2ee4456abd65a917576d7c8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b34cb22332863f6c1412ada25b144c1d5ae4e197ee4d10cafa8612ad13c7670ad7a2562c8fd20a66b716a5a3bce8c97b07dde3899684ea0aac1a93de0926f0f9', 'id': 'f832758e-8657-4a6a-9c4d-572ab5cd832e', 'created_at': datetime.datetime(2026, 7, 8, 16, 57, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 57, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f832758e-8657-4a6a-9c4d-572ab5cd832e/file', 'properties': {}}, 'image_service': } Jul 08 18:57:47 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] Trying to clone 273fdfd2-4a3f-4a26-97b9-b3304f86b282 from image f832758e-8657-4a6a-9c4d-572ab5cd832e at location (None, [{'url': 'file:///opt/stack/data/glance/images/f832758e-8657-4a6a-9c4d-572ab5cd832e', 'metadata': {}}]). {{(pid=86873) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 18:57:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-36f5992f-54b8-44de-bab7-880c8ceb728d tempest-CreateVolumesFromImageTest-687116459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-1d748e16-f019-456e-a4fc-22ba40e1f160" returned: 0 in 0.722s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:47 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-36f5992f-54b8-44de-bab7-880c8ceb728d tempest-CreateVolumesFromImageTest-687116459 None] Lock "cinder-quobyte-1d748e16-f019-456e-a4fc-22ba40e1f160" released by "delete_volume" :: held 1.614s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:47 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-36f5992f-54b8-44de-bab7-880c8ceb728d tempest-CreateVolumesFromImageTest-687116459 None] Created reservations ['d7ca348d-d60a-4f52-91ad-fc80fff0f4a4', '83de0a3a-9de2-4974-8248-247ce318957c', '12df5c0a-a203-4b34-a798-aafc70ad5838', '55d8c030-b7fb-4de9-9421-bf188f409d8c'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:57:47 devstack cinder-volume[86873]: DEBUG cinder.image.image_utils [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f832758e-8657-4a6a-9c4d-572ab5cd832e_4l61rf4_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86873) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 18:57:47 devstack cinder-volume[86873]: INFO cinder.image.image_utils [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] Image download 0.00 MB at 0.00 MB/s Jul 08 18:57:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-36f5992f-54b8-44de-bab7-880c8ceb728d tempest-CreateVolumesFromImageTest-687116459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-36f5992f-54b8-44de-bab7-880c8ceb728d tempest-CreateVolumesFromImageTest-687116459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:47 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-36f5992f-54b8-44de-bab7-880c8ceb728d tempest-CreateVolumesFromImageTest-687116459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:47 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-36f5992f-54b8-44de-bab7-880c8ceb728d tempest-CreateVolumesFromImageTest-687116459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-36f5992f-54b8-44de-bab7-880c8ceb728d tempest-CreateVolumesFromImageTest-687116459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-36f5992f-54b8-44de-bab7-880c8ceb728d tempest-CreateVolumesFromImageTest-687116459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:47 devstack sudo[104787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:57:47 devstack sudo[104787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:47 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[76601194-b408-43c3-bd72-a8ada38b0358]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f832758e-8657-4a6a-9c4d-572ab5cd832e_4l61rf4_devstack@QuobyteHD {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:47 devstack sudo[104783]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-526ac01f-6fde-447e-911b-7e4c52f7140b tempest-CinderUnicodeTest-784859172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cf2794dc-0eba-4f06-8ff7-b68531386aaf.9a9ab516-e826-450a-aa40-7b4651574d5f" returned: 0 in 0.686s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-526ac01f-6fde-447e-911b-7e4c52f7140b tempest-CinderUnicodeTest-784859172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cf2794dc-0eba-4f06-8ff7-b68531386aaf.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:48 devstack sudo[104789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f832758e-8657-4a6a-9c4d-572ab5cd832e_4l61rf4_devstack@QuobyteHD Jul 08 18:57:48 devstack sudo[104789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:48 devstack sudo[104790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cf2794dc-0eba-4f06-8ff7-b68531386aaf.info Jul 08 18:57:48 devstack sudo[104790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:48 devstack cinder-volume[86873]: DEBUG oslo_service.periodic_task [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86873) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:57:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:48 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-c2507b60-79a4-47fd-ad03-f08890d0a4a8 tempest-CreateVolumesFromImageTest-687116459 None] Acquiring lock "cinder-714bb8d1-10c4-4c40-b518-8d0a0c9e63f2-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:48 devstack sudo[104793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:57:48 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-c2507b60-79a4-47fd-ad03-f08890d0a4a8 tempest-CreateVolumesFromImageTest-687116459 None] Lock "cinder-714bb8d1-10c4-4c40-b518-8d0a0c9e63f2-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:48 devstack sudo[104793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:48 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-c2507b60-79a4-47fd-ad03-f08890d0a4a8 tempest-CreateVolumesFromImageTest-687116459 None] Acquiring lock "cinder-quobyte-714bb8d1-10c4-4c40-b518-8d0a0c9e63f2" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:48 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-c2507b60-79a4-47fd-ad03-f08890d0a4a8 tempest-CreateVolumesFromImageTest-687116459 None] Lock "cinder-quobyte-714bb8d1-10c4-4c40-b518-8d0a0c9e63f2" acquired by "delete_volume" :: waited 0.030s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:48 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee725522-011b-4793-8681-0322a3204271]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c2507b60-79a4-47fd-ad03-f08890d0a4a8 tempest-CreateVolumesFromImageTest-687116459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-714bb8d1-10c4-4c40-b518-8d0a0c9e63f2 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:48 devstack sudo[104795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-714bb8d1-10c4-4c40-b518-8d0a0c9e63f2 Jul 08 18:57:48 devstack sudo[104795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:48 devstack sudo[104787]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-36f5992f-54b8-44de-bab7-880c8ceb728d tempest-CreateVolumesFromImageTest-687116459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.862s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:48 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-36f5992f-54b8-44de-bab7-880c8ceb728d tempest-CreateVolumesFromImageTest-687116459 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:57:48 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-36f5992f-54b8-44de-bab7-880c8ceb728d tempest-CreateVolumesFromImageTest-687116459 None] Deleted volume successfully. Jul 08 18:57:48 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-36f5992f-54b8-44de-bab7-880c8ceb728d tempest-CreateVolumesFromImageTest-687116459 None] Lock "cinder-1d748e16-f019-456e-a4fc-22ba40e1f160-delete_volume" released by "delete_volume" :: held 2.760s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:48 devstack sudo[104789]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f832758e-8657-4a6a-9c4d-572ab5cd832e_4l61rf4_devstack@QuobyteHD" returned: 0 in 0.953s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f832758e-8657-4a6a-9c4d-572ab5cd832e_4l61rf4_devstack@QuobyteHD {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:48 devstack sudo[104790]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-526ac01f-6fde-447e-911b-7e4c52f7140b tempest-CinderUnicodeTest-784859172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cf2794dc-0eba-4f06-8ff7-b68531386aaf.info" returned: 0 in 0.887s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:48 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-526ac01f-6fde-447e-911b-7e4c52f7140b tempest-CinderUnicodeTest-784859172 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cf2794dc-0eba-4f06-8ff7-b68531386aaf.info is being set with open permissions: ugo+rw Jul 08 18:57:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-526ac01f-6fde-447e-911b-7e4c52f7140b tempest-CinderUnicodeTest-784859172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cf2794dc-0eba-4f06-8ff7-b68531386aaf.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:48 devstack sudo[104802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cf2794dc-0eba-4f06-8ff7-b68531386aaf.info Jul 08 18:57:48 devstack sudo[104802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:48 devstack sudo[104801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f832758e-8657-4a6a-9c4d-572ab5cd832e_4l61rf4_devstack@QuobyteHD Jul 08 18:57:48 devstack sudo[104801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:49 devstack sudo[104793]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.849s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:49 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:57:49 devstack cinder-volume[86873]: DEBUG oslo_service.periodic_task [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running periodic task VolumeManager._thread_info {{(pid=86873) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:57:49 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] thread count: 29 {{(pid=86873) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:57:49 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] thread info: [<_MainThread(MainThread, started 138577734545536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86873) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:57:49 devstack sudo[104795]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c2507b60-79a4-47fd-ad03-f08890d0a4a8 tempest-CreateVolumesFromImageTest-687116459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-714bb8d1-10c4-4c40-b518-8d0a0c9e63f2" returned: 0 in 0.934s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c2507b60-79a4-47fd-ad03-f08890d0a4a8 tempest-CreateVolumesFromImageTest-687116459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-714bb8d1-10c4-4c40-b518-8d0a0c9e63f2 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:49 devstack sudo[104809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-714bb8d1-10c4-4c40-b518-8d0a0c9e63f2 Jul 08 18:57:49 devstack sudo[104809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:49 devstack sudo[104802]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-526ac01f-6fde-447e-911b-7e4c52f7140b tempest-CinderUnicodeTest-784859172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cf2794dc-0eba-4f06-8ff7-b68531386aaf.info" returned: 0 in 0.722s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-526ac01f-6fde-447e-911b-7e4c52f7140b tempest-CinderUnicodeTest-784859172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.319s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-0f73e10a-c02a-4635-bf25-b5988bbeb675 tempest-ProjectMemberTests-704047872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.931s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:49 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-0f73e10a-c02a-4635-bf25-b5988bbeb675 tempest-ProjectMemberTests-704047872 None] Creating offline snapshot cf7db5e0-bb4d-4703-92e5-d3a263b5f744 of volume d293d45e-745c-440b-9c88-d871c227c724 {{(pid=86873) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:57:49 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-526ac01f-6fde-447e-911b-7e4c52f7140b tempest-CinderUnicodeTest-784859172 None] Create snapshot completed successfully Jul 08 18:57:49 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[9797676d-fb58-4968-9f88-aa309be917db]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-0f73e10a-c02a-4635-bf25-b5988bbeb675 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d293d45e-745c-440b-9c88-d871c227c724 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:49 devstack sudo[104801]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f832758e-8657-4a6a-9c4d-572ab5cd832e_4l61rf4_devstack@QuobyteHD" returned: 1 in 0.823s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f832758e-8657-4a6a-9c4d-572ab5cd832e_4l61rf4_devstack@QuobyteHD' failed. Not Retrying. {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:57:49 devstack cinder-volume[86873]: DEBUG cinder.image.image_utils [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] Temporary image f832758e-8657-4a6a-9c4d-572ab5cd832e is fetched for user 1d9a4c357fed4e79aa9ae6d22e7ded73. {{(pid=86873) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 18:57:49 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8052be-b8fd-4b66-94ad-0e679fcecabc]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f832758e-8657-4a6a-9c4d-572ab5cd832e_4l61rf4_devstack@QuobyteHD {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:49 devstack sudo[104815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d293d45e-745c-440b-9c88-d871c227c724 Jul 08 18:57:49 devstack sudo[104815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:49 devstack sudo[104816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f832758e-8657-4a6a-9c4d-572ab5cd832e_4l61rf4_devstack@QuobyteHD Jul 08 18:57:49 devstack sudo[104816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:50 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-c46a775d-d19f-41f6-a580-9e1d671ef544 tempest-CinderUnicodeTest-784859172 None] Acquiring lock "cinder-9a9ab516-e826-450a-aa40-7b4651574d5f-delete_snapshot" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:50 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-c46a775d-d19f-41f6-a580-9e1d671ef544 tempest-CinderUnicodeTest-784859172 None] Lock "cinder-9a9ab516-e826-450a-aa40-7b4651574d5f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:50 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-c46a775d-d19f-41f6-a580-9e1d671ef544 tempest-CinderUnicodeTest-784859172 None] Acquiring lock "cinder-quobyte-cf2794dc-0eba-4f06-8ff7-b68531386aaf" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:50 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-c46a775d-d19f-41f6-a580-9e1d671ef544 tempest-CinderUnicodeTest-784859172 None] Lock "cinder-quobyte-cf2794dc-0eba-4f06-8ff7-b68531386aaf" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:50 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-c46a775d-d19f-41f6-a580-9e1d671ef544 tempest-CinderUnicodeTest-784859172 None] Acquiring lock "cinder-quobyte-9a9ab516-e826-450a-aa40-7b4651574d5f" by "_delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:50 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-c46a775d-d19f-41f6-a580-9e1d671ef544 tempest-CinderUnicodeTest-784859172 None] Lock "cinder-quobyte-9a9ab516-e826-450a-aa40-7b4651574d5f" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:50 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-c46a775d-d19f-41f6-a580-9e1d671ef544 tempest-CinderUnicodeTest-784859172 None] Deleting offline snapshot 9a9ab516-e826-450a-aa40-7b4651574d5f of volume cf2794dc-0eba-4f06-8ff7-b68531386aaf {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:57:50 devstack sudo[104809]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:50 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-c46a775d-d19f-41f6-a580-9e1d671ef544 tempest-CinderUnicodeTest-784859172 None] snapshot_file for this snap is: volume-cf2794dc-0eba-4f06-8ff7-b68531386aaf.9a9ab516-e826-450a-aa40-7b4651574d5f {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:57:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c2507b60-79a4-47fd-ad03-f08890d0a4a8 tempest-CreateVolumesFromImageTest-687116459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-714bb8d1-10c4-4c40-b518-8d0a0c9e63f2" returned: 0 in 0.734s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:50 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19cce2a-642a-4433-b8f4-b428c4b2aaac]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c46a775d-d19f-41f6-a580-9e1d671ef544 tempest-CinderUnicodeTest-784859172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cf2794dc-0eba-4f06-8ff7-b68531386aaf.9a9ab516-e826-450a-aa40-7b4651574d5f {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:50 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-c2507b60-79a4-47fd-ad03-f08890d0a4a8 tempest-CreateVolumesFromImageTest-687116459 None] Lock "cinder-quobyte-714bb8d1-10c4-4c40-b518-8d0a0c9e63f2" released by "delete_volume" :: held 1.739s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:50 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-c2507b60-79a4-47fd-ad03-f08890d0a4a8 tempest-CreateVolumesFromImageTest-687116459 None] Created reservations ['a5712582-45eb-4d15-a5f7-213ace35e14d', '0a225c2c-ab49-44ce-98a4-ca2737b7feaf', 'bc5a28b9-ee87-48a9-8e8c-408e7a6572ba', '484a1409-2746-46d9-85e2-1311cc14d1bf'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:57:50 devstack sudo[104820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cf2794dc-0eba-4f06-8ff7-b68531386aaf.9a9ab516-e826-450a-aa40-7b4651574d5f Jul 08 18:57:50 devstack sudo[104820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c2507b60-79a4-47fd-ad03-f08890d0a4a8 tempest-CreateVolumesFromImageTest-687116459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c2507b60-79a4-47fd-ad03-f08890d0a4a8 tempest-CreateVolumesFromImageTest-687116459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:50 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c2507b60-79a4-47fd-ad03-f08890d0a4a8 tempest-CreateVolumesFromImageTest-687116459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:50 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c2507b60-79a4-47fd-ad03-f08890d0a4a8 tempest-CreateVolumesFromImageTest-687116459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c2507b60-79a4-47fd-ad03-f08890d0a4a8 tempest-CreateVolumesFromImageTest-687116459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c2507b60-79a4-47fd-ad03-f08890d0a4a8 tempest-CreateVolumesFromImageTest-687116459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:50 devstack sudo[104822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:57:50 devstack sudo[104822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:50 devstack sudo[104815]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-0f73e10a-c02a-4635-bf25-b5988bbeb675 tempest-ProjectMemberTests-704047872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d293d45e-745c-440b-9c88-d871c227c724" returned: 0 in 1.001s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-0f73e10a-c02a-4635-bf25-b5988bbeb675 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d293d45e-745c-440b-9c88-d871c227c724,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d293d45e-745c-440b-9c88-d871c227c724.cf7db5e0-bb4d-4703-92e5-d3a263b5f744 1G {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:50 devstack sudo[104816]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f832758e-8657-4a6a-9c4d-572ab5cd832e_4l61rf4_devstack@QuobyteHD" returned: 0 in 0.925s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f832758e-8657-4a6a-9c4d-572ab5cd832e_4l61rf4_devstack@QuobyteHD {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:50 devstack sudo[104829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d293d45e-745c-440b-9c88-d871c227c724,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d293d45e-745c-440b-9c88-d871c227c724.cf7db5e0-bb4d-4703-92e5-d3a263b5f744 1G Jul 08 18:57:50 devstack sudo[104829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:50 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-f45c8522-ca56-4548-af8a-35bc8b1ec2f9 tempest-CreateVolumesFromImageTest-687116459 None] Acquiring lock "cinder-b5e5cf6c-bd89-4dae-a961-fb18873aa234-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:50 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-f45c8522-ca56-4548-af8a-35bc8b1ec2f9 tempest-CreateVolumesFromImageTest-687116459 None] Lock "cinder-b5e5cf6c-bd89-4dae-a961-fb18873aa234-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:50 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-f45c8522-ca56-4548-af8a-35bc8b1ec2f9 tempest-CreateVolumesFromImageTest-687116459 None] Acquiring lock "cinder-quobyte-b5e5cf6c-bd89-4dae-a961-fb18873aa234" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:50 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-f45c8522-ca56-4548-af8a-35bc8b1ec2f9 tempest-CreateVolumesFromImageTest-687116459 None] Lock "cinder-quobyte-b5e5cf6c-bd89-4dae-a961-fb18873aa234" acquired by "delete_volume" :: waited 0.029s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:50 devstack sudo[104830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f832758e-8657-4a6a-9c4d-572ab5cd832e_4l61rf4_devstack@QuobyteHD Jul 08 18:57:50 devstack sudo[104830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:50 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[b854e6f8-11a0-44aa-8cb4-6ce41bb9046b]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f45c8522-ca56-4548-af8a-35bc8b1ec2f9 tempest-CreateVolumesFromImageTest-687116459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b5e5cf6c-bd89-4dae-a961-fb18873aa234 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:51 devstack sudo[104836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b5e5cf6c-bd89-4dae-a961-fb18873aa234 Jul 08 18:57:51 devstack sudo[104836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:51 devstack sudo[104820]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c46a775d-d19f-41f6-a580-9e1d671ef544 tempest-CinderUnicodeTest-784859172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cf2794dc-0eba-4f06-8ff7-b68531386aaf.9a9ab516-e826-450a-aa40-7b4651574d5f" returned: 0 in 0.962s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:51 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-c46a775d-d19f-41f6-a580-9e1d671ef544 tempest-CinderUnicodeTest-784859172 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf2794dc-0eba-4f06-8ff7-b68531386aaf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:57:51 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e028aa-d9bc-4866-b156-e78e86678708]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c46a775d-d19f-41f6-a580-9e1d671ef544 tempest-CinderUnicodeTest-784859172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cf2794dc-0eba-4f06-8ff7-b68531386aaf {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:51 devstack sudo[104822]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c2507b60-79a4-47fd-ad03-f08890d0a4a8 tempest-CreateVolumesFromImageTest-687116459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.894s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:51 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-c2507b60-79a4-47fd-ad03-f08890d0a4a8 tempest-CreateVolumesFromImageTest-687116459 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:57:51 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-c2507b60-79a4-47fd-ad03-f08890d0a4a8 tempest-CreateVolumesFromImageTest-687116459 None] Deleted volume successfully. Jul 08 18:57:51 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-c2507b60-79a4-47fd-ad03-f08890d0a4a8 tempest-CreateVolumesFromImageTest-687116459 None] Lock "cinder-714bb8d1-10c4-4c40-b518-8d0a0c9e63f2-delete_volume" released by "delete_volume" :: held 2.912s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:51 devstack sudo[104839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cf2794dc-0eba-4f06-8ff7-b68531386aaf Jul 08 18:57:51 devstack sudo[104839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:51 devstack sudo[104829]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-0f73e10a-c02a-4635-bf25-b5988bbeb675 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d293d45e-745c-440b-9c88-d871c227c724,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d293d45e-745c-440b-9c88-d871c227c724.cf7db5e0-bb4d-4703-92e5-d3a263b5f744 1G" returned: 0 in 0.943s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-0f73e10a-c02a-4635-bf25-b5988bbeb675 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d293d45e-745c-440b-9c88-d871c227c724 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d293d45e-745c-440b-9c88-d871c227c724.cf7db5e0-bb4d-4703-92e5-d3a263b5f744 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:51 devstack sudo[104848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d293d45e-745c-440b-9c88-d871c227c724 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d293d45e-745c-440b-9c88-d871c227c724.cf7db5e0-bb4d-4703-92e5-d3a263b5f744 Jul 08 18:57:51 devstack sudo[104848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:51 devstack sudo[104830]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f832758e-8657-4a6a-9c4d-572ab5cd832e_4l61rf4_devstack@QuobyteHD" returned: 1 in 1.050s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f832758e-8657-4a6a-9c4d-572ab5cd832e_4l61rf4_devstack@QuobyteHD' failed. Not Retrying. {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:57:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:51 devstack sudo[104836]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f45c8522-ca56-4548-af8a-35bc8b1ec2f9 tempest-CreateVolumesFromImageTest-687116459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b5e5cf6c-bd89-4dae-a961-fb18873aa234" returned: 0 in 0.892s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f45c8522-ca56-4548-af8a-35bc8b1ec2f9 tempest-CreateVolumesFromImageTest-687116459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b5e5cf6c-bd89-4dae-a961-fb18873aa234 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:51 devstack sudo[104853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b5e5cf6c-bd89-4dae-a961-fb18873aa234 Jul 08 18:57:51 devstack sudo[104853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:52 devstack sudo[104839]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c46a775d-d19f-41f6-a580-9e1d671ef544 tempest-CinderUnicodeTest-784859172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cf2794dc-0eba-4f06-8ff7-b68531386aaf" returned: 0 in 0.908s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c46a775d-d19f-41f6-a580-9e1d671ef544 tempest-CinderUnicodeTest-784859172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cf2794dc-0eba-4f06-8ff7-b68531386aaf.9a9ab516-e826-450a-aa40-7b4651574d5f {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:52 devstack sudo[104858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cf2794dc-0eba-4f06-8ff7-b68531386aaf.9a9ab516-e826-450a-aa40-7b4651574d5f Jul 08 18:57:52 devstack sudo[104858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:52 devstack sudo[104848]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-0f73e10a-c02a-4635-bf25-b5988bbeb675 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d293d45e-745c-440b-9c88-d871c227c724 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d293d45e-745c-440b-9c88-d871c227c724.cf7db5e0-bb4d-4703-92e5-d3a263b5f744" returned: 0 in 0.744s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:52 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-0f73e10a-c02a-4635-bf25-b5988bbeb675 tempest-ProjectMemberTests-704047872 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d293d45e-745c-440b-9c88-d871c227c724.cf7db5e0-bb4d-4703-92e5-d3a263b5f744 is being set with open permissions: ugo+rw Jul 08 18:57:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-0f73e10a-c02a-4635-bf25-b5988bbeb675 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d293d45e-745c-440b-9c88-d871c227c724.cf7db5e0-bb4d-4703-92e5-d3a263b5f744 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:52 devstack sudo[104863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d293d45e-745c-440b-9c88-d871c227c724.cf7db5e0-bb4d-4703-92e5-d3a263b5f744 Jul 08 18:57:52 devstack sudo[104863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:52 devstack sudo[104853]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f45c8522-ca56-4548-af8a-35bc8b1ec2f9 tempest-CreateVolumesFromImageTest-687116459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-b5e5cf6c-bd89-4dae-a961-fb18873aa234" returned: 0 in 0.682s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:52 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-f45c8522-ca56-4548-af8a-35bc8b1ec2f9 tempest-CreateVolumesFromImageTest-687116459 None] Lock "cinder-quobyte-b5e5cf6c-bd89-4dae-a961-fb18873aa234" released by "delete_volume" :: held 1.633s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:52 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-f45c8522-ca56-4548-af8a-35bc8b1ec2f9 tempest-CreateVolumesFromImageTest-687116459 None] Created reservations ['4b61b125-c7d5-40a7-9c03-64da75a22d58', '0b806741-f3f5-4df6-aa17-f825fccb266a', '37981f8b-573f-4084-9e10-99223c6c80d5', '39907ccb-a635-4a03-98e8-5e20f0fe38ab'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:57:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f45c8522-ca56-4548-af8a-35bc8b1ec2f9 tempest-CreateVolumesFromImageTest-687116459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f45c8522-ca56-4548-af8a-35bc8b1ec2f9 tempest-CreateVolumesFromImageTest-687116459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:52 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-f45c8522-ca56-4548-af8a-35bc8b1ec2f9 tempest-CreateVolumesFromImageTest-687116459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:52 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-f45c8522-ca56-4548-af8a-35bc8b1ec2f9 tempest-CreateVolumesFromImageTest-687116459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f45c8522-ca56-4548-af8a-35bc8b1ec2f9 tempest-CreateVolumesFromImageTest-687116459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f45c8522-ca56-4548-af8a-35bc8b1ec2f9 tempest-CreateVolumesFromImageTest-687116459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:52 devstack sudo[104867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:57:52 devstack sudo[104867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:52 devstack sudo[104858]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c46a775d-d19f-41f6-a580-9e1d671ef544 tempest-CinderUnicodeTest-784859172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cf2794dc-0eba-4f06-8ff7-b68531386aaf.9a9ab516-e826-450a-aa40-7b4651574d5f" returned: 0 in 0.809s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c46a775d-d19f-41f6-a580-9e1d671ef544 tempest-CinderUnicodeTest-784859172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cf2794dc-0eba-4f06-8ff7-b68531386aaf.9a9ab516-e826-450a-aa40-7b4651574d5f {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:52 devstack sudo[104872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cf2794dc-0eba-4f06-8ff7-b68531386aaf.9a9ab516-e826-450a-aa40-7b4651574d5f Jul 08 18:57:52 devstack sudo[104872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:53 devstack sudo[104863]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:53 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-0f73e10a-c02a-4635-bf25-b5988bbeb675 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d293d45e-745c-440b-9c88-d871c227c724.cf7db5e0-bb4d-4703-92e5-d3a263b5f744" returned: 0 in 0.692s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:53 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-0f73e10a-c02a-4635-bf25-b5988bbeb675 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d293d45e-745c-440b-9c88-d871c227c724.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:53 devstack sudo[104875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d293d45e-745c-440b-9c88-d871c227c724.info Jul 08 18:57:53 devstack sudo[104875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:53 devstack sudo[104867]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:53 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f45c8522-ca56-4548-af8a-35bc8b1ec2f9 tempest-CreateVolumesFromImageTest-687116459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.694s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:53 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-f45c8522-ca56-4548-af8a-35bc8b1ec2f9 tempest-CreateVolumesFromImageTest-687116459 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:57:53 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-f45c8522-ca56-4548-af8a-35bc8b1ec2f9 tempest-CreateVolumesFromImageTest-687116459 None] Deleted volume successfully. Jul 08 18:57:53 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-f45c8522-ca56-4548-af8a-35bc8b1ec2f9 tempest-CreateVolumesFromImageTest-687116459 None] Lock "cinder-b5e5cf6c-bd89-4dae-a961-fb18873aa234-delete_volume" released by "delete_volume" :: held 2.616s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:53 devstack sudo[104872]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:53 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c46a775d-d19f-41f6-a580-9e1d671ef544 tempest-CinderUnicodeTest-784859172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cf2794dc-0eba-4f06-8ff7-b68531386aaf.9a9ab516-e826-450a-aa40-7b4651574d5f" returned: 0 in 0.724s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:53 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-c46a775d-d19f-41f6-a580-9e1d671ef544 tempest-CinderUnicodeTest-784859172 None] Lock "cinder-quobyte-9a9ab516-e826-450a-aa40-7b4651574d5f" released by "_delete_snapshot" :: held 3.543s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:53 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-c46a775d-d19f-41f6-a580-9e1d671ef544 tempest-CinderUnicodeTest-784859172 None] Lock "cinder-quobyte-cf2794dc-0eba-4f06-8ff7-b68531386aaf" released by "delete_snapshot" :: held 3.576s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:53 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-c46a775d-d19f-41f6-a580-9e1d671ef544 tempest-CinderUnicodeTest-784859172 None] Created reservations ['2d6bfe41-654f-4e0f-9e5b-0546ce68628b', '3e74775a-4c1d-4a9b-8bae-f6ae3287ae0b', 'cd0a734c-63f6-4199-84a9-543c4209db3a', 'b36e00a0-ea53-4291-8888-97ee70613bcf'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:57:53 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-c46a775d-d19f-41f6-a580-9e1d671ef544 tempest-CinderUnicodeTest-784859172 None] Delete snapshot completed successfully. Jul 08 18:57:53 devstack sudo[104875]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:53 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-c46a775d-d19f-41f6-a580-9e1d671ef544 tempest-CinderUnicodeTest-784859172 None] Lock "cinder-9a9ab516-e826-450a-aa40-7b4651574d5f-delete_snapshot" released by "delete_snapshot" :: held 3.769s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:53 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-0f73e10a-c02a-4635-bf25-b5988bbeb675 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d293d45e-745c-440b-9c88-d871c227c724.info" returned: 0 in 0.741s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:53 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-0f73e10a-c02a-4635-bf25-b5988bbeb675 tempest-ProjectMemberTests-704047872 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d293d45e-745c-440b-9c88-d871c227c724.info is being set with open permissions: ugo+rw Jul 08 18:57:53 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-0f73e10a-c02a-4635-bf25-b5988bbeb675 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d293d45e-745c-440b-9c88-d871c227c724.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:53 devstack sudo[104880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d293d45e-745c-440b-9c88-d871c227c724.info Jul 08 18:57:53 devstack sudo[104880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:54 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-3edf9578-381a-4c03-9ee5-cad64288a6ed tempest-CinderUnicodeTest-784859172 None] Acquiring lock "cinder-cf2794dc-0eba-4f06-8ff7-b68531386aaf-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:54 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-3edf9578-381a-4c03-9ee5-cad64288a6ed tempest-CinderUnicodeTest-784859172 None] Lock "cinder-cf2794dc-0eba-4f06-8ff7-b68531386aaf-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:54 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-3edf9578-381a-4c03-9ee5-cad64288a6ed tempest-CinderUnicodeTest-784859172 None] Acquiring lock "cinder-quobyte-cf2794dc-0eba-4f06-8ff7-b68531386aaf" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:54 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-3edf9578-381a-4c03-9ee5-cad64288a6ed tempest-CinderUnicodeTest-784859172 None] Lock "cinder-quobyte-cf2794dc-0eba-4f06-8ff7-b68531386aaf" acquired by "delete_volume" :: waited 0.018s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:54 devstack sudo[104880]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-0f73e10a-c02a-4635-bf25-b5988bbeb675 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d293d45e-745c-440b-9c88-d871c227c724.info" returned: 0 in 0.708s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-0f73e10a-c02a-4635-bf25-b5988bbeb675 tempest-ProjectMemberTests-704047872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.933s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:54 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b2e38a-d4b3-4940-b3fd-4ce9fa8112fc]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.822s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:54 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:57:47Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=273fdfd2-4a3f-4a26-97b9-b3304f86b282,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a01988ed2ee4456abd65a917576d7c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:57:47Z,use_quota=True,user_id='1d9a4c357fed4e79aa9ae6d22e7ded73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:57:54 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] Creating volume 273fdfd2-4a3f-4a26-97b9-b3304f86b282 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:57:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:54 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:54 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:54 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:57:54 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:57:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-273fdfd2-4a3f-4a26-97b9-b3304f86b282 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3edf9578-381a-4c03-9ee5-cad64288a6ed tempest-CinderUnicodeTest-784859172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cf2794dc-0eba-4f06-8ff7-b68531386aaf {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:54 devstack sudo[104883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-273fdfd2-4a3f-4a26-97b9-b3304f86b282 1073741824 Jul 08 18:57:54 devstack sudo[104883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:54 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-0f73e10a-c02a-4635-bf25-b5988bbeb675 tempest-ProjectMemberTests-704047872 None] Create snapshot completed successfully Jul 08 18:57:54 devstack sudo[104884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cf2794dc-0eba-4f06-8ff7-b68531386aaf Jul 08 18:57:54 devstack sudo[104884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:55 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-71500a45-93a0-4e1f-b0a5-42f17a4b0c4c tempest-ProjectMemberTests-704047872 None] Acquiring lock "cinder-cf7db5e0-bb4d-4703-92e5-d3a263b5f744-delete_snapshot" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:55 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-71500a45-93a0-4e1f-b0a5-42f17a4b0c4c tempest-ProjectMemberTests-704047872 None] Lock "cinder-cf7db5e0-bb4d-4703-92e5-d3a263b5f744-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:55 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-71500a45-93a0-4e1f-b0a5-42f17a4b0c4c tempest-ProjectMemberTests-704047872 None] Acquiring lock "cinder-quobyte-d293d45e-745c-440b-9c88-d871c227c724" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:55 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-71500a45-93a0-4e1f-b0a5-42f17a4b0c4c tempest-ProjectMemberTests-704047872 None] Lock "cinder-quobyte-d293d45e-745c-440b-9c88-d871c227c724" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:55 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-71500a45-93a0-4e1f-b0a5-42f17a4b0c4c tempest-ProjectMemberTests-704047872 None] Acquiring lock "cinder-quobyte-cf7db5e0-bb4d-4703-92e5-d3a263b5f744" by "_delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:55 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-71500a45-93a0-4e1f-b0a5-42f17a4b0c4c tempest-ProjectMemberTests-704047872 None] Lock "cinder-quobyte-cf7db5e0-bb4d-4703-92e5-d3a263b5f744" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:55 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-71500a45-93a0-4e1f-b0a5-42f17a4b0c4c tempest-ProjectMemberTests-704047872 None] Deleting offline snapshot cf7db5e0-bb4d-4703-92e5-d3a263b5f744 of volume d293d45e-745c-440b-9c88-d871c227c724 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:57:55 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-71500a45-93a0-4e1f-b0a5-42f17a4b0c4c tempest-ProjectMemberTests-704047872 None] snapshot_file for this snap is: volume-d293d45e-745c-440b-9c88-d871c227c724.cf7db5e0-bb4d-4703-92e5-d3a263b5f744 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:57:55 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[f660301f-4240-424e-bab9-a37ba6451cdd]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-71500a45-93a0-4e1f-b0a5-42f17a4b0c4c tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d293d45e-745c-440b-9c88-d871c227c724.cf7db5e0-bb4d-4703-92e5-d3a263b5f744 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:55 devstack sudo[104890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d293d45e-745c-440b-9c88-d871c227c724.cf7db5e0-bb4d-4703-92e5-d3a263b5f744 Jul 08 18:57:55 devstack sudo[104890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:55 devstack sudo[104884]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3edf9578-381a-4c03-9ee5-cad64288a6ed tempest-CinderUnicodeTest-784859172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cf2794dc-0eba-4f06-8ff7-b68531386aaf" returned: 0 in 0.979s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3edf9578-381a-4c03-9ee5-cad64288a6ed tempest-CinderUnicodeTest-784859172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cf2794dc-0eba-4f06-8ff7-b68531386aaf {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:55 devstack sudo[104896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cf2794dc-0eba-4f06-8ff7-b68531386aaf Jul 08 18:57:55 devstack sudo[104896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:55 devstack sudo[104883]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-273fdfd2-4a3f-4a26-97b9-b3304f86b282 1073741824" returned: 0 in 1.039s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-273fdfd2-4a3f-4a26-97b9-b3304f86b282 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:55 devstack sudo[104898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-273fdfd2-4a3f-4a26-97b9-b3304f86b282 Jul 08 18:57:55 devstack sudo[104898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:56 devstack sudo[104890]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-71500a45-93a0-4e1f-b0a5-42f17a4b0c4c tempest-ProjectMemberTests-704047872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d293d45e-745c-440b-9c88-d871c227c724.cf7db5e0-bb4d-4703-92e5-d3a263b5f744" returned: 0 in 0.889s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:56 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-71500a45-93a0-4e1f-b0a5-42f17a4b0c4c tempest-ProjectMemberTests-704047872 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d293d45e-745c-440b-9c88-d871c227c724(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:57:56 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed35960b-cf66-488c-a273-db55d147f6f1]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-71500a45-93a0-4e1f-b0a5-42f17a4b0c4c tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d293d45e-745c-440b-9c88-d871c227c724 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:56 devstack sudo[104896]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3edf9578-381a-4c03-9ee5-cad64288a6ed tempest-CinderUnicodeTest-784859172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cf2794dc-0eba-4f06-8ff7-b68531386aaf" returned: 0 in 0.715s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:56 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-3edf9578-381a-4c03-9ee5-cad64288a6ed tempest-CinderUnicodeTest-784859172 None] Lock "cinder-quobyte-cf2794dc-0eba-4f06-8ff7-b68531386aaf" released by "delete_volume" :: held 1.801s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:56 devstack sudo[104904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d293d45e-745c-440b-9c88-d871c227c724 Jul 08 18:57:56 devstack sudo[104904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:56 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-3edf9578-381a-4c03-9ee5-cad64288a6ed tempest-CinderUnicodeTest-784859172 None] Created reservations ['f930d737-31a5-4b82-a61b-c9306db317f6', '3114cf03-d8a7-46ba-9048-6ed5264d29a5', '42f26f0d-66aa-42a4-a159-7c72930c1b62', 'd678a054-373f-452f-ba82-e1f5e119efa5'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:57:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3edf9578-381a-4c03-9ee5-cad64288a6ed tempest-CinderUnicodeTest-784859172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3edf9578-381a-4c03-9ee5-cad64288a6ed tempest-CinderUnicodeTest-784859172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:56 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-3edf9578-381a-4c03-9ee5-cad64288a6ed tempest-CinderUnicodeTest-784859172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:56 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-3edf9578-381a-4c03-9ee5-cad64288a6ed tempest-CinderUnicodeTest-784859172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-3edf9578-381a-4c03-9ee5-cad64288a6ed tempest-CinderUnicodeTest-784859172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3edf9578-381a-4c03-9ee5-cad64288a6ed tempest-CinderUnicodeTest-784859172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:56 devstack sudo[104907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:57:56 devstack sudo[104907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:56 devstack sudo[104898]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-273fdfd2-4a3f-4a26-97b9-b3304f86b282" returned: 0 in 0.888s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:56 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] <== create_volume: return (1981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:57:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.984s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:56 devstack cinder-volume[86873]: DEBUG cinder.volume.volume_utils [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] Attempting download of f832758e-8657-4a6a-9c4d-572ab5cd832e ((None, [{'url': 'file:///opt/stack/data/glance/images/f832758e-8657-4a6a-9c4d-572ab5cd832e', 'metadata': {}}])) to volume 273fdfd2-4a3f-4a26-97b9-b3304f86b282. {{(pid=86873) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 18:57:56 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9b45fd98-35ea-467b-98f2-b15bd745aa97 tempest-CinderUnicodeTest-784859172 None] Acquiring lock "cinder-e4a0d3e5-6577-49f7-9975-7ccd42000cca-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:56 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5065593-a7f5-493a-b270-9e32eb155d56]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f832758e-8657-4a6a-9c4d-572ab5cd832e_02yml9b5 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:56 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9b45fd98-35ea-467b-98f2-b15bd745aa97 tempest-CinderUnicodeTest-784859172 None] Lock "cinder-e4a0d3e5-6577-49f7-9975-7ccd42000cca-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:56 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9b45fd98-35ea-467b-98f2-b15bd745aa97 tempest-CinderUnicodeTest-784859172 None] Acquiring lock "cinder-quobyte-e4a0d3e5-6577-49f7-9975-7ccd42000cca" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:56 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9b45fd98-35ea-467b-98f2-b15bd745aa97 tempest-CinderUnicodeTest-784859172 None] Lock "cinder-quobyte-e4a0d3e5-6577-49f7-9975-7ccd42000cca" acquired by "delete_volume" :: waited 0.023s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:56 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[9761d0fd-52cc-466f-adf3-bd83765409b5]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9b45fd98-35ea-467b-98f2-b15bd745aa97 tempest-CinderUnicodeTest-784859172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e4a0d3e5-6577-49f7-9975-7ccd42000cca {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:56 devstack sudo[104909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f832758e-8657-4a6a-9c4d-572ab5cd832e_02yml9b5 Jul 08 18:57:56 devstack sudo[104909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:56 devstack sudo[104910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e4a0d3e5-6577-49f7-9975-7ccd42000cca Jul 08 18:57:56 devstack sudo[104910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:57 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-7a49c934-ae30-4ade-951a-22fdb3f7e4aa tempest-ProjectAdminTests-251560092 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.667579650879, 'free_capacity_gb': 1775.667579650879, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86873) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 08 18:57:57 devstack sudo[104904]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-71500a45-93a0-4e1f-b0a5-42f17a4b0c4c tempest-ProjectMemberTests-704047872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d293d45e-745c-440b-9c88-d871c227c724" returned: 0 in 0.886s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-71500a45-93a0-4e1f-b0a5-42f17a4b0c4c tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d293d45e-745c-440b-9c88-d871c227c724.cf7db5e0-bb4d-4703-92e5-d3a263b5f744 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:57 devstack sudo[104918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d293d45e-745c-440b-9c88-d871c227c724.cf7db5e0-bb4d-4703-92e5-d3a263b5f744 Jul 08 18:57:57 devstack sudo[104918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:57 devstack sudo[104907]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-3edf9578-381a-4c03-9ee5-cad64288a6ed tempest-CinderUnicodeTest-784859172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.778s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:57 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-3edf9578-381a-4c03-9ee5-cad64288a6ed tempest-CinderUnicodeTest-784859172 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:57:57 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-3edf9578-381a-4c03-9ee5-cad64288a6ed tempest-CinderUnicodeTest-784859172 None] Deleted volume successfully. Jul 08 18:57:57 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-3edf9578-381a-4c03-9ee5-cad64288a6ed tempest-CinderUnicodeTest-784859172 None] Lock "cinder-cf2794dc-0eba-4f06-8ff7-b68531386aaf-delete_volume" released by "delete_volume" :: held 2.869s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:57 devstack sudo[104909]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f832758e-8657-4a6a-9c4d-572ab5cd832e_02yml9b5" returned: 0 in 0.859s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f832758e-8657-4a6a-9c4d-572ab5cd832e_02yml9b5 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:57 devstack sudo[104922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f832758e-8657-4a6a-9c4d-572ab5cd832e_02yml9b5 Jul 08 18:57:57 devstack sudo[104922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:57 devstack sudo[104910]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9b45fd98-35ea-467b-98f2-b15bd745aa97 tempest-CinderUnicodeTest-784859172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e4a0d3e5-6577-49f7-9975-7ccd42000cca" returned: 0 in 0.927s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9b45fd98-35ea-467b-98f2-b15bd745aa97 tempest-CinderUnicodeTest-784859172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e4a0d3e5-6577-49f7-9975-7ccd42000cca {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:57 devstack sudo[104930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e4a0d3e5-6577-49f7-9975-7ccd42000cca Jul 08 18:57:57 devstack sudo[104930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:57 devstack sudo[104918]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-71500a45-93a0-4e1f-b0a5-42f17a4b0c4c tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d293d45e-745c-440b-9c88-d871c227c724.cf7db5e0-bb4d-4703-92e5-d3a263b5f744" returned: 0 in 0.880s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-71500a45-93a0-4e1f-b0a5-42f17a4b0c4c tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d293d45e-745c-440b-9c88-d871c227c724.cf7db5e0-bb4d-4703-92e5-d3a263b5f744 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:58 devstack sudo[104938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d293d45e-745c-440b-9c88-d871c227c724.cf7db5e0-bb4d-4703-92e5-d3a263b5f744 Jul 08 18:57:58 devstack sudo[104938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:58 devstack sudo[104922]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f832758e-8657-4a6a-9c4d-572ab5cd832e_02yml9b5" returned: 1 in 0.884s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f832758e-8657-4a6a-9c4d-572ab5cd832e_02yml9b5' failed. Not Retrying. {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:57:58 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc785b5-c910-47f8-9067-8f504817e049]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f832758e-8657-4a6a-9c4d-572ab5cd832e_4l61rf4_devstack@QuobyteHD {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:58 devstack sudo[104930]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9b45fd98-35ea-467b-98f2-b15bd745aa97 tempest-CinderUnicodeTest-784859172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e4a0d3e5-6577-49f7-9975-7ccd42000cca" returned: 0 in 0.813s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:58 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9b45fd98-35ea-467b-98f2-b15bd745aa97 tempest-CinderUnicodeTest-784859172 None] Lock "cinder-quobyte-e4a0d3e5-6577-49f7-9975-7ccd42000cca" released by "delete_volume" :: held 1.810s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:58 devstack sudo[104945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f832758e-8657-4a6a-9c4d-572ab5cd832e_4l61rf4_devstack@QuobyteHD Jul 08 18:57:58 devstack sudo[104945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:58 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-9b45fd98-35ea-467b-98f2-b15bd745aa97 tempest-CinderUnicodeTest-784859172 None] Created reservations ['3dc0c072-4b7e-46f5-81c0-1017b2dfe233', '11af7b96-e347-497b-aea1-93da2178d4ff', '55c4d851-568b-47d2-99e8-9ff57cf52bc0', '68eba03b-6ccf-4836-a823-12dfef581581'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:57:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-9b45fd98-35ea-467b-98f2-b15bd745aa97 tempest-CinderUnicodeTest-784859172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-9b45fd98-35ea-467b-98f2-b15bd745aa97 tempest-CinderUnicodeTest-784859172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:58 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-9b45fd98-35ea-467b-98f2-b15bd745aa97 tempest-CinderUnicodeTest-784859172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:58 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-9b45fd98-35ea-467b-98f2-b15bd745aa97 tempest-CinderUnicodeTest-784859172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-9b45fd98-35ea-467b-98f2-b15bd745aa97 tempest-CinderUnicodeTest-784859172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9b45fd98-35ea-467b-98f2-b15bd745aa97 tempest-CinderUnicodeTest-784859172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:58 devstack sudo[104948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:57:58 devstack sudo[104948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:58 devstack sudo[104938]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-71500a45-93a0-4e1f-b0a5-42f17a4b0c4c tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d293d45e-745c-440b-9c88-d871c227c724.cf7db5e0-bb4d-4703-92e5-d3a263b5f744" returned: 0 in 0.985s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:59 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-71500a45-93a0-4e1f-b0a5-42f17a4b0c4c tempest-ProjectMemberTests-704047872 None] Lock "cinder-quobyte-cf7db5e0-bb4d-4703-92e5-d3a263b5f744" released by "_delete_snapshot" :: held 3.779s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:59 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-71500a45-93a0-4e1f-b0a5-42f17a4b0c4c tempest-ProjectMemberTests-704047872 None] Lock "cinder-quobyte-d293d45e-745c-440b-9c88-d871c227c724" released by "delete_snapshot" :: held 3.809s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:59 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-71500a45-93a0-4e1f-b0a5-42f17a4b0c4c tempest-ProjectMemberTests-704047872 None] Created reservations ['20830642-373d-40b1-b2eb-1916b1d2f6bc', 'a00f1a31-634b-4f8c-a3c1-8df2aad19529', 'ac679a4e-f334-43b4-8610-b687357e23a2', '6686e42d-0354-442b-af69-7b7e08eef14a'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:57:59 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-71500a45-93a0-4e1f-b0a5-42f17a4b0c4c tempest-ProjectMemberTests-704047872 None] Delete snapshot completed successfully. Jul 08 18:57:59 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-71500a45-93a0-4e1f-b0a5-42f17a4b0c4c tempest-ProjectMemberTests-704047872 None] Lock "cinder-cf7db5e0-bb4d-4703-92e5-d3a263b5f744-delete_snapshot" released by "delete_snapshot" :: held 4.001s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:59 devstack sudo[104945]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f832758e-8657-4a6a-9c4d-572ab5cd832e_4l61rf4_devstack@QuobyteHD" returned: 0 in 1.091s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f832758e-8657-4a6a-9c4d-572ab5cd832e_4l61rf4_devstack@QuobyteHD {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:59 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-bcdf44b5-0982-4522-95e3-ac9eea2a0469 tempest-ProjectMemberTests-704047872 None] Acquiring lock "cinder-d293d45e-745c-440b-9c88-d871c227c724-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:59 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-bcdf44b5-0982-4522-95e3-ac9eea2a0469 tempest-ProjectMemberTests-704047872 None] Lock "cinder-d293d45e-745c-440b-9c88-d871c227c724-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:59 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-bcdf44b5-0982-4522-95e3-ac9eea2a0469 tempest-ProjectMemberTests-704047872 None] Acquiring lock "cinder-quobyte-d293d45e-745c-440b-9c88-d871c227c724" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:59 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-bcdf44b5-0982-4522-95e3-ac9eea2a0469 tempest-ProjectMemberTests-704047872 None] Lock "cinder-quobyte-d293d45e-745c-440b-9c88-d871c227c724" acquired by "delete_volume" :: waited 0.019s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:59 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[6098e35b-b6b4-40d4-b055-322b8bac7ab7]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-bcdf44b5-0982-4522-95e3-ac9eea2a0469 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d293d45e-745c-440b-9c88-d871c227c724 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:59 devstack sudo[104952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f832758e-8657-4a6a-9c4d-572ab5cd832e_4l61rf4_devstack@QuobyteHD Jul 08 18:57:59 devstack sudo[104952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:59 devstack sudo[104954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d293d45e-745c-440b-9c88-d871c227c724 Jul 08 18:57:59 devstack sudo[104954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:59 devstack sudo[104948]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9b45fd98-35ea-467b-98f2-b15bd745aa97 tempest-CinderUnicodeTest-784859172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 1.077s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:59 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-9b45fd98-35ea-467b-98f2-b15bd745aa97 tempest-CinderUnicodeTest-784859172 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:57:59 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-9b45fd98-35ea-467b-98f2-b15bd745aa97 tempest-CinderUnicodeTest-784859172 None] Deleted volume successfully. Jul 08 18:57:59 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9b45fd98-35ea-467b-98f2-b15bd745aa97 tempest-CinderUnicodeTest-784859172 None] Lock "cinder-e4a0d3e5-6577-49f7-9975-7ccd42000cca-delete_volume" released by "delete_volume" :: held 3.325s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:00 devstack sudo[104952]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f832758e-8657-4a6a-9c4d-572ab5cd832e_4l61rf4_devstack@QuobyteHD" returned: 1 in 1.082s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f832758e-8657-4a6a-9c4d-572ab5cd832e_4l61rf4_devstack@QuobyteHD' failed. Not Retrying. {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:58:00 devstack cinder-volume[86873]: DEBUG cinder.image.image_utils [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] f832758e-8657-4a6a-9c4d-572ab5cd832e was raw, converting to raw {{(pid=86873) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 18:58:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f832758e-8657-4a6a-9c4d-572ab5cd832e_4l61rf4_devstack@QuobyteHD /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-273fdfd2-4a3f-4a26-97b9-b3304f86b282 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:00 devstack sudo[104961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f832758e-8657-4a6a-9c4d-572ab5cd832e_4l61rf4_devstack@QuobyteHD /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-273fdfd2-4a3f-4a26-97b9-b3304f86b282 Jul 08 18:58:00 devstack sudo[104961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:00 devstack sudo[104954]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-bcdf44b5-0982-4522-95e3-ac9eea2a0469 tempest-ProjectMemberTests-704047872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d293d45e-745c-440b-9c88-d871c227c724" returned: 0 in 1.132s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-bcdf44b5-0982-4522-95e3-ac9eea2a0469 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d293d45e-745c-440b-9c88-d871c227c724 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:00 devstack sudo[104966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d293d45e-745c-440b-9c88-d871c227c724 Jul 08 18:58:00 devstack sudo[104966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:01 devstack sudo[104961]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f832758e-8657-4a6a-9c4d-572ab5cd832e_4l61rf4_devstack@QuobyteHD /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-273fdfd2-4a3f-4a26-97b9-b3304f86b282" returned: 0 in 0.922s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:01 devstack cinder-volume[86873]: DEBUG cinder.image.image_utils [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f832758e-8657-4a6a-9c4d-572ab5cd832e_4l61rf4_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-273fdfd2-4a3f-4a26-97b9-b3304f86b282 {{(pid=86873) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:58:01 devstack cinder-volume[86873]: INFO cinder.image.image_utils [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 18:58:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-273fdfd2-4a3f-4a26-97b9-b3304f86b282 1G {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:01 devstack sudo[104972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-273fdfd2-4a3f-4a26-97b9-b3304f86b282 1G Jul 08 18:58:01 devstack sudo[104972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:01 devstack sudo[104966]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-bcdf44b5-0982-4522-95e3-ac9eea2a0469 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d293d45e-745c-440b-9c88-d871c227c724" returned: 0 in 0.778s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:01 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-bcdf44b5-0982-4522-95e3-ac9eea2a0469 tempest-ProjectMemberTests-704047872 None] Lock "cinder-quobyte-d293d45e-745c-440b-9c88-d871c227c724" released by "delete_volume" :: held 2.005s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:01 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-bcdf44b5-0982-4522-95e3-ac9eea2a0469 tempest-ProjectMemberTests-704047872 None] Created reservations ['e7415164-70fe-4e53-b425-80fa7c1927e3', '2e9d596a-c890-4db0-9866-6e9d843f92cd', 'bef8ee57-c02e-49f2-9d71-160e2e147e03', 'e856b9f0-03e9-497b-aa21-d2d05633a4cf'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:58:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-bcdf44b5-0982-4522-95e3-ac9eea2a0469 tempest-ProjectMemberTests-704047872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-bcdf44b5-0982-4522-95e3-ac9eea2a0469 tempest-ProjectMemberTests-704047872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:01 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-bcdf44b5-0982-4522-95e3-ac9eea2a0469 tempest-ProjectMemberTests-704047872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:58:01 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-bcdf44b5-0982-4522-95e3-ac9eea2a0469 tempest-ProjectMemberTests-704047872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:58:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-bcdf44b5-0982-4522-95e3-ac9eea2a0469 tempest-ProjectMemberTests-704047872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-bcdf44b5-0982-4522-95e3-ac9eea2a0469 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:01 devstack sudo[104974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:58:01 devstack sudo[104974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:02 devstack sudo[104972]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-273fdfd2-4a3f-4a26-97b9-b3304f86b282 1G" returned: 0 in 1.017s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:02 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5e69f2-70bb-4f3a-9a28-c1e9651c61f6]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:58:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-273fdfd2-4a3f-4a26-97b9-b3304f86b282 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:02 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4d40881-acf9-4dec-bcc0-ebf872de5bc6 tempest-ProjectMemberTests-704047872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:58:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f4d40881-acf9-4dec-bcc0-ebf872de5bc6 tempest-ProjectMemberTests-704047872 None] Flow 'volume_create_manager' (b42b1b4f-a024-4aba-98ba-da2eeb9ff998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:58:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f4d40881-acf9-4dec-bcc0-ebf872de5bc6 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd8cb839-d045-4de7-bac1-82fd45994f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:02 devstack sudo[104974]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-bcdf44b5-0982-4522-95e3-ac9eea2a0469 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.929s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:02 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-bcdf44b5-0982-4522-95e3-ac9eea2a0469 tempest-ProjectMemberTests-704047872 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:58:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f4d40881-acf9-4dec-bcc0-ebf872de5bc6 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd8cb839-d045-4de7-bac1-82fd45994f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1700901520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfa810f1-819c-4221-8b27-196b57918325,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23f6feda0dc341ae9dff1be67ef4c54c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:58:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:58:03Z,use_quota=True,user_id='ebff52e9980446ed8de939cd8116db5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f4d40881-acf9-4dec-bcc0-ebf872de5bc6 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf5d146a-50a7-4836-b90f-1fd7f82ed77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:02 devstack sudo[104982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-273fdfd2-4a3f-4a26-97b9-b3304f86b282 Jul 08 18:58:02 devstack sudo[104982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f4d40881-acf9-4dec-bcc0-ebf872de5bc6 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf5d146a-50a7-4836-b90f-1fd7f82ed77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f4d40881-acf9-4dec-bcc0-ebf872de5bc6 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb23633e-818c-40c9-a2d4-5daabe4cfe64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f4d40881-acf9-4dec-bcc0-ebf872de5bc6 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb23633e-818c-40c9-a2d4-5daabe4cfe64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfa810f1-819c-4221-8b27-196b57918325', 'volume_name': 'volume-cfa810f1-819c-4221-8b27-196b57918325', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f4d40881-acf9-4dec-bcc0-ebf872de5bc6 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23270fc3-e3c4-4090-bd64-e06012bf65a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f4d40881-acf9-4dec-bcc0-ebf872de5bc6 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23270fc3-e3c4-4090-bd64-e06012bf65a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f4d40881-acf9-4dec-bcc0-ebf872de5bc6 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd0124f1-830d-43b5-8d59-48800212e0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:02 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-f4d40881-acf9-4dec-bcc0-ebf872de5bc6 tempest-ProjectMemberTests-704047872 None] Volume cfa810f1-819c-4221-8b27-196b57918325: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfa810f1-819c-4221-8b27-196b57918325', 'volume_size': 1} Jul 08 18:58:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f4d40881-acf9-4dec-bcc0-ebf872de5bc6 tempest-ProjectMemberTests-704047872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f4d40881-acf9-4dec-bcc0-ebf872de5bc6 tempest-ProjectMemberTests-704047872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:02 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-f4d40881-acf9-4dec-bcc0-ebf872de5bc6 tempest-ProjectMemberTests-704047872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1700901520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfa810f1-819c-4221-8b27-196b57918325,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23f6feda0dc341ae9dff1be67ef4c54c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:58:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:58:03Z,use_quota=True,user_id='ebff52e9980446ed8de939cd8116db5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:58:02 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-f4d40881-acf9-4dec-bcc0-ebf872de5bc6 tempest-ProjectMemberTests-704047872 None] Creating volume cfa810f1-819c-4221-8b27-196b57918325 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:58:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f4d40881-acf9-4dec-bcc0-ebf872de5bc6 tempest-ProjectMemberTests-704047872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f4d40881-acf9-4dec-bcc0-ebf872de5bc6 tempest-ProjectMemberTests-704047872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:02 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-f4d40881-acf9-4dec-bcc0-ebf872de5bc6 tempest-ProjectMemberTests-704047872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:58:02 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-f4d40881-acf9-4dec-bcc0-ebf872de5bc6 tempest-ProjectMemberTests-704047872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:58:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f4d40881-acf9-4dec-bcc0-ebf872de5bc6 tempest-ProjectMemberTests-704047872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:02 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-f4d40881-acf9-4dec-bcc0-ebf872de5bc6 tempest-ProjectMemberTests-704047872 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:58:02 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-f4d40881-acf9-4dec-bcc0-ebf872de5bc6 tempest-ProjectMemberTests-704047872 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:58:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f4d40881-acf9-4dec-bcc0-ebf872de5bc6 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cfa810f1-819c-4221-8b27-196b57918325 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:02 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-bcdf44b5-0982-4522-95e3-ac9eea2a0469 tempest-ProjectMemberTests-704047872 None] Deleted volume successfully. Jul 08 18:58:02 devstack sudo[104985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cfa810f1-819c-4221-8b27-196b57918325 1073741824 Jul 08 18:58:02 devstack sudo[104985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:02 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-bcdf44b5-0982-4522-95e3-ac9eea2a0469 tempest-ProjectMemberTests-704047872 None] Lock "cinder-d293d45e-745c-440b-9c88-d871c227c724-delete_volume" released by "delete_volume" :: held 3.338s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:02 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-648840ca-3d85-4121-bf00-b57820d0a768 tempest-ProjectReaderTests-482077113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:58:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-648840ca-3d85-4121-bf00-b57820d0a768 tempest-ProjectReaderTests-482077113 None] Flow 'volume_create_manager' (dc5841bf-53af-44dd-9000-18d995bd577a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:58:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-648840ca-3d85-4121-bf00-b57820d0a768 tempest-ProjectReaderTests-482077113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2120cc13-5eb7-4ca2-ae0d-6af3e256fbc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-648840ca-3d85-4121-bf00-b57820d0a768 tempest-ProjectReaderTests-482077113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2120cc13-5eb7-4ca2-ae0d-6af3e256fbc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1963273254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de8c026d-a3ea-4a78-961a-e8f09b2e5b10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2cb55a5f7d846cbb527b5bdd9e7ccd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:58:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:58:03Z,use_quota=True,user_id='9c785ac07168487b84ec55149a6baaf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-648840ca-3d85-4121-bf00-b57820d0a768 tempest-ProjectReaderTests-482077113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67acd650-a448-42b1-a58d-e10b3e68e394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-648840ca-3d85-4121-bf00-b57820d0a768 tempest-ProjectReaderTests-482077113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67acd650-a448-42b1-a58d-e10b3e68e394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-648840ca-3d85-4121-bf00-b57820d0a768 tempest-ProjectReaderTests-482077113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bec111d0-a6fc-4296-8e6c-d48a1eef49b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-648840ca-3d85-4121-bf00-b57820d0a768 tempest-ProjectReaderTests-482077113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bec111d0-a6fc-4296-8e6c-d48a1eef49b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de8c026d-a3ea-4a78-961a-e8f09b2e5b10', 'volume_name': 'volume-de8c026d-a3ea-4a78-961a-e8f09b2e5b10', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-648840ca-3d85-4121-bf00-b57820d0a768 tempest-ProjectReaderTests-482077113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d2f50da-7526-476b-ac52-45a24e2668d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-648840ca-3d85-4121-bf00-b57820d0a768 tempest-ProjectReaderTests-482077113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d2f50da-7526-476b-ac52-45a24e2668d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-648840ca-3d85-4121-bf00-b57820d0a768 tempest-ProjectReaderTests-482077113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc0b9abe-e887-4308-8276-933119af64f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:03 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-648840ca-3d85-4121-bf00-b57820d0a768 tempest-ProjectReaderTests-482077113 None] Volume de8c026d-a3ea-4a78-961a-e8f09b2e5b10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de8c026d-a3ea-4a78-961a-e8f09b2e5b10', 'volume_size': 1} Jul 08 18:58:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-648840ca-3d85-4121-bf00-b57820d0a768 tempest-ProjectReaderTests-482077113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:03 devstack sudo[104982]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-273fdfd2-4a3f-4a26-97b9-b3304f86b282" returned: 0 in 0.909s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-273fdfd2-4a3f-4a26-97b9-b3304f86b282 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:03 devstack sudo[104992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-273fdfd2-4a3f-4a26-97b9-b3304f86b282 Jul 08 18:58:03 devstack sudo[104992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:03 devstack sudo[104985]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f4d40881-acf9-4dec-bcc0-ebf872de5bc6 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cfa810f1-819c-4221-8b27-196b57918325 1073741824" returned: 0 in 0.997s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f4d40881-acf9-4dec-bcc0-ebf872de5bc6 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cfa810f1-819c-4221-8b27-196b57918325 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:03 devstack sudo[104995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cfa810f1-819c-4221-8b27-196b57918325 Jul 08 18:58:03 devstack sudo[104995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:04 devstack sudo[104992]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-273fdfd2-4a3f-4a26-97b9-b3304f86b282" returned: 1 in 0.859s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-273fdfd2-4a3f-4a26-97b9-b3304f86b282' failed. Not Retrying. {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:58:04 devstack cinder-volume[86873]: DEBUG cinder.volume.volume_utils [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] Downloaded image f832758e-8657-4a6a-9c4d-572ab5cd832e ((None, [{'url': 'file:///opt/stack/data/glance/images/f832758e-8657-4a6a-9c4d-572ab5cd832e', 'metadata': {}}])) to volume 273fdfd2-4a3f-4a26-97b9-b3304f86b282 successfully. {{(pid=86873) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 18:58:04 devstack cinder-volume[86873]: DEBUG cinder.image.image_utils [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] Temporary image f832758e-8657-4a6a-9c4d-572ab5cd832e for user 1d9a4c357fed4e79aa9ae6d22e7ded73 is deleted. {{(pid=86873) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 18:58:04 devstack cinder-volume[86873]: DEBUG cinder.volume.volume_utils [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] Marking volume 273fdfd2-4a3f-4a26-97b9-b3304f86b282 as bootable. {{(pid=86873) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 18:58:04 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] Copying metadata from image f832758e-8657-4a6a-9c4d-572ab5cd832e to 273fdfd2-4a3f-4a26-97b9-b3304f86b282. {{(pid=86873) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 18:58:04 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] Creating volume glance metadata for volume 273fdfd2-4a3f-4a26-97b9-b3304f86b282 backed by image f832758e-8657-4a6a-9c4d-572ab5cd832e with: {'image_id': 'f832758e-8657-4a6a-9c4d-572ab5cd832e', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'f86305f40de5ddb28c909bdee33cf104', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86873) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 18:58:04 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7823075-76f3-49df-b3ba-f5b167a30676) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-273fdfd2-4a3f-4a26-97b9-b3304f86b282', 'volume_size': 1, 'image_id': 'f832758e-8657-4a6a-9c4d-572ab5cd832e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f832758e-8657-4a6a-9c4d-572ab5cd832e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f86305f40de5ddb28c909bdee33cf104', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0a01988ed2ee4456abd65a917576d7c8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b34cb22332863f6c1412ada25b144c1d5ae4e197ee4d10cafa8612ad13c7670ad7a2562c8fd20a66b716a5a3bce8c97b07dde3899684ea0aac1a93de0926f0f9', 'id': 'f832758e-8657-4a6a-9c4d-572ab5cd832e', 'created_at': datetime.datetime(2026, 7, 8, 16, 57, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 57, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f832758e-8657-4a6a-9c4d-572ab5cd832e/file', 'properties': {}}, 'image_service': }' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:04 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aaa71d1-1808-4b0b-852f-29b603321fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:04 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] Volume volume-273fdfd2-4a3f-4a26-97b9-b3304f86b282 (273fdfd2-4a3f-4a26-97b9-b3304f86b282): created successfully Jul 08 18:58:04 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aaa71d1-1808-4b0b-852f-29b603321fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:04 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] Flow 'volume_create_manager' (20d9ccc5-cbbb-47b3-89d2-35456e5afe36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:58:04 devstack sudo[104995]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f4d40881-acf9-4dec-bcc0-ebf872de5bc6 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cfa810f1-819c-4221-8b27-196b57918325" returned: 0 in 0.676s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:04 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-f4d40881-acf9-4dec-bcc0-ebf872de5bc6 tempest-ProjectMemberTests-704047872 None] <== create_volume: return (1721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:58:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f4d40881-acf9-4dec-bcc0-ebf872de5bc6 tempest-ProjectMemberTests-704047872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.726s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-648840ca-3d85-4121-bf00-b57820d0a768 tempest-ProjectReaderTests-482077113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.489s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:04 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-648840ca-3d85-4121-bf00-b57820d0a768 tempest-ProjectReaderTests-482077113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1963273254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de8c026d-a3ea-4a78-961a-e8f09b2e5b10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2cb55a5f7d846cbb527b5bdd9e7ccd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:58:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:58:03Z,use_quota=True,user_id='9c785ac07168487b84ec55149a6baaf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:58:04 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-648840ca-3d85-4121-bf00-b57820d0a768 tempest-ProjectReaderTests-482077113 None] Creating volume de8c026d-a3ea-4a78-961a-e8f09b2e5b10 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:58:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-648840ca-3d85-4121-bf00-b57820d0a768 tempest-ProjectReaderTests-482077113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-648840ca-3d85-4121-bf00-b57820d0a768 tempest-ProjectReaderTests-482077113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:04 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-648840ca-3d85-4121-bf00-b57820d0a768 tempest-ProjectReaderTests-482077113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:58:04 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-648840ca-3d85-4121-bf00-b57820d0a768 tempest-ProjectReaderTests-482077113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:58:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-648840ca-3d85-4121-bf00-b57820d0a768 tempest-ProjectReaderTests-482077113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:04 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-648840ca-3d85-4121-bf00-b57820d0a768 tempest-ProjectReaderTests-482077113 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:58:04 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-648840ca-3d85-4121-bf00-b57820d0a768 tempest-ProjectReaderTests-482077113 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:58:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-648840ca-3d85-4121-bf00-b57820d0a768 tempest-ProjectReaderTests-482077113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de8c026d-a3ea-4a78-961a-e8f09b2e5b10 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:04 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-51a42a50-a208-4df5-9af3-da8d48c32ec0 tempest-VolumeImageDependencyTests-1188344448 None] Created volume successfully. Jul 08 18:58:04 devstack sudo[105001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de8c026d-a3ea-4a78-961a-e8f09b2e5b10 1073741824 Jul 08 18:58:04 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f4d40881-acf9-4dec-bcc0-ebf872de5bc6 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd0124f1-830d-43b5-8d59-48800212e0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfa810f1-819c-4221-8b27-196b57918325', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:04 devstack sudo[105001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:04 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f4d40881-acf9-4dec-bcc0-ebf872de5bc6 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c755904-81ef-433d-892d-02ee518c02e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:04 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-f4d40881-acf9-4dec-bcc0-ebf872de5bc6 tempest-ProjectMemberTests-704047872 None] Volume volume-cfa810f1-819c-4221-8b27-196b57918325 (cfa810f1-819c-4221-8b27-196b57918325): created successfully Jul 08 18:58:04 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f4d40881-acf9-4dec-bcc0-ebf872de5bc6 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c755904-81ef-433d-892d-02ee518c02e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:04 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-f4d40881-acf9-4dec-bcc0-ebf872de5bc6 tempest-ProjectMemberTests-704047872 None] Flow 'volume_create_manager' (b42b1b4f-a024-4aba-98ba-da2eeb9ff998) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:58:04 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-f4d40881-acf9-4dec-bcc0-ebf872de5bc6 tempest-ProjectMemberTests-704047872 None] Created volume successfully. Jul 08 18:58:04 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-4594fab0-836d-49f0-b3ac-c75e0a61bce2 tempest-VolumeImageDependencyTests-1188344448 None] Acquiring lock "cinder-273fdfd2-4a3f-4a26-97b9-b3304f86b282-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:58:04 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-4594fab0-836d-49f0-b3ac-c75e0a61bce2 tempest-VolumeImageDependencyTests-1188344448 None] Lock "cinder-273fdfd2-4a3f-4a26-97b9-b3304f86b282-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:58:05 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-4594fab0-836d-49f0-b3ac-c75e0a61bce2 tempest-VolumeImageDependencyTests-1188344448 None] Acquiring lock "cinder-quobyte-273fdfd2-4a3f-4a26-97b9-b3304f86b282" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:58:05 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-4594fab0-836d-49f0-b3ac-c75e0a61bce2 tempest-VolumeImageDependencyTests-1188344448 None] Lock "cinder-quobyte-273fdfd2-4a3f-4a26-97b9-b3304f86b282" acquired by "delete_volume" :: waited 0.019s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:58:05 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2296eb-70b3-412d-8fda-c41e188c545a]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:58:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-4594fab0-836d-49f0-b3ac-c75e0a61bce2 tempest-VolumeImageDependencyTests-1188344448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-273fdfd2-4a3f-4a26-97b9-b3304f86b282 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:05 devstack sudo[105003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-273fdfd2-4a3f-4a26-97b9-b3304f86b282 Jul 08 18:58:05 devstack sudo[105003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:05 devstack sudo[105001]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-648840ca-3d85-4121-bf00-b57820d0a768 tempest-ProjectReaderTests-482077113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de8c026d-a3ea-4a78-961a-e8f09b2e5b10 1073741824" returned: 0 in 0.992s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-648840ca-3d85-4121-bf00-b57820d0a768 tempest-ProjectReaderTests-482077113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de8c026d-a3ea-4a78-961a-e8f09b2e5b10 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:05 devstack sudo[105008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de8c026d-a3ea-4a78-961a-e8f09b2e5b10 Jul 08 18:58:05 devstack sudo[105008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1c894a1e-124c-41cf-9962-a5103b53fe19 tempest-ProjectMemberTests-704047872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:06 devstack sudo[105003]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-4594fab0-836d-49f0-b3ac-c75e0a61bce2 tempest-VolumeImageDependencyTests-1188344448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-273fdfd2-4a3f-4a26-97b9-b3304f86b282" returned: 0 in 1.019s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-4594fab0-836d-49f0-b3ac-c75e0a61bce2 tempest-VolumeImageDependencyTests-1188344448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-273fdfd2-4a3f-4a26-97b9-b3304f86b282 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:06 devstack sudo[105012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-273fdfd2-4a3f-4a26-97b9-b3304f86b282 Jul 08 18:58:06 devstack sudo[105012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:06 devstack sudo[105008]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-648840ca-3d85-4121-bf00-b57820d0a768 tempest-ProjectReaderTests-482077113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de8c026d-a3ea-4a78-961a-e8f09b2e5b10" returned: 0 in 0.887s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:06 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-648840ca-3d85-4121-bf00-b57820d0a768 tempest-ProjectReaderTests-482077113 None] <== create_volume: return (1932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:58:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-648840ca-3d85-4121-bf00-b57820d0a768 tempest-ProjectReaderTests-482077113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.938s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1c894a1e-124c-41cf-9962-a5103b53fe19 tempest-ProjectMemberTests-704047872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.487s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:06 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-1c894a1e-124c-41cf-9962-a5103b53fe19 tempest-ProjectMemberTests-704047872 None] Creating offline snapshot 945793c9-4c5e-45c8-99f6-1d2fb4673592 of volume cfa810f1-819c-4221-8b27-196b57918325 {{(pid=86873) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:58:06 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-648840ca-3d85-4121-bf00-b57820d0a768 tempest-ProjectReaderTests-482077113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc0b9abe-e887-4308-8276-933119af64f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de8c026d-a3ea-4a78-961a-e8f09b2e5b10', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:06 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-648840ca-3d85-4121-bf00-b57820d0a768 tempest-ProjectReaderTests-482077113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e65326c8-0730-4612-b25a-702df79bc4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:06 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[4086310f-67e9-4a82-a670-627b1f377a3b]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:58:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1c894a1e-124c-41cf-9962-a5103b53fe19 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cfa810f1-819c-4221-8b27-196b57918325 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:06 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-648840ca-3d85-4121-bf00-b57820d0a768 tempest-ProjectReaderTests-482077113 None] Volume volume-de8c026d-a3ea-4a78-961a-e8f09b2e5b10 (de8c026d-a3ea-4a78-961a-e8f09b2e5b10): created successfully Jul 08 18:58:06 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-648840ca-3d85-4121-bf00-b57820d0a768 tempest-ProjectReaderTests-482077113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e65326c8-0730-4612-b25a-702df79bc4c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:06 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-648840ca-3d85-4121-bf00-b57820d0a768 tempest-ProjectReaderTests-482077113 None] Flow 'volume_create_manager' (dc5841bf-53af-44dd-9000-18d995bd577a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:58:06 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-648840ca-3d85-4121-bf00-b57820d0a768 tempest-ProjectReaderTests-482077113 None] Created volume successfully. Jul 08 18:58:06 devstack sudo[105032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cfa810f1-819c-4221-8b27-196b57918325 Jul 08 18:58:06 devstack sudo[105032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:07 devstack sudo[105012]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-4594fab0-836d-49f0-b3ac-c75e0a61bce2 tempest-VolumeImageDependencyTests-1188344448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-273fdfd2-4a3f-4a26-97b9-b3304f86b282" returned: 1 in 0.968s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-4594fab0-836d-49f0-b3ac-c75e0a61bce2 tempest-VolumeImageDependencyTests-1188344448 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-273fdfd2-4a3f-4a26-97b9-b3304f86b282' failed. Not Retrying. {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:58:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-4594fab0-836d-49f0-b3ac-c75e0a61bce2 tempest-VolumeImageDependencyTests-1188344448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-273fdfd2-4a3f-4a26-97b9-b3304f86b282 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:07 devstack sudo[105057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-273fdfd2-4a3f-4a26-97b9-b3304f86b282 Jul 08 18:58:07 devstack sudo[105057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:07 devstack sudo[105032]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1c894a1e-124c-41cf-9962-a5103b53fe19 tempest-ProjectMemberTests-704047872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cfa810f1-819c-4221-8b27-196b57918325" returned: 0 in 1.010s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1c894a1e-124c-41cf-9962-a5103b53fe19 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cfa810f1-819c-4221-8b27-196b57918325,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cfa810f1-819c-4221-8b27-196b57918325.945793c9-4c5e-45c8-99f6-1d2fb4673592 1G {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:07 devstack sudo[105063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cfa810f1-819c-4221-8b27-196b57918325,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cfa810f1-819c-4221-8b27-196b57918325.945793c9-4c5e-45c8-99f6-1d2fb4673592 1G Jul 08 18:58:07 devstack sudo[105063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:07 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-e87b8f8f-2c22-4ae9-9aa8-760c90c6fe4a tempest-ProjectReaderTests-482077113 None] Acquiring lock "cinder-de8c026d-a3ea-4a78-961a-e8f09b2e5b10-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:58:07 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-e87b8f8f-2c22-4ae9-9aa8-760c90c6fe4a tempest-ProjectReaderTests-482077113 None] Lock "cinder-de8c026d-a3ea-4a78-961a-e8f09b2e5b10-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:58:07 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-e87b8f8f-2c22-4ae9-9aa8-760c90c6fe4a tempest-ProjectReaderTests-482077113 None] Acquiring lock "cinder-quobyte-de8c026d-a3ea-4a78-961a-e8f09b2e5b10" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:58:07 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-e87b8f8f-2c22-4ae9-9aa8-760c90c6fe4a tempest-ProjectReaderTests-482077113 None] Lock "cinder-quobyte-de8c026d-a3ea-4a78-961a-e8f09b2e5b10" acquired by "delete_volume" :: waited 0.017s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:58:07 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7103d9-3962-4a25-8c78-14493c593fea]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:58:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e87b8f8f-2c22-4ae9-9aa8-760c90c6fe4a tempest-ProjectReaderTests-482077113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de8c026d-a3ea-4a78-961a-e8f09b2e5b10 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:07 devstack sudo[105057]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-4594fab0-836d-49f0-b3ac-c75e0a61bce2 tempest-VolumeImageDependencyTests-1188344448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-273fdfd2-4a3f-4a26-97b9-b3304f86b282" returned: 0 in 0.894s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:07 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-4594fab0-836d-49f0-b3ac-c75e0a61bce2 tempest-VolumeImageDependencyTests-1188344448 None] Lock "cinder-quobyte-273fdfd2-4a3f-4a26-97b9-b3304f86b282" released by "delete_volume" :: held 2.957s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:08 devstack sudo[105066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de8c026d-a3ea-4a78-961a-e8f09b2e5b10 Jul 08 18:58:08 devstack sudo[105066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:08 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-4594fab0-836d-49f0-b3ac-c75e0a61bce2 tempest-VolumeImageDependencyTests-1188344448 None] Created reservations ['f1cfbe1c-685d-427a-a8d1-ad1f2efcc4b1', '83c345d3-f2e9-4059-9038-b973a7d9ac79', 'f1a5310b-ab52-4a8b-840e-448298d0d38f', '45b555d2-6648-45e6-8380-8d393d3f7b7b'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:58:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-4594fab0-836d-49f0-b3ac-c75e0a61bce2 tempest-VolumeImageDependencyTests-1188344448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-4594fab0-836d-49f0-b3ac-c75e0a61bce2 tempest-VolumeImageDependencyTests-1188344448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:08 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-4594fab0-836d-49f0-b3ac-c75e0a61bce2 tempest-VolumeImageDependencyTests-1188344448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:58:08 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-4594fab0-836d-49f0-b3ac-c75e0a61bce2 tempest-VolumeImageDependencyTests-1188344448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:58:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-4594fab0-836d-49f0-b3ac-c75e0a61bce2 tempest-VolumeImageDependencyTests-1188344448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-4594fab0-836d-49f0-b3ac-c75e0a61bce2 tempest-VolumeImageDependencyTests-1188344448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:08 devstack sudo[105068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:58:08 devstack sudo[105068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:08 devstack sudo[105063]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1c894a1e-124c-41cf-9962-a5103b53fe19 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cfa810f1-819c-4221-8b27-196b57918325,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cfa810f1-819c-4221-8b27-196b57918325.945793c9-4c5e-45c8-99f6-1d2fb4673592 1G" returned: 0 in 1.164s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1c894a1e-124c-41cf-9962-a5103b53fe19 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfa810f1-819c-4221-8b27-196b57918325 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cfa810f1-819c-4221-8b27-196b57918325.945793c9-4c5e-45c8-99f6-1d2fb4673592 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:08 devstack sudo[105066]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e87b8f8f-2c22-4ae9-9aa8-760c90c6fe4a tempest-ProjectReaderTests-482077113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de8c026d-a3ea-4a78-961a-e8f09b2e5b10" returned: 0 in 0.908s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e87b8f8f-2c22-4ae9-9aa8-760c90c6fe4a tempest-ProjectReaderTests-482077113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de8c026d-a3ea-4a78-961a-e8f09b2e5b10 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:08 devstack sudo[105077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfa810f1-819c-4221-8b27-196b57918325 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cfa810f1-819c-4221-8b27-196b57918325.945793c9-4c5e-45c8-99f6-1d2fb4673592 Jul 08 18:58:08 devstack sudo[105077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:08 devstack sudo[105079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de8c026d-a3ea-4a78-961a-e8f09b2e5b10 Jul 08 18:58:08 devstack sudo[105079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:09 devstack sudo[105068]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-4594fab0-836d-49f0-b3ac-c75e0a61bce2 tempest-VolumeImageDependencyTests-1188344448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 1.024s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:09 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-4594fab0-836d-49f0-b3ac-c75e0a61bce2 tempest-VolumeImageDependencyTests-1188344448 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:58:09 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-4594fab0-836d-49f0-b3ac-c75e0a61bce2 tempest-VolumeImageDependencyTests-1188344448 None] Deleted volume successfully. Jul 08 18:58:09 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-4594fab0-836d-49f0-b3ac-c75e0a61bce2 tempest-VolumeImageDependencyTests-1188344448 None] Lock "cinder-273fdfd2-4a3f-4a26-97b9-b3304f86b282-delete_volume" released by "delete_volume" :: held 4.295s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:09 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-64136bc4-a189-4be2-9ef2-bdd70a4071fa tempest-ProjectReaderTests-422434555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:58:09 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-64136bc4-a189-4be2-9ef2-bdd70a4071fa tempest-ProjectReaderTests-422434555 None] Flow 'volume_create_manager' (0351d354-e5ef-4a36-acba-3d79aedb99d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:58:09 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-64136bc4-a189-4be2-9ef2-bdd70a4071fa tempest-ProjectReaderTests-422434555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8c16ebb-fb8d-473e-a8ae-6f0499cb5b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:09 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-64136bc4-a189-4be2-9ef2-bdd70a4071fa tempest-ProjectReaderTests-422434555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8c16ebb-fb8d-473e-a8ae-6f0499cb5b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:58:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1921631026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d818df3-c847-4fa6-a50a-cc4c6cd5c365,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29c32154c507487cbafd67a692df63f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:58:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:58:10Z,use_quota=True,user_id='2a3842f74d0646b8824351eff025b80e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:09 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-64136bc4-a189-4be2-9ef2-bdd70a4071fa tempest-ProjectReaderTests-422434555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85a31248-a81c-4fcc-a4f7-91241d8f6121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:09 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-64136bc4-a189-4be2-9ef2-bdd70a4071fa tempest-ProjectReaderTests-422434555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85a31248-a81c-4fcc-a4f7-91241d8f6121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:09 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-64136bc4-a189-4be2-9ef2-bdd70a4071fa tempest-ProjectReaderTests-422434555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e94c687-e0bb-4832-9e48-5ca0367346a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:09 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-64136bc4-a189-4be2-9ef2-bdd70a4071fa tempest-ProjectReaderTests-422434555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e94c687-e0bb-4832-9e48-5ca0367346a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d818df3-c847-4fa6-a50a-cc4c6cd5c365', 'volume_name': 'volume-7d818df3-c847-4fa6-a50a-cc4c6cd5c365', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:09 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-64136bc4-a189-4be2-9ef2-bdd70a4071fa tempest-ProjectReaderTests-422434555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc856c3b-7341-4111-a897-dc67927ea4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:09 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-64136bc4-a189-4be2-9ef2-bdd70a4071fa tempest-ProjectReaderTests-422434555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc856c3b-7341-4111-a897-dc67927ea4b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:09 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-64136bc4-a189-4be2-9ef2-bdd70a4071fa tempest-ProjectReaderTests-422434555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f81dfee3-4c9d-479a-adf5-1035cb56c46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:09 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-64136bc4-a189-4be2-9ef2-bdd70a4071fa tempest-ProjectReaderTests-422434555 None] Volume 7d818df3-c847-4fa6-a50a-cc4c6cd5c365: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d818df3-c847-4fa6-a50a-cc4c6cd5c365', 'volume_size': 1} Jul 08 18:58:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-64136bc4-a189-4be2-9ef2-bdd70a4071fa tempest-ProjectReaderTests-422434555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:09 devstack sudo[105077]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1c894a1e-124c-41cf-9962-a5103b53fe19 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfa810f1-819c-4221-8b27-196b57918325 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cfa810f1-819c-4221-8b27-196b57918325.945793c9-4c5e-45c8-99f6-1d2fb4673592" returned: 0 in 0.981s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:09 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-1c894a1e-124c-41cf-9962-a5103b53fe19 tempest-ProjectMemberTests-704047872 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cfa810f1-819c-4221-8b27-196b57918325.945793c9-4c5e-45c8-99f6-1d2fb4673592 is being set with open permissions: ugo+rw Jul 08 18:58:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1c894a1e-124c-41cf-9962-a5103b53fe19 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cfa810f1-819c-4221-8b27-196b57918325.945793c9-4c5e-45c8-99f6-1d2fb4673592 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:09 devstack sudo[105079]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e87b8f8f-2c22-4ae9-9aa8-760c90c6fe4a tempest-ProjectReaderTests-482077113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de8c026d-a3ea-4a78-961a-e8f09b2e5b10" returned: 0 in 0.945s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:09 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-e87b8f8f-2c22-4ae9-9aa8-760c90c6fe4a tempest-ProjectReaderTests-482077113 None] Lock "cinder-quobyte-de8c026d-a3ea-4a78-961a-e8f09b2e5b10" released by "delete_volume" :: held 1.914s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:09 devstack sudo[105086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cfa810f1-819c-4221-8b27-196b57918325.945793c9-4c5e-45c8-99f6-1d2fb4673592 Jul 08 18:58:09 devstack sudo[105086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:09 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-e87b8f8f-2c22-4ae9-9aa8-760c90c6fe4a tempest-ProjectReaderTests-482077113 None] Created reservations ['81400c1a-1fc7-43a6-93b1-23456eb6f597', '7ec3ea70-4a00-41bd-b271-4604c8d9576d', 'a500aeda-b406-49b3-a9f0-31ffabb7179c', '2a1cf465-3e14-4a03-9bb1-41539a12b3f7'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:58:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-e87b8f8f-2c22-4ae9-9aa8-760c90c6fe4a tempest-ProjectReaderTests-482077113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-e87b8f8f-2c22-4ae9-9aa8-760c90c6fe4a tempest-ProjectReaderTests-482077113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:09 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-e87b8f8f-2c22-4ae9-9aa8-760c90c6fe4a tempest-ProjectReaderTests-482077113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:58:09 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-e87b8f8f-2c22-4ae9-9aa8-760c90c6fe4a tempest-ProjectReaderTests-482077113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:58:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-e87b8f8f-2c22-4ae9-9aa8-760c90c6fe4a tempest-ProjectReaderTests-482077113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e87b8f8f-2c22-4ae9-9aa8-760c90c6fe4a tempest-ProjectReaderTests-482077113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:09 devstack sudo[105088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:58:09 devstack sudo[105088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:10 devstack sudo[105086]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1c894a1e-124c-41cf-9962-a5103b53fe19 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cfa810f1-819c-4221-8b27-196b57918325.945793c9-4c5e-45c8-99f6-1d2fb4673592" returned: 0 in 0.770s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1c894a1e-124c-41cf-9962-a5103b53fe19 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cfa810f1-819c-4221-8b27-196b57918325.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:10 devstack sudo[105091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cfa810f1-819c-4221-8b27-196b57918325.info Jul 08 18:58:10 devstack sudo[105091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:10 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-e464fb74-3513-4175-aa85-9c4636d66c34 tempest-ProjectReaderTests-482077113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:58:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e464fb74-3513-4175-aa85-9c4636d66c34 tempest-ProjectReaderTests-482077113 None] Flow 'volume_create_manager' (a948ff0f-2b75-4974-8bec-2e219ec0cdaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:58:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e464fb74-3513-4175-aa85-9c4636d66c34 tempest-ProjectReaderTests-482077113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92b01cc2-ca5a-430f-98af-44bfc25fb1c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e464fb74-3513-4175-aa85-9c4636d66c34 tempest-ProjectReaderTests-482077113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92b01cc2-ca5a-430f-98af-44bfc25fb1c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:58:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-177218031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=306474d8-7e65-4eae-9a8a-09184f89b8c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2cb55a5f7d846cbb527b5bdd9e7ccd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:58:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:58:11Z,use_quota=True,user_id='9c785ac07168487b84ec55149a6baaf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e464fb74-3513-4175-aa85-9c4636d66c34 tempest-ProjectReaderTests-482077113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91f20b95-5b3f-4004-bb7c-6d180c5414b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e464fb74-3513-4175-aa85-9c4636d66c34 tempest-ProjectReaderTests-482077113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91f20b95-5b3f-4004-bb7c-6d180c5414b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e464fb74-3513-4175-aa85-9c4636d66c34 tempest-ProjectReaderTests-482077113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c907fa56-e126-45c6-b537-d34cd8f39e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e464fb74-3513-4175-aa85-9c4636d66c34 tempest-ProjectReaderTests-482077113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c907fa56-e126-45c6-b537-d34cd8f39e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '306474d8-7e65-4eae-9a8a-09184f89b8c4', 'volume_name': 'volume-306474d8-7e65-4eae-9a8a-09184f89b8c4', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e464fb74-3513-4175-aa85-9c4636d66c34 tempest-ProjectReaderTests-482077113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f96edda3-a376-4376-bf85-ad10500e4d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e464fb74-3513-4175-aa85-9c4636d66c34 tempest-ProjectReaderTests-482077113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f96edda3-a376-4376-bf85-ad10500e4d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e464fb74-3513-4175-aa85-9c4636d66c34 tempest-ProjectReaderTests-482077113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (342813f6-9885-4061-b1d0-101681d4c9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:10 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-e464fb74-3513-4175-aa85-9c4636d66c34 tempest-ProjectReaderTests-482077113 None] Volume 306474d8-7e65-4eae-9a8a-09184f89b8c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-306474d8-7e65-4eae-9a8a-09184f89b8c4', 'volume_size': 1} Jul 08 18:58:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-e464fb74-3513-4175-aa85-9c4636d66c34 tempest-ProjectReaderTests-482077113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:10 devstack sudo[105088]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e87b8f8f-2c22-4ae9-9aa8-760c90c6fe4a tempest-ProjectReaderTests-482077113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.949s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:10 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-e87b8f8f-2c22-4ae9-9aa8-760c90c6fe4a tempest-ProjectReaderTests-482077113 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:58:10 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-e87b8f8f-2c22-4ae9-9aa8-760c90c6fe4a tempest-ProjectReaderTests-482077113 None] Deleted volume successfully. Jul 08 18:58:10 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-e87b8f8f-2c22-4ae9-9aa8-760c90c6fe4a tempest-ProjectReaderTests-482077113 None] Lock "cinder-de8c026d-a3ea-4a78-961a-e8f09b2e5b10-delete_volume" released by "delete_volume" :: held 3.113s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:11 devstack sudo[105091]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1c894a1e-124c-41cf-9962-a5103b53fe19 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cfa810f1-819c-4221-8b27-196b57918325.info" returned: 0 in 0.713s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:11 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-1c894a1e-124c-41cf-9962-a5103b53fe19 tempest-ProjectMemberTests-704047872 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cfa810f1-819c-4221-8b27-196b57918325.info is being set with open permissions: ugo+rw Jul 08 18:58:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1c894a1e-124c-41cf-9962-a5103b53fe19 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cfa810f1-819c-4221-8b27-196b57918325.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:11 devstack sudo[105095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cfa810f1-819c-4221-8b27-196b57918325.info Jul 08 18:58:11 devstack sudo[105095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:11 devstack sudo[105095]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1c894a1e-124c-41cf-9962-a5103b53fe19 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cfa810f1-819c-4221-8b27-196b57918325.info" returned: 0 in 0.662s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1c894a1e-124c-41cf-9962-a5103b53fe19 tempest-ProjectMemberTests-704047872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.427s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-64136bc4-a189-4be2-9ef2-bdd70a4071fa tempest-ProjectReaderTests-422434555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.249s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:11 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-64136bc4-a189-4be2-9ef2-bdd70a4071fa tempest-ProjectReaderTests-422434555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:58:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1921631026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d818df3-c847-4fa6-a50a-cc4c6cd5c365,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29c32154c507487cbafd67a692df63f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:58:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:58:10Z,use_quota=True,user_id='2a3842f74d0646b8824351eff025b80e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:58:11 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-64136bc4-a189-4be2-9ef2-bdd70a4071fa tempest-ProjectReaderTests-422434555 None] Creating volume 7d818df3-c847-4fa6-a50a-cc4c6cd5c365 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:58:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-64136bc4-a189-4be2-9ef2-bdd70a4071fa tempest-ProjectReaderTests-422434555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-64136bc4-a189-4be2-9ef2-bdd70a4071fa tempest-ProjectReaderTests-422434555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:11 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-64136bc4-a189-4be2-9ef2-bdd70a4071fa tempest-ProjectReaderTests-422434555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:58:11 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-64136bc4-a189-4be2-9ef2-bdd70a4071fa tempest-ProjectReaderTests-422434555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:58:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-64136bc4-a189-4be2-9ef2-bdd70a4071fa tempest-ProjectReaderTests-422434555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:11 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-64136bc4-a189-4be2-9ef2-bdd70a4071fa tempest-ProjectReaderTests-422434555 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:58:11 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-64136bc4-a189-4be2-9ef2-bdd70a4071fa tempest-ProjectReaderTests-422434555 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:58:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-64136bc4-a189-4be2-9ef2-bdd70a4071fa tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7d818df3-c847-4fa6-a50a-cc4c6cd5c365 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:11 devstack sudo[105098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7d818df3-c847-4fa6-a50a-cc4c6cd5c365 1073741824 Jul 08 18:58:11 devstack sudo[105098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:11 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-1c894a1e-124c-41cf-9962-a5103b53fe19 tempest-ProjectMemberTests-704047872 None] Create snapshot completed successfully Jul 08 18:58:12 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-e85635a2-e9b5-49ba-99b1-56336f0c054f tempest-ProjectMemberTests-704047872 None] Acquiring lock "cinder-945793c9-4c5e-45c8-99f6-1d2fb4673592-delete_snapshot" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:58:12 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-e85635a2-e9b5-49ba-99b1-56336f0c054f tempest-ProjectMemberTests-704047872 None] Lock "cinder-945793c9-4c5e-45c8-99f6-1d2fb4673592-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:58:12 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-e85635a2-e9b5-49ba-99b1-56336f0c054f tempest-ProjectMemberTests-704047872 None] Acquiring lock "cinder-quobyte-cfa810f1-819c-4221-8b27-196b57918325" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:58:12 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-e85635a2-e9b5-49ba-99b1-56336f0c054f tempest-ProjectMemberTests-704047872 None] Lock "cinder-quobyte-cfa810f1-819c-4221-8b27-196b57918325" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:58:12 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-e85635a2-e9b5-49ba-99b1-56336f0c054f tempest-ProjectMemberTests-704047872 None] Acquiring lock "cinder-quobyte-945793c9-4c5e-45c8-99f6-1d2fb4673592" by "_delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:58:12 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-e85635a2-e9b5-49ba-99b1-56336f0c054f tempest-ProjectMemberTests-704047872 None] Lock "cinder-quobyte-945793c9-4c5e-45c8-99f6-1d2fb4673592" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:58:12 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-e85635a2-e9b5-49ba-99b1-56336f0c054f tempest-ProjectMemberTests-704047872 None] Deleting offline snapshot 945793c9-4c5e-45c8-99f6-1d2fb4673592 of volume cfa810f1-819c-4221-8b27-196b57918325 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:58:12 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-e85635a2-e9b5-49ba-99b1-56336f0c054f tempest-ProjectMemberTests-704047872 None] snapshot_file for this snap is: volume-cfa810f1-819c-4221-8b27-196b57918325.945793c9-4c5e-45c8-99f6-1d2fb4673592 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:58:12 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b0bba6-f3ca-462d-b3d5-e89e5fac9361]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:58:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e85635a2-e9b5-49ba-99b1-56336f0c054f tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cfa810f1-819c-4221-8b27-196b57918325.945793c9-4c5e-45c8-99f6-1d2fb4673592 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:12 devstack sudo[105100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cfa810f1-819c-4221-8b27-196b57918325.945793c9-4c5e-45c8-99f6-1d2fb4673592 Jul 08 18:58:12 devstack sudo[105100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:12 devstack sudo[105098]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-64136bc4-a189-4be2-9ef2-bdd70a4071fa tempest-ProjectReaderTests-422434555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7d818df3-c847-4fa6-a50a-cc4c6cd5c365 1073741824" returned: 0 in 0.936s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-64136bc4-a189-4be2-9ef2-bdd70a4071fa tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7d818df3-c847-4fa6-a50a-cc4c6cd5c365 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:12 devstack sudo[105107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7d818df3-c847-4fa6-a50a-cc4c6cd5c365 Jul 08 18:58:12 devstack sudo[105107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:13 devstack sudo[105100]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e85635a2-e9b5-49ba-99b1-56336f0c054f tempest-ProjectMemberTests-704047872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cfa810f1-819c-4221-8b27-196b57918325.945793c9-4c5e-45c8-99f6-1d2fb4673592" returned: 0 in 0.822s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:13 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-e85635a2-e9b5-49ba-99b1-56336f0c054f tempest-ProjectMemberTests-704047872 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfa810f1-819c-4221-8b27-196b57918325(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:58:13 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c954dd7-0cb1-4046-98d5-70a3222f192f]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:58:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e85635a2-e9b5-49ba-99b1-56336f0c054f tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cfa810f1-819c-4221-8b27-196b57918325 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:13 devstack sudo[105112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cfa810f1-819c-4221-8b27-196b57918325 Jul 08 18:58:13 devstack sudo[105112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:13 devstack sudo[105107]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-64136bc4-a189-4be2-9ef2-bdd70a4071fa tempest-ProjectReaderTests-422434555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7d818df3-c847-4fa6-a50a-cc4c6cd5c365" returned: 0 in 0.663s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:13 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-64136bc4-a189-4be2-9ef2-bdd70a4071fa tempest-ProjectReaderTests-422434555 None] <== create_volume: return (1645ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:58:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-64136bc4-a189-4be2-9ef2-bdd70a4071fa tempest-ProjectReaderTests-422434555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.649s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-e464fb74-3513-4175-aa85-9c4636d66c34 tempest-ProjectReaderTests-482077113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.898s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:13 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-e464fb74-3513-4175-aa85-9c4636d66c34 tempest-ProjectReaderTests-482077113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:58:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-177218031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=306474d8-7e65-4eae-9a8a-09184f89b8c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2cb55a5f7d846cbb527b5bdd9e7ccd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:58:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:58:11Z,use_quota=True,user_id='9c785ac07168487b84ec55149a6baaf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:58:13 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-e464fb74-3513-4175-aa85-9c4636d66c34 tempest-ProjectReaderTests-482077113 None] Creating volume 306474d8-7e65-4eae-9a8a-09184f89b8c4 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:58:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-e464fb74-3513-4175-aa85-9c4636d66c34 tempest-ProjectReaderTests-482077113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-e464fb74-3513-4175-aa85-9c4636d66c34 tempest-ProjectReaderTests-482077113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:13 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-e464fb74-3513-4175-aa85-9c4636d66c34 tempest-ProjectReaderTests-482077113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:58:13 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-e464fb74-3513-4175-aa85-9c4636d66c34 tempest-ProjectReaderTests-482077113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:58:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-e464fb74-3513-4175-aa85-9c4636d66c34 tempest-ProjectReaderTests-482077113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:13 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-e464fb74-3513-4175-aa85-9c4636d66c34 tempest-ProjectReaderTests-482077113 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:58:13 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-e464fb74-3513-4175-aa85-9c4636d66c34 tempest-ProjectReaderTests-482077113 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:58:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e464fb74-3513-4175-aa85-9c4636d66c34 tempest-ProjectReaderTests-482077113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-306474d8-7e65-4eae-9a8a-09184f89b8c4 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:13 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-64136bc4-a189-4be2-9ef2-bdd70a4071fa tempest-ProjectReaderTests-422434555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f81dfee3-4c9d-479a-adf5-1035cb56c46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d818df3-c847-4fa6-a50a-cc4c6cd5c365', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:13 devstack sudo[105115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-306474d8-7e65-4eae-9a8a-09184f89b8c4 1073741824 Jul 08 18:58:13 devstack sudo[105115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:13 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-64136bc4-a189-4be2-9ef2-bdd70a4071fa tempest-ProjectReaderTests-422434555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bdd9f40-679f-4b8e-ac15-acfecebae8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:13 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-64136bc4-a189-4be2-9ef2-bdd70a4071fa tempest-ProjectReaderTests-422434555 None] Volume volume-7d818df3-c847-4fa6-a50a-cc4c6cd5c365 (7d818df3-c847-4fa6-a50a-cc4c6cd5c365): created successfully Jul 08 18:58:13 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-64136bc4-a189-4be2-9ef2-bdd70a4071fa tempest-ProjectReaderTests-422434555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bdd9f40-679f-4b8e-ac15-acfecebae8d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:13 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-64136bc4-a189-4be2-9ef2-bdd70a4071fa tempest-ProjectReaderTests-422434555 None] Flow 'volume_create_manager' (0351d354-e5ef-4a36-acba-3d79aedb99d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:58:13 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-64136bc4-a189-4be2-9ef2-bdd70a4071fa tempest-ProjectReaderTests-422434555 None] Created volume successfully. Jul 08 18:58:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-d552633c-7f9a-4e16-b994-39a8673c477d tempest-ProjectReaderTests-422434555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:14 devstack sudo[105112]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e85635a2-e9b5-49ba-99b1-56336f0c054f tempest-ProjectMemberTests-704047872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cfa810f1-819c-4221-8b27-196b57918325" returned: 0 in 0.897s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e85635a2-e9b5-49ba-99b1-56336f0c054f tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cfa810f1-819c-4221-8b27-196b57918325.945793c9-4c5e-45c8-99f6-1d2fb4673592 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:14 devstack sudo[105120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cfa810f1-819c-4221-8b27-196b57918325.945793c9-4c5e-45c8-99f6-1d2fb4673592 Jul 08 18:58:14 devstack sudo[105120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:14 devstack sudo[105115]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e464fb74-3513-4175-aa85-9c4636d66c34 tempest-ProjectReaderTests-482077113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-306474d8-7e65-4eae-9a8a-09184f89b8c4 1073741824" returned: 0 in 1.008s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e464fb74-3513-4175-aa85-9c4636d66c34 tempest-ProjectReaderTests-482077113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-306474d8-7e65-4eae-9a8a-09184f89b8c4 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:14 devstack sudo[105125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-306474d8-7e65-4eae-9a8a-09184f89b8c4 Jul 08 18:58:14 devstack sudo[105125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:15 devstack sudo[105120]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e85635a2-e9b5-49ba-99b1-56336f0c054f tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cfa810f1-819c-4221-8b27-196b57918325.945793c9-4c5e-45c8-99f6-1d2fb4673592" returned: 0 in 0.865s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e85635a2-e9b5-49ba-99b1-56336f0c054f tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cfa810f1-819c-4221-8b27-196b57918325.945793c9-4c5e-45c8-99f6-1d2fb4673592 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:15 devstack sudo[105131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cfa810f1-819c-4221-8b27-196b57918325.945793c9-4c5e-45c8-99f6-1d2fb4673592 Jul 08 18:58:15 devstack sudo[105131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:15 devstack sudo[105125]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e464fb74-3513-4175-aa85-9c4636d66c34 tempest-ProjectReaderTests-482077113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-306474d8-7e65-4eae-9a8a-09184f89b8c4" returned: 0 in 0.735s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:15 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-e464fb74-3513-4175-aa85-9c4636d66c34 tempest-ProjectReaderTests-482077113 None] <== create_volume: return (1805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:58:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-e464fb74-3513-4175-aa85-9c4636d66c34 tempest-ProjectReaderTests-482077113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.812s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-d552633c-7f9a-4e16-b994-39a8673c477d tempest-ProjectReaderTests-422434555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.313s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:15 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e464fb74-3513-4175-aa85-9c4636d66c34 tempest-ProjectReaderTests-482077113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (342813f6-9885-4061-b1d0-101681d4c9a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-306474d8-7e65-4eae-9a8a-09184f89b8c4', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:15 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e464fb74-3513-4175-aa85-9c4636d66c34 tempest-ProjectReaderTests-482077113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da0d414b-de99-4f2e-95a5-720aa6a87204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:15 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-d552633c-7f9a-4e16-b994-39a8673c477d tempest-ProjectReaderTests-422434555 None] Creating offline snapshot 219cd0ef-5a36-4090-b990-403049a24eb2 of volume 7d818df3-c847-4fa6-a50a-cc4c6cd5c365 {{(pid=86873) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:58:15 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-e464fb74-3513-4175-aa85-9c4636d66c34 tempest-ProjectReaderTests-482077113 None] Volume volume-306474d8-7e65-4eae-9a8a-09184f89b8c4 (306474d8-7e65-4eae-9a8a-09184f89b8c4): created successfully Jul 08 18:58:15 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e464fb74-3513-4175-aa85-9c4636d66c34 tempest-ProjectReaderTests-482077113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da0d414b-de99-4f2e-95a5-720aa6a87204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:15 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e464fb74-3513-4175-aa85-9c4636d66c34 tempest-ProjectReaderTests-482077113 None] Flow 'volume_create_manager' (a948ff0f-2b75-4974-8bec-2e219ec0cdaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:58:15 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dca6301-efb9-4e8e-bed9-9c0deb296ca5]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:58:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d552633c-7f9a-4e16-b994-39a8673c477d tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7d818df3-c847-4fa6-a50a-cc4c6cd5c365 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:15 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-e464fb74-3513-4175-aa85-9c4636d66c34 tempest-ProjectReaderTests-482077113 None] Created volume successfully. Jul 08 18:58:15 devstack sudo[105134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7d818df3-c847-4fa6-a50a-cc4c6cd5c365 Jul 08 18:58:15 devstack sudo[105134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:15 devstack sudo[105131]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e85635a2-e9b5-49ba-99b1-56336f0c054f tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cfa810f1-819c-4221-8b27-196b57918325.945793c9-4c5e-45c8-99f6-1d2fb4673592" returned: 0 in 0.811s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:15 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-e85635a2-e9b5-49ba-99b1-56336f0c054f tempest-ProjectMemberTests-704047872 None] Lock "cinder-quobyte-945793c9-4c5e-45c8-99f6-1d2fb4673592" released by "_delete_snapshot" :: held 3.552s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:15 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-e85635a2-e9b5-49ba-99b1-56336f0c054f tempest-ProjectMemberTests-704047872 None] Lock "cinder-quobyte-cfa810f1-819c-4221-8b27-196b57918325" released by "delete_snapshot" :: held 3.574s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:16 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-598f0000-30a9-41b5-a9fb-9ba004f934e6 tempest-ProjectReaderTests-482077113 None] Acquiring lock "cinder-306474d8-7e65-4eae-9a8a-09184f89b8c4-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:58:16 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-598f0000-30a9-41b5-a9fb-9ba004f934e6 tempest-ProjectReaderTests-482077113 None] Lock "cinder-306474d8-7e65-4eae-9a8a-09184f89b8c4-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:58:16 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-e85635a2-e9b5-49ba-99b1-56336f0c054f tempest-ProjectMemberTests-704047872 None] Created reservations ['bad90ffc-0840-4837-a272-c36813829dce', '0ef844f1-662f-44d9-add7-f5eba13b3640', '402806c1-89d5-4a06-baa4-458b672a9f69', 'e2705d64-868e-4f86-bd30-dd965432b22f'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:58:16 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-598f0000-30a9-41b5-a9fb-9ba004f934e6 tempest-ProjectReaderTests-482077113 None] Acquiring lock "cinder-quobyte-306474d8-7e65-4eae-9a8a-09184f89b8c4" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:58:16 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-598f0000-30a9-41b5-a9fb-9ba004f934e6 tempest-ProjectReaderTests-482077113 None] Lock "cinder-quobyte-306474d8-7e65-4eae-9a8a-09184f89b8c4" acquired by "delete_volume" :: waited 0.036s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:58:16 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-e85635a2-e9b5-49ba-99b1-56336f0c054f tempest-ProjectMemberTests-704047872 None] Delete snapshot completed successfully. Jul 08 18:58:16 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce7996a-c637-4e59-8b23-c5db67f994ee]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:58:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-598f0000-30a9-41b5-a9fb-9ba004f934e6 tempest-ProjectReaderTests-482077113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-306474d8-7e65-4eae-9a8a-09184f89b8c4 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:16 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-e85635a2-e9b5-49ba-99b1-56336f0c054f tempest-ProjectMemberTests-704047872 None] Lock "cinder-945793c9-4c5e-45c8-99f6-1d2fb4673592-delete_snapshot" released by "delete_snapshot" :: held 3.870s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:16 devstack sudo[105140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-306474d8-7e65-4eae-9a8a-09184f89b8c4 Jul 08 18:58:16 devstack sudo[105140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:16 devstack sudo[105134]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d552633c-7f9a-4e16-b994-39a8673c477d tempest-ProjectReaderTests-422434555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7d818df3-c847-4fa6-a50a-cc4c6cd5c365" returned: 0 in 0.848s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d552633c-7f9a-4e16-b994-39a8673c477d tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7d818df3-c847-4fa6-a50a-cc4c6cd5c365,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7d818df3-c847-4fa6-a50a-cc4c6cd5c365.219cd0ef-5a36-4090-b990-403049a24eb2 1G {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:16 devstack sudo[105142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7d818df3-c847-4fa6-a50a-cc4c6cd5c365,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7d818df3-c847-4fa6-a50a-cc4c6cd5c365.219cd0ef-5a36-4090-b990-403049a24eb2 1G Jul 08 18:58:16 devstack sudo[105142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:16 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-75c0393b-8264-45cc-9c73-0cd88ea8322d tempest-ProjectMemberTests-704047872 None] Acquiring lock "cinder-cfa810f1-819c-4221-8b27-196b57918325-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:58:16 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-75c0393b-8264-45cc-9c73-0cd88ea8322d tempest-ProjectMemberTests-704047872 None] Lock "cinder-cfa810f1-819c-4221-8b27-196b57918325-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:58:16 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-75c0393b-8264-45cc-9c73-0cd88ea8322d tempest-ProjectMemberTests-704047872 None] Acquiring lock "cinder-quobyte-cfa810f1-819c-4221-8b27-196b57918325" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:58:16 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-75c0393b-8264-45cc-9c73-0cd88ea8322d tempest-ProjectMemberTests-704047872 None] Lock "cinder-quobyte-cfa810f1-819c-4221-8b27-196b57918325" acquired by "delete_volume" :: waited 0.031s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:58:16 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6970cbe-5318-4e56-96f0-5a8d07c5271a]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:58:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-75c0393b-8264-45cc-9c73-0cd88ea8322d tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cfa810f1-819c-4221-8b27-196b57918325 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:17 devstack sudo[105150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cfa810f1-819c-4221-8b27-196b57918325 Jul 08 18:58:17 devstack sudo[105150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:17 devstack sudo[105142]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d552633c-7f9a-4e16-b994-39a8673c477d tempest-ProjectReaderTests-422434555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7d818df3-c847-4fa6-a50a-cc4c6cd5c365,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7d818df3-c847-4fa6-a50a-cc4c6cd5c365.219cd0ef-5a36-4090-b990-403049a24eb2 1G" returned: 0 in 0.932s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d552633c-7f9a-4e16-b994-39a8673c477d tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d818df3-c847-4fa6-a50a-cc4c6cd5c365 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7d818df3-c847-4fa6-a50a-cc4c6cd5c365.219cd0ef-5a36-4090-b990-403049a24eb2 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:17 devstack sudo[105140]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-598f0000-30a9-41b5-a9fb-9ba004f934e6 tempest-ProjectReaderTests-482077113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-306474d8-7e65-4eae-9a8a-09184f89b8c4" returned: 0 in 1.098s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-598f0000-30a9-41b5-a9fb-9ba004f934e6 tempest-ProjectReaderTests-482077113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-306474d8-7e65-4eae-9a8a-09184f89b8c4 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:17 devstack sudo[105159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d818df3-c847-4fa6-a50a-cc4c6cd5c365 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7d818df3-c847-4fa6-a50a-cc4c6cd5c365.219cd0ef-5a36-4090-b990-403049a24eb2 Jul 08 18:58:17 devstack sudo[105159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:17 devstack sudo[105160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-306474d8-7e65-4eae-9a8a-09184f89b8c4 Jul 08 18:58:17 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:17 devstack sudo[105150]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-75c0393b-8264-45cc-9c73-0cd88ea8322d tempest-ProjectMemberTests-704047872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cfa810f1-819c-4221-8b27-196b57918325" returned: 0 in 0.979s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-75c0393b-8264-45cc-9c73-0cd88ea8322d tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cfa810f1-819c-4221-8b27-196b57918325 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:17 devstack sudo[105167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cfa810f1-819c-4221-8b27-196b57918325 Jul 08 18:58:17 devstack sudo[105167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:18 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-598f0000-30a9-41b5-a9fb-9ba004f934e6 tempest-ProjectReaderTests-482077113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-306474d8-7e65-4eae-9a8a-09184f89b8c4" returned: 0 in 0.775s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:18 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-598f0000-30a9-41b5-a9fb-9ba004f934e6 tempest-ProjectReaderTests-482077113 None] Lock "cinder-quobyte-306474d8-7e65-4eae-9a8a-09184f89b8c4" released by "delete_volume" :: held 1.946s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:18 devstack sudo[105159]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d552633c-7f9a-4e16-b994-39a8673c477d tempest-ProjectReaderTests-422434555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d818df3-c847-4fa6-a50a-cc4c6cd5c365 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7d818df3-c847-4fa6-a50a-cc4c6cd5c365.219cd0ef-5a36-4090-b990-403049a24eb2" returned: 0 in 0.916s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:18 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-d552633c-7f9a-4e16-b994-39a8673c477d tempest-ProjectReaderTests-422434555 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7d818df3-c847-4fa6-a50a-cc4c6cd5c365.219cd0ef-5a36-4090-b990-403049a24eb2 is being set with open permissions: ugo+rw Jul 08 18:58:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d552633c-7f9a-4e16-b994-39a8673c477d tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7d818df3-c847-4fa6-a50a-cc4c6cd5c365.219cd0ef-5a36-4090-b990-403049a24eb2 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:18 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-598f0000-30a9-41b5-a9fb-9ba004f934e6 tempest-ProjectReaderTests-482077113 None] Created reservations ['9c6c6ebc-5ddd-4ac3-8354-2e9f698aa753', 'd675ec79-4a1f-4907-8c94-1ed07c542827', '059f7f61-f281-4b30-87a1-b559915ca342', '30cdd25e-a0e3-4fa0-8f4c-a539fbef5e4d'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:58:18 devstack sudo[105174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7d818df3-c847-4fa6-a50a-cc4c6cd5c365.219cd0ef-5a36-4090-b990-403049a24eb2 Jul 08 18:58:18 devstack sudo[105174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-598f0000-30a9-41b5-a9fb-9ba004f934e6 tempest-ProjectReaderTests-482077113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-598f0000-30a9-41b5-a9fb-9ba004f934e6 tempest-ProjectReaderTests-482077113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:18 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-598f0000-30a9-41b5-a9fb-9ba004f934e6 tempest-ProjectReaderTests-482077113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:58:18 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-598f0000-30a9-41b5-a9fb-9ba004f934e6 tempest-ProjectReaderTests-482077113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:58:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-598f0000-30a9-41b5-a9fb-9ba004f934e6 tempest-ProjectReaderTests-482077113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-598f0000-30a9-41b5-a9fb-9ba004f934e6 tempest-ProjectReaderTests-482077113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:18 devstack sudo[105176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:58:18 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:18 devstack sudo[105167]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-75c0393b-8264-45cc-9c73-0cd88ea8322d tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-cfa810f1-819c-4221-8b27-196b57918325" returned: 0 in 0.881s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:18 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-75c0393b-8264-45cc-9c73-0cd88ea8322d tempest-ProjectMemberTests-704047872 None] Lock "cinder-quobyte-cfa810f1-819c-4221-8b27-196b57918325" released by "delete_volume" :: held 1.965s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:18 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-75c0393b-8264-45cc-9c73-0cd88ea8322d tempest-ProjectMemberTests-704047872 None] Created reservations ['5f5630b3-2def-499f-a674-c7dbdaf421ab', '1a8ec0d9-c5fc-456d-b406-bbb31e627c60', '78b0a3f9-8b4b-4da8-a44f-5ad58b073ae4', 'af4a435b-f276-4918-b300-637584b779d2'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:58:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-75c0393b-8264-45cc-9c73-0cd88ea8322d tempest-ProjectMemberTests-704047872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-75c0393b-8264-45cc-9c73-0cd88ea8322d tempest-ProjectMemberTests-704047872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:18 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-75c0393b-8264-45cc-9c73-0cd88ea8322d tempest-ProjectMemberTests-704047872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:58:18 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-75c0393b-8264-45cc-9c73-0cd88ea8322d tempest-ProjectMemberTests-704047872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:58:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-75c0393b-8264-45cc-9c73-0cd88ea8322d tempest-ProjectMemberTests-704047872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-75c0393b-8264-45cc-9c73-0cd88ea8322d tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:18 devstack sudo[105180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:58:18 devstack sudo[105180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:19 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-60e7e838-3fe0-4003-ab00-11e0ce081c86 tempest-ProjectReaderTests-482077113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:58:19 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-60e7e838-3fe0-4003-ab00-11e0ce081c86 tempest-ProjectReaderTests-482077113 None] Flow 'volume_create_manager' (346acb66-68ca-40df-9ede-c5061c687ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:58:19 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-60e7e838-3fe0-4003-ab00-11e0ce081c86 tempest-ProjectReaderTests-482077113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60303525-a0e0-43cb-8ba9-e4cf700eebe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:19 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-60e7e838-3fe0-4003-ab00-11e0ce081c86 tempest-ProjectReaderTests-482077113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60303525-a0e0-43cb-8ba9-e4cf700eebe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:58:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1006350971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7c7206a-6c78-4663-b9f6-af853e462837,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2cb55a5f7d846cbb527b5bdd9e7ccd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:58:19Z,use_quota=True,user_id='9c785ac07168487b84ec55149a6baaf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:19 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-60e7e838-3fe0-4003-ab00-11e0ce081c86 tempest-ProjectReaderTests-482077113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7395c06a-1e19-44db-b6ae-c75f127d3485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:19 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-60e7e838-3fe0-4003-ab00-11e0ce081c86 tempest-ProjectReaderTests-482077113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7395c06a-1e19-44db-b6ae-c75f127d3485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:19 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-60e7e838-3fe0-4003-ab00-11e0ce081c86 tempest-ProjectReaderTests-482077113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58cf766a-2675-4ac2-9108-b610d4a30db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:19 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-60e7e838-3fe0-4003-ab00-11e0ce081c86 tempest-ProjectReaderTests-482077113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58cf766a-2675-4ac2-9108-b610d4a30db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7c7206a-6c78-4663-b9f6-af853e462837', 'volume_name': 'volume-c7c7206a-6c78-4663-b9f6-af853e462837', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:19 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-60e7e838-3fe0-4003-ab00-11e0ce081c86 tempest-ProjectReaderTests-482077113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8abac37-4366-4493-9003-c59970a397d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:19 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-60e7e838-3fe0-4003-ab00-11e0ce081c86 tempest-ProjectReaderTests-482077113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8abac37-4366-4493-9003-c59970a397d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:19 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-60e7e838-3fe0-4003-ab00-11e0ce081c86 tempest-ProjectReaderTests-482077113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac0d69cd-72f9-40a6-b2b4-6ed565ae2182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:19 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-60e7e838-3fe0-4003-ab00-11e0ce081c86 tempest-ProjectReaderTests-482077113 None] Volume c7c7206a-6c78-4663-b9f6-af853e462837: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7c7206a-6c78-4663-b9f6-af853e462837', 'volume_size': 1} Jul 08 18:58:19 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-60e7e838-3fe0-4003-ab00-11e0ce081c86 tempest-ProjectReaderTests-482077113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:19 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:19 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-598f0000-30a9-41b5-a9fb-9ba004f934e6 tempest-ProjectReaderTests-482077113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.832s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:19 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-598f0000-30a9-41b5-a9fb-9ba004f934e6 tempest-ProjectReaderTests-482077113 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:58:19 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-598f0000-30a9-41b5-a9fb-9ba004f934e6 tempest-ProjectReaderTests-482077113 None] Deleted volume successfully. Jul 08 18:58:19 devstack sudo[105174]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:19 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d552633c-7f9a-4e16-b994-39a8673c477d tempest-ProjectReaderTests-422434555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7d818df3-c847-4fa6-a50a-cc4c6cd5c365.219cd0ef-5a36-4090-b990-403049a24eb2" returned: 0 in 1.011s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:19 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-598f0000-30a9-41b5-a9fb-9ba004f934e6 tempest-ProjectReaderTests-482077113 None] Lock "cinder-306474d8-7e65-4eae-9a8a-09184f89b8c4-delete_volume" released by "delete_volume" :: held 3.179s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:19 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d552633c-7f9a-4e16-b994-39a8673c477d tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7d818df3-c847-4fa6-a50a-cc4c6cd5c365.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:19 devstack sudo[105183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7d818df3-c847-4fa6-a50a-cc4c6cd5c365.info Jul 08 18:58:19 devstack sudo[105183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:19 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-104cb6e0-81ba-4b46-b395-94d6344d06a0 tempest-ProjectMemberTests-704047872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:58:19 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-104cb6e0-81ba-4b46-b395-94d6344d06a0 tempest-ProjectMemberTests-704047872 None] Flow 'volume_create_manager' (66f14877-c28b-4b6d-95d9-89e10237dc60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:58:19 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-104cb6e0-81ba-4b46-b395-94d6344d06a0 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94581631-c64d-49df-a2be-c6598467b311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:19 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-104cb6e0-81ba-4b46-b395-94d6344d06a0 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94581631-c64d-49df-a2be-c6598467b311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:58:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1673412253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e56e100-db99-481d-85f3-d1b517d7c1e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23f6feda0dc341ae9dff1be67ef4c54c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:58:20Z,use_quota=True,user_id='ebff52e9980446ed8de939cd8116db5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:19 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-104cb6e0-81ba-4b46-b395-94d6344d06a0 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddec76de-e806-4dc2-aa31-f1616d77e792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:19 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-104cb6e0-81ba-4b46-b395-94d6344d06a0 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddec76de-e806-4dc2-aa31-f1616d77e792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:19 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-104cb6e0-81ba-4b46-b395-94d6344d06a0 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaf46834-49d9-45aa-b039-c3b80f9c4a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:19 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-104cb6e0-81ba-4b46-b395-94d6344d06a0 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaf46834-49d9-45aa-b039-c3b80f9c4a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e56e100-db99-481d-85f3-d1b517d7c1e3', 'volume_name': 'volume-5e56e100-db99-481d-85f3-d1b517d7c1e3', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:19 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-104cb6e0-81ba-4b46-b395-94d6344d06a0 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86c32ecb-7741-4870-bd57-a4fb4598b9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:19 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-104cb6e0-81ba-4b46-b395-94d6344d06a0 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86c32ecb-7741-4870-bd57-a4fb4598b9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:19 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-104cb6e0-81ba-4b46-b395-94d6344d06a0 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70b734c4-d67a-4e18-ad31-e395bfb3464d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:19 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-104cb6e0-81ba-4b46-b395-94d6344d06a0 tempest-ProjectMemberTests-704047872 None] Volume 5e56e100-db99-481d-85f3-d1b517d7c1e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e56e100-db99-481d-85f3-d1b517d7c1e3', 'volume_size': 1} Jul 08 18:58:19 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-104cb6e0-81ba-4b46-b395-94d6344d06a0 tempest-ProjectMemberTests-704047872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:19 devstack sudo[105180]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:19 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-75c0393b-8264-45cc-9c73-0cd88ea8322d tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.978s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:19 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-75c0393b-8264-45cc-9c73-0cd88ea8322d tempest-ProjectMemberTests-704047872 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:58:19 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-75c0393b-8264-45cc-9c73-0cd88ea8322d tempest-ProjectMemberTests-704047872 None] Deleted volume successfully. Jul 08 18:58:19 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-75c0393b-8264-45cc-9c73-0cd88ea8322d tempest-ProjectMemberTests-704047872 None] Lock "cinder-cfa810f1-819c-4221-8b27-196b57918325-delete_volume" released by "delete_volume" :: held 3.240s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:20 devstack sudo[105183]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d552633c-7f9a-4e16-b994-39a8673c477d tempest-ProjectReaderTests-422434555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7d818df3-c847-4fa6-a50a-cc4c6cd5c365.info" returned: 0 in 0.821s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:20 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-d552633c-7f9a-4e16-b994-39a8673c477d tempest-ProjectReaderTests-422434555 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7d818df3-c847-4fa6-a50a-cc4c6cd5c365.info is being set with open permissions: ugo+rw Jul 08 18:58:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d552633c-7f9a-4e16-b994-39a8673c477d tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7d818df3-c847-4fa6-a50a-cc4c6cd5c365.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:20 devstack sudo[105187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7d818df3-c847-4fa6-a50a-cc4c6cd5c365.info Jul 08 18:58:20 devstack sudo[105187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:20 devstack sudo[105187]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-d552633c-7f9a-4e16-b994-39a8673c477d tempest-ProjectReaderTests-422434555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7d818df3-c847-4fa6-a50a-cc4c6cd5c365.info" returned: 0 in 0.677s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-d552633c-7f9a-4e16-b994-39a8673c477d tempest-ProjectReaderTests-422434555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.353s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-60e7e838-3fe0-4003-ab00-11e0ce081c86 tempest-ProjectReaderTests-482077113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.629s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:20 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-60e7e838-3fe0-4003-ab00-11e0ce081c86 tempest-ProjectReaderTests-482077113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:58:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1006350971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7c7206a-6c78-4663-b9f6-af853e462837,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2cb55a5f7d846cbb527b5bdd9e7ccd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:58:19Z,use_quota=True,user_id='9c785ac07168487b84ec55149a6baaf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:58:20 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-60e7e838-3fe0-4003-ab00-11e0ce081c86 tempest-ProjectReaderTests-482077113 None] Creating volume c7c7206a-6c78-4663-b9f6-af853e462837 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:58:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-60e7e838-3fe0-4003-ab00-11e0ce081c86 tempest-ProjectReaderTests-482077113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-60e7e838-3fe0-4003-ab00-11e0ce081c86 tempest-ProjectReaderTests-482077113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:20 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-60e7e838-3fe0-4003-ab00-11e0ce081c86 tempest-ProjectReaderTests-482077113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:58:20 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-60e7e838-3fe0-4003-ab00-11e0ce081c86 tempest-ProjectReaderTests-482077113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:58:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-60e7e838-3fe0-4003-ab00-11e0ce081c86 tempest-ProjectReaderTests-482077113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:20 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-60e7e838-3fe0-4003-ab00-11e0ce081c86 tempest-ProjectReaderTests-482077113 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:58:20 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-60e7e838-3fe0-4003-ab00-11e0ce081c86 tempest-ProjectReaderTests-482077113 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:58:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-60e7e838-3fe0-4003-ab00-11e0ce081c86 tempest-ProjectReaderTests-482077113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c7c7206a-6c78-4663-b9f6-af853e462837 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:20 devstack sudo[105190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c7c7206a-6c78-4663-b9f6-af853e462837 1073741824 Jul 08 18:58:20 devstack sudo[105190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:20 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-d552633c-7f9a-4e16-b994-39a8673c477d tempest-ProjectReaderTests-422434555 None] Create snapshot completed successfully Jul 08 18:58:21 devstack sudo[105190]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:21 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-35148d73-c9b7-4514-a68f-3fae16b8731a tempest-ProjectReaderTests-422434555 None] Acquiring lock "cinder-219cd0ef-5a36-4090-b990-403049a24eb2-delete_snapshot" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:58:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-60e7e838-3fe0-4003-ab00-11e0ce081c86 tempest-ProjectReaderTests-482077113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c7c7206a-6c78-4663-b9f6-af853e462837 1073741824" returned: 0 in 0.862s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:21 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-35148d73-c9b7-4514-a68f-3fae16b8731a tempest-ProjectReaderTests-422434555 None] Lock "cinder-219cd0ef-5a36-4090-b990-403049a24eb2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:58:21 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-35148d73-c9b7-4514-a68f-3fae16b8731a tempest-ProjectReaderTests-422434555 None] Acquiring lock "cinder-quobyte-7d818df3-c847-4fa6-a50a-cc4c6cd5c365" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:58:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-60e7e838-3fe0-4003-ab00-11e0ce081c86 tempest-ProjectReaderTests-482077113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c7c7206a-6c78-4663-b9f6-af853e462837 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:21 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-35148d73-c9b7-4514-a68f-3fae16b8731a tempest-ProjectReaderTests-422434555 None] Lock "cinder-quobyte-7d818df3-c847-4fa6-a50a-cc4c6cd5c365" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:58:21 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-35148d73-c9b7-4514-a68f-3fae16b8731a tempest-ProjectReaderTests-422434555 None] Acquiring lock "cinder-quobyte-219cd0ef-5a36-4090-b990-403049a24eb2" by "_delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:58:21 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-35148d73-c9b7-4514-a68f-3fae16b8731a tempest-ProjectReaderTests-422434555 None] Lock "cinder-quobyte-219cd0ef-5a36-4090-b990-403049a24eb2" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:58:21 devstack sudo[105196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c7c7206a-6c78-4663-b9f6-af853e462837 Jul 08 18:58:21 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:21 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-35148d73-c9b7-4514-a68f-3fae16b8731a tempest-ProjectReaderTests-422434555 None] Deleting offline snapshot 219cd0ef-5a36-4090-b990-403049a24eb2 of volume 7d818df3-c847-4fa6-a50a-cc4c6cd5c365 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:58:21 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-35148d73-c9b7-4514-a68f-3fae16b8731a tempest-ProjectReaderTests-422434555 None] snapshot_file for this snap is: volume-7d818df3-c847-4fa6-a50a-cc4c6cd5c365.219cd0ef-5a36-4090-b990-403049a24eb2 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:58:21 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a4019b-db15-4483-9c6d-38b5b80e9f50]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:58:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-35148d73-c9b7-4514-a68f-3fae16b8731a tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7d818df3-c847-4fa6-a50a-cc4c6cd5c365.219cd0ef-5a36-4090-b990-403049a24eb2 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:21 devstack sudo[105198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7d818df3-c847-4fa6-a50a-cc4c6cd5c365.219cd0ef-5a36-4090-b990-403049a24eb2 Jul 08 18:58:21 devstack sudo[105198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:22 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-60e7e838-3fe0-4003-ab00-11e0ce081c86 tempest-ProjectReaderTests-482077113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c7c7206a-6c78-4663-b9f6-af853e462837" returned: 0 in 0.693s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:22 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-60e7e838-3fe0-4003-ab00-11e0ce081c86 tempest-ProjectReaderTests-482077113 None] <== create_volume: return (1604ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:58:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-60e7e838-3fe0-4003-ab00-11e0ce081c86 tempest-ProjectReaderTests-482077113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.610s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-104cb6e0-81ba-4b46-b395-94d6344d06a0 tempest-ProjectMemberTests-704047872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.573s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:22 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-104cb6e0-81ba-4b46-b395-94d6344d06a0 tempest-ProjectMemberTests-704047872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:58:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1673412253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e56e100-db99-481d-85f3-d1b517d7c1e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23f6feda0dc341ae9dff1be67ef4c54c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:58:20Z,use_quota=True,user_id='ebff52e9980446ed8de939cd8116db5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:58:22 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-104cb6e0-81ba-4b46-b395-94d6344d06a0 tempest-ProjectMemberTests-704047872 None] Creating volume 5e56e100-db99-481d-85f3-d1b517d7c1e3 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:58:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-104cb6e0-81ba-4b46-b395-94d6344d06a0 tempest-ProjectMemberTests-704047872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-104cb6e0-81ba-4b46-b395-94d6344d06a0 tempest-ProjectMemberTests-704047872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:22 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-104cb6e0-81ba-4b46-b395-94d6344d06a0 tempest-ProjectMemberTests-704047872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:58:22 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-104cb6e0-81ba-4b46-b395-94d6344d06a0 tempest-ProjectMemberTests-704047872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:58:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-104cb6e0-81ba-4b46-b395-94d6344d06a0 tempest-ProjectMemberTests-704047872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:22 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-104cb6e0-81ba-4b46-b395-94d6344d06a0 tempest-ProjectMemberTests-704047872 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:58:22 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-104cb6e0-81ba-4b46-b395-94d6344d06a0 tempest-ProjectMemberTests-704047872 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:58:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-104cb6e0-81ba-4b46-b395-94d6344d06a0 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5e56e100-db99-481d-85f3-d1b517d7c1e3 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:22 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-60e7e838-3fe0-4003-ab00-11e0ce081c86 tempest-ProjectReaderTests-482077113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac0d69cd-72f9-40a6-b2b4-6ed565ae2182) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7c7206a-6c78-4663-b9f6-af853e462837', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:22 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-60e7e838-3fe0-4003-ab00-11e0ce081c86 tempest-ProjectReaderTests-482077113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d1b3850-9924-4b7f-8f96-1e29fe848c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:22 devstack sudo[105201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5e56e100-db99-481d-85f3-d1b517d7c1e3 1073741824 Jul 08 18:58:22 devstack sudo[105201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:22 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-60e7e838-3fe0-4003-ab00-11e0ce081c86 tempest-ProjectReaderTests-482077113 None] Volume volume-c7c7206a-6c78-4663-b9f6-af853e462837 (c7c7206a-6c78-4663-b9f6-af853e462837): created successfully Jul 08 18:58:22 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-60e7e838-3fe0-4003-ab00-11e0ce081c86 tempest-ProjectReaderTests-482077113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d1b3850-9924-4b7f-8f96-1e29fe848c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:22 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-60e7e838-3fe0-4003-ab00-11e0ce081c86 tempest-ProjectReaderTests-482077113 None] Flow 'volume_create_manager' (346acb66-68ca-40df-9ede-c5061c687ad8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:58:22 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-60e7e838-3fe0-4003-ab00-11e0ce081c86 tempest-ProjectReaderTests-482077113 None] Created volume successfully. Jul 08 18:58:22 devstack sudo[105198]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-35148d73-c9b7-4514-a68f-3fae16b8731a tempest-ProjectReaderTests-422434555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7d818df3-c847-4fa6-a50a-cc4c6cd5c365.219cd0ef-5a36-4090-b990-403049a24eb2" returned: 0 in 0.891s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:22 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-35148d73-c9b7-4514-a68f-3fae16b8731a tempest-ProjectReaderTests-422434555 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d818df3-c847-4fa6-a50a-cc4c6cd5c365(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:58:22 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[736782f3-4e8a-40f0-bb04-2b9659752c41]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:58:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-35148d73-c9b7-4514-a68f-3fae16b8731a tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7d818df3-c847-4fa6-a50a-cc4c6cd5c365 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:22 devstack sudo[105207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7d818df3-c847-4fa6-a50a-cc4c6cd5c365 Jul 08 18:58:22 devstack sudo[105207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:23 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-4b18a562-d3b1-4a14-838a-4cd65a7a2f78 tempest-ProjectReaderTests-482077113 None] Acquiring lock "cinder-c7c7206a-6c78-4663-b9f6-af853e462837-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:58:23 devstack sudo[105201]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:23 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-4b18a562-d3b1-4a14-838a-4cd65a7a2f78 tempest-ProjectReaderTests-482077113 None] Lock "cinder-c7c7206a-6c78-4663-b9f6-af853e462837-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:58:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-104cb6e0-81ba-4b46-b395-94d6344d06a0 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5e56e100-db99-481d-85f3-d1b517d7c1e3 1073741824" returned: 0 in 0.902s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:23 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-4b18a562-d3b1-4a14-838a-4cd65a7a2f78 tempest-ProjectReaderTests-482077113 None] Acquiring lock "cinder-quobyte-c7c7206a-6c78-4663-b9f6-af853e462837" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:58:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-104cb6e0-81ba-4b46-b395-94d6344d06a0 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5e56e100-db99-481d-85f3-d1b517d7c1e3 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:23 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-4b18a562-d3b1-4a14-838a-4cd65a7a2f78 tempest-ProjectReaderTests-482077113 None] Lock "cinder-quobyte-c7c7206a-6c78-4663-b9f6-af853e462837" acquired by "delete_volume" :: waited 0.030s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:58:23 devstack sudo[105213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5e56e100-db99-481d-85f3-d1b517d7c1e3 Jul 08 18:58:23 devstack sudo[105213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:23 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f4619c-d9d7-42c3-ac88-9ab2e9748a25]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:58:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-4b18a562-d3b1-4a14-838a-4cd65a7a2f78 tempest-ProjectReaderTests-482077113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c7c7206a-6c78-4663-b9f6-af853e462837 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:23 devstack sudo[105216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c7c7206a-6c78-4663-b9f6-af853e462837 Jul 08 18:58:23 devstack sudo[105216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:23 devstack sudo[105207]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-35148d73-c9b7-4514-a68f-3fae16b8731a tempest-ProjectReaderTests-422434555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7d818df3-c847-4fa6-a50a-cc4c6cd5c365" returned: 0 in 0.880s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-35148d73-c9b7-4514-a68f-3fae16b8731a tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7d818df3-c847-4fa6-a50a-cc4c6cd5c365.219cd0ef-5a36-4090-b990-403049a24eb2 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:23 devstack sudo[105220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7d818df3-c847-4fa6-a50a-cc4c6cd5c365.219cd0ef-5a36-4090-b990-403049a24eb2 Jul 08 18:58:23 devstack sudo[105220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:24 devstack sudo[105213]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-104cb6e0-81ba-4b46-b395-94d6344d06a0 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5e56e100-db99-481d-85f3-d1b517d7c1e3" returned: 0 in 0.786s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:24 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-104cb6e0-81ba-4b46-b395-94d6344d06a0 tempest-ProjectMemberTests-704047872 None] <== create_volume: return (1749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:58:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-104cb6e0-81ba-4b46-b395-94d6344d06a0 tempest-ProjectMemberTests-704047872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.755s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:24 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-104cb6e0-81ba-4b46-b395-94d6344d06a0 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70b734c4-d67a-4e18-ad31-e395bfb3464d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e56e100-db99-481d-85f3-d1b517d7c1e3', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:24 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-104cb6e0-81ba-4b46-b395-94d6344d06a0 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a10e56f-21b5-4de8-a397-e08a0c287542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:24 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-104cb6e0-81ba-4b46-b395-94d6344d06a0 tempest-ProjectMemberTests-704047872 None] Volume volume-5e56e100-db99-481d-85f3-d1b517d7c1e3 (5e56e100-db99-481d-85f3-d1b517d7c1e3): created successfully Jul 08 18:58:24 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-104cb6e0-81ba-4b46-b395-94d6344d06a0 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a10e56f-21b5-4de8-a397-e08a0c287542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:24 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-104cb6e0-81ba-4b46-b395-94d6344d06a0 tempest-ProjectMemberTests-704047872 None] Flow 'volume_create_manager' (66f14877-c28b-4b6d-95d9-89e10237dc60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:58:24 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-104cb6e0-81ba-4b46-b395-94d6344d06a0 tempest-ProjectMemberTests-704047872 None] Created volume successfully. Jul 08 18:58:24 devstack sudo[105216]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-4b18a562-d3b1-4a14-838a-4cd65a7a2f78 tempest-ProjectReaderTests-482077113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c7c7206a-6c78-4663-b9f6-af853e462837" returned: 0 in 0.951s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-4b18a562-d3b1-4a14-838a-4cd65a7a2f78 tempest-ProjectReaderTests-482077113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c7c7206a-6c78-4663-b9f6-af853e462837 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:24 devstack sudo[105220]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-35148d73-c9b7-4514-a68f-3fae16b8731a tempest-ProjectReaderTests-422434555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7d818df3-c847-4fa6-a50a-cc4c6cd5c365.219cd0ef-5a36-4090-b990-403049a24eb2" returned: 0 in 0.814s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-35148d73-c9b7-4514-a68f-3fae16b8731a tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7d818df3-c847-4fa6-a50a-cc4c6cd5c365.219cd0ef-5a36-4090-b990-403049a24eb2 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:24 devstack sudo[105229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c7c7206a-6c78-4663-b9f6-af853e462837 Jul 08 18:58:24 devstack sudo[105229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:24 devstack sudo[105230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7d818df3-c847-4fa6-a50a-cc4c6cd5c365.219cd0ef-5a36-4090-b990-403049a24eb2 Jul 08 18:58:24 devstack sudo[105230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:25 devstack sudo[105229]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-4b18a562-d3b1-4a14-838a-4cd65a7a2f78 tempest-ProjectReaderTests-482077113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-c7c7206a-6c78-4663-b9f6-af853e462837" returned: 0 in 0.746s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:25 devstack sudo[105230]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:25 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-4b18a562-d3b1-4a14-838a-4cd65a7a2f78 tempest-ProjectReaderTests-482077113 None] Lock "cinder-quobyte-c7c7206a-6c78-4663-b9f6-af853e462837" released by "delete_volume" :: held 1.760s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-35148d73-c9b7-4514-a68f-3fae16b8731a tempest-ProjectReaderTests-422434555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7d818df3-c847-4fa6-a50a-cc4c6cd5c365.219cd0ef-5a36-4090-b990-403049a24eb2" returned: 0 in 0.770s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:25 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-35148d73-c9b7-4514-a68f-3fae16b8731a tempest-ProjectReaderTests-422434555 None] Lock "cinder-quobyte-219cd0ef-5a36-4090-b990-403049a24eb2" released by "_delete_snapshot" :: held 3.502s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:25 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-35148d73-c9b7-4514-a68f-3fae16b8731a tempest-ProjectReaderTests-422434555 None] Lock "cinder-quobyte-7d818df3-c847-4fa6-a50a-cc4c6cd5c365" released by "delete_snapshot" :: held 3.533s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-8a4ed5ad-fc9c-46c7-b318-90b5a2e25612 tempest-ProjectMemberTests-704047872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-8a4ed5ad-fc9c-46c7-b318-90b5a2e25612 tempest-ProjectMemberTests-704047872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:25 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-8a4ed5ad-fc9c-46c7-b318-90b5a2e25612 tempest-ProjectMemberTests-704047872 None] Creating offline snapshot c7de6cac-b34a-4698-a6ff-b9af07e81dba of volume 5e56e100-db99-481d-85f3-d1b517d7c1e3 {{(pid=86873) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:58:25 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1e18a7-e5f7-4f09-a568-36cb76fbc3c9]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:58:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8a4ed5ad-fc9c-46c7-b318-90b5a2e25612 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5e56e100-db99-481d-85f3-d1b517d7c1e3 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:25 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-4b18a562-d3b1-4a14-838a-4cd65a7a2f78 tempest-ProjectReaderTests-482077113 None] Created reservations ['5e188911-7478-4b13-9a1c-24dd0e0499c1', 'f700c320-e2c1-48d7-b1d6-8552e71a2e01', 'dad5c1eb-15cd-4823-a7a7-1f08fa6a4060', '9104fdb9-865d-47b6-903e-46547dfe2074'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:58:25 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-35148d73-c9b7-4514-a68f-3fae16b8731a tempest-ProjectReaderTests-422434555 None] Created reservations ['fec39158-5308-4f03-a00e-32cb1cc8f96f', '199f59b9-c1d4-41df-8281-b46bcb0054c4', '06a75d74-0f65-441a-ae55-eabcf4a00341', '4c98c2dc-e9b0-49a4-bf93-9626208f16dc'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:58:25 devstack sudo[105235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5e56e100-db99-481d-85f3-d1b517d7c1e3 Jul 08 18:58:25 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-4b18a562-d3b1-4a14-838a-4cd65a7a2f78 tempest-ProjectReaderTests-482077113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-4b18a562-d3b1-4a14-838a-4cd65a7a2f78 tempest-ProjectReaderTests-482077113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:25 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-4b18a562-d3b1-4a14-838a-4cd65a7a2f78 tempest-ProjectReaderTests-482077113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:58:25 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-4b18a562-d3b1-4a14-838a-4cd65a7a2f78 tempest-ProjectReaderTests-482077113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:58:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-4b18a562-d3b1-4a14-838a-4cd65a7a2f78 tempest-ProjectReaderTests-482077113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-4b18a562-d3b1-4a14-838a-4cd65a7a2f78 tempest-ProjectReaderTests-482077113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:25 devstack sudo[105237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:58:25 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-35148d73-c9b7-4514-a68f-3fae16b8731a tempest-ProjectReaderTests-422434555 None] Delete snapshot completed successfully. Jul 08 18:58:25 devstack sudo[105237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:25 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-35148d73-c9b7-4514-a68f-3fae16b8731a tempest-ProjectReaderTests-422434555 None] Lock "cinder-219cd0ef-5a36-4090-b990-403049a24eb2-delete_snapshot" released by "delete_snapshot" :: held 3.855s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:26 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6a20e456-14f9-48da-a0a8-13417d62222c tempest-ProjectReaderTests-422434555 None] Acquiring lock "cinder-7d818df3-c847-4fa6-a50a-cc4c6cd5c365-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:58:26 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6a20e456-14f9-48da-a0a8-13417d62222c tempest-ProjectReaderTests-422434555 None] Lock "cinder-7d818df3-c847-4fa6-a50a-cc4c6cd5c365-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:58:26 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8a4ed5ad-fc9c-46c7-b318-90b5a2e25612 tempest-ProjectMemberTests-704047872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5e56e100-db99-481d-85f3-d1b517d7c1e3" returned: 0 in 0.929s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8a4ed5ad-fc9c-46c7-b318-90b5a2e25612 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5e56e100-db99-481d-85f3-d1b517d7c1e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5e56e100-db99-481d-85f3-d1b517d7c1e3.c7de6cac-b34a-4698-a6ff-b9af07e81dba 1G {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:26 devstack sudo[105245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5e56e100-db99-481d-85f3-d1b517d7c1e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5e56e100-db99-481d-85f3-d1b517d7c1e3.c7de6cac-b34a-4698-a6ff-b9af07e81dba 1G Jul 08 18:58:26 devstack sudo[105245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:26 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6a20e456-14f9-48da-a0a8-13417d62222c tempest-ProjectReaderTests-422434555 None] Acquiring lock "cinder-quobyte-7d818df3-c847-4fa6-a50a-cc4c6cd5c365" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:58:26 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6a20e456-14f9-48da-a0a8-13417d62222c tempest-ProjectReaderTests-422434555 None] Lock "cinder-quobyte-7d818df3-c847-4fa6-a50a-cc4c6cd5c365" acquired by "delete_volume" :: waited 0.018s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:58:26 devstack sudo[105237]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-4b18a562-d3b1-4a14-838a-4cd65a7a2f78 tempest-ProjectReaderTests-482077113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.897s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:26 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-4b18a562-d3b1-4a14-838a-4cd65a7a2f78 tempest-ProjectReaderTests-482077113 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:58:26 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-4b18a562-d3b1-4a14-838a-4cd65a7a2f78 tempest-ProjectReaderTests-482077113 None] Deleted volume successfully. Jul 08 18:58:26 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2dcec4c-6c6c-422b-b3df-a1a604036105]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:58:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6a20e456-14f9-48da-a0a8-13417d62222c tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7d818df3-c847-4fa6-a50a-cc4c6cd5c365 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:26 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-32fd7505-dd80-49ec-9860-5d42597c1fa8 tempest-ProjectReaderTests-482077113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:58:26 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-32fd7505-dd80-49ec-9860-5d42597c1fa8 tempest-ProjectReaderTests-482077113 None] Flow 'volume_create_manager' (3d85d5f9-ea6c-4208-bccf-846ba00e9c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:58:26 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-32fd7505-dd80-49ec-9860-5d42597c1fa8 tempest-ProjectReaderTests-482077113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3ca2f8a-a892-441e-9b20-1ae48ed25305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:26 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-32fd7505-dd80-49ec-9860-5d42597c1fa8 tempest-ProjectReaderTests-482077113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3ca2f8a-a892-441e-9b20-1ae48ed25305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:58:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1069595996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d8c72c5-0c41-4f75-88dc-f3ff6473fce5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2cb55a5f7d846cbb527b5bdd9e7ccd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:58:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:58:26Z,use_quota=True,user_id='9c785ac07168487b84ec55149a6baaf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:26 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-32fd7505-dd80-49ec-9860-5d42597c1fa8 tempest-ProjectReaderTests-482077113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf49637c-c248-45c9-9969-ec706f5eb182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:26 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-32fd7505-dd80-49ec-9860-5d42597c1fa8 tempest-ProjectReaderTests-482077113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf49637c-c248-45c9-9969-ec706f5eb182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:26 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-32fd7505-dd80-49ec-9860-5d42597c1fa8 tempest-ProjectReaderTests-482077113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b910af5-22a5-40ab-936e-87ad8d9a04a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:26 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-32fd7505-dd80-49ec-9860-5d42597c1fa8 tempest-ProjectReaderTests-482077113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b910af5-22a5-40ab-936e-87ad8d9a04a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d8c72c5-0c41-4f75-88dc-f3ff6473fce5', 'volume_name': 'volume-8d8c72c5-0c41-4f75-88dc-f3ff6473fce5', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:26 devstack sudo[105247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7d818df3-c847-4fa6-a50a-cc4c6cd5c365 Jul 08 18:58:26 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-32fd7505-dd80-49ec-9860-5d42597c1fa8 tempest-ProjectReaderTests-482077113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47830265-7248-4c27-9fa7-b6db01136e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:26 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:26 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-32fd7505-dd80-49ec-9860-5d42597c1fa8 tempest-ProjectReaderTests-482077113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47830265-7248-4c27-9fa7-b6db01136e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:26 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-32fd7505-dd80-49ec-9860-5d42597c1fa8 tempest-ProjectReaderTests-482077113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab3de947-a140-4771-b2cc-08e92ccd3259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:26 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-32fd7505-dd80-49ec-9860-5d42597c1fa8 tempest-ProjectReaderTests-482077113 None] Volume 8d8c72c5-0c41-4f75-88dc-f3ff6473fce5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d8c72c5-0c41-4f75-88dc-f3ff6473fce5', 'volume_size': 1} Jul 08 18:58:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-32fd7505-dd80-49ec-9860-5d42597c1fa8 tempest-ProjectReaderTests-482077113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:26 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-4b18a562-d3b1-4a14-838a-4cd65a7a2f78 tempest-ProjectReaderTests-482077113 None] Lock "cinder-c7c7206a-6c78-4663-b9f6-af853e462837-delete_volume" released by "delete_volume" :: held 3.222s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:27 devstack sudo[105245]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8a4ed5ad-fc9c-46c7-b318-90b5a2e25612 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5e56e100-db99-481d-85f3-d1b517d7c1e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5e56e100-db99-481d-85f3-d1b517d7c1e3.c7de6cac-b34a-4698-a6ff-b9af07e81dba 1G" returned: 0 in 0.895s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8a4ed5ad-fc9c-46c7-b318-90b5a2e25612 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e56e100-db99-481d-85f3-d1b517d7c1e3 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5e56e100-db99-481d-85f3-d1b517d7c1e3.c7de6cac-b34a-4698-a6ff-b9af07e81dba {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:27 devstack sudo[105256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e56e100-db99-481d-85f3-d1b517d7c1e3 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5e56e100-db99-481d-85f3-d1b517d7c1e3.c7de6cac-b34a-4698-a6ff-b9af07e81dba Jul 08 18:58:27 devstack sudo[105256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:27 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6a20e456-14f9-48da-a0a8-13417d62222c tempest-ProjectReaderTests-422434555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7d818df3-c847-4fa6-a50a-cc4c6cd5c365" returned: 0 in 0.826s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6a20e456-14f9-48da-a0a8-13417d62222c tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7d818df3-c847-4fa6-a50a-cc4c6cd5c365 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:27 devstack sudo[105258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7d818df3-c847-4fa6-a50a-cc4c6cd5c365 Jul 08 18:58:27 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:27 devstack sudo[105256]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8a4ed5ad-fc9c-46c7-b318-90b5a2e25612 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e56e100-db99-481d-85f3-d1b517d7c1e3 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5e56e100-db99-481d-85f3-d1b517d7c1e3.c7de6cac-b34a-4698-a6ff-b9af07e81dba" returned: 0 in 0.793s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:27 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-8a4ed5ad-fc9c-46c7-b318-90b5a2e25612 tempest-ProjectMemberTests-704047872 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5e56e100-db99-481d-85f3-d1b517d7c1e3.c7de6cac-b34a-4698-a6ff-b9af07e81dba is being set with open permissions: ugo+rw Jul 08 18:58:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8a4ed5ad-fc9c-46c7-b318-90b5a2e25612 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5e56e100-db99-481d-85f3-d1b517d7c1e3.c7de6cac-b34a-4698-a6ff-b9af07e81dba {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:27 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6a20e456-14f9-48da-a0a8-13417d62222c tempest-ProjectReaderTests-422434555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-7d818df3-c847-4fa6-a50a-cc4c6cd5c365" returned: 0 in 0.734s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:27 devstack sudo[105264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5e56e100-db99-481d-85f3-d1b517d7c1e3.c7de6cac-b34a-4698-a6ff-b9af07e81dba Jul 08 18:58:27 devstack sudo[105264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:27 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6a20e456-14f9-48da-a0a8-13417d62222c tempest-ProjectReaderTests-422434555 None] Lock "cinder-quobyte-7d818df3-c847-4fa6-a50a-cc4c6cd5c365" released by "delete_volume" :: held 1.630s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:28 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-6a20e456-14f9-48da-a0a8-13417d62222c tempest-ProjectReaderTests-422434555 None] Created reservations ['fcbd6d35-f7f6-4bcf-a14c-3427cb8a3b3d', '6b2c41e1-ff72-4dc1-8f40-54b90f81f192', '15f00572-7954-4a66-a328-67606764f40d', 'df5f693a-a892-4463-a621-8abf22ac45a8'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:58:28 devstack sudo[105264]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8a4ed5ad-fc9c-46c7-b318-90b5a2e25612 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5e56e100-db99-481d-85f3-d1b517d7c1e3.c7de6cac-b34a-4698-a6ff-b9af07e81dba" returned: 0 in 0.691s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6a20e456-14f9-48da-a0a8-13417d62222c tempest-ProjectReaderTests-422434555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6a20e456-14f9-48da-a0a8-13417d62222c tempest-ProjectReaderTests-422434555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:28 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-6a20e456-14f9-48da-a0a8-13417d62222c tempest-ProjectReaderTests-422434555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:58:28 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-6a20e456-14f9-48da-a0a8-13417d62222c tempest-ProjectReaderTests-422434555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:58:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-6a20e456-14f9-48da-a0a8-13417d62222c tempest-ProjectReaderTests-422434555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6a20e456-14f9-48da-a0a8-13417d62222c tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8a4ed5ad-fc9c-46c7-b318-90b5a2e25612 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5e56e100-db99-481d-85f3-d1b517d7c1e3.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:28 devstack sudo[105267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:58:28 devstack sudo[105267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:28 devstack sudo[105268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5e56e100-db99-481d-85f3-d1b517d7c1e3.info Jul 08 18:58:28 devstack sudo[105268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:29 devstack sudo[105268]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8a4ed5ad-fc9c-46c7-b318-90b5a2e25612 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5e56e100-db99-481d-85f3-d1b517d7c1e3.info" returned: 0 in 0.716s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:29 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-8a4ed5ad-fc9c-46c7-b318-90b5a2e25612 tempest-ProjectMemberTests-704047872 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5e56e100-db99-481d-85f3-d1b517d7c1e3.info is being set with open permissions: ugo+rw Jul 08 18:58:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8a4ed5ad-fc9c-46c7-b318-90b5a2e25612 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5e56e100-db99-481d-85f3-d1b517d7c1e3.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:29 devstack sudo[105267]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-6a20e456-14f9-48da-a0a8-13417d62222c tempest-ProjectReaderTests-422434555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.755s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:29 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-6a20e456-14f9-48da-a0a8-13417d62222c tempest-ProjectReaderTests-422434555 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:58:29 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-6a20e456-14f9-48da-a0a8-13417d62222c tempest-ProjectReaderTests-422434555 None] Deleted volume successfully. Jul 08 18:58:29 devstack sudo[105273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5e56e100-db99-481d-85f3-d1b517d7c1e3.info Jul 08 18:58:29 devstack sudo[105273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:29 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-6a20e456-14f9-48da-a0a8-13417d62222c tempest-ProjectReaderTests-422434555 None] Lock "cinder-7d818df3-c847-4fa6-a50a-cc4c6cd5c365-delete_volume" released by "delete_volume" :: held 3.390s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:30 devstack sudo[105273]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8a4ed5ad-fc9c-46c7-b318-90b5a2e25612 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5e56e100-db99-481d-85f3-d1b517d7c1e3.info" returned: 0 in 0.708s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-8a4ed5ad-fc9c-46c7-b318-90b5a2e25612 tempest-ProjectMemberTests-704047872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.935s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-32fd7505-dd80-49ec-9860-5d42597c1fa8 tempest-ProjectReaderTests-482077113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.679s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:30 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-32fd7505-dd80-49ec-9860-5d42597c1fa8 tempest-ProjectReaderTests-482077113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:58:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1069595996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d8c72c5-0c41-4f75-88dc-f3ff6473fce5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2cb55a5f7d846cbb527b5bdd9e7ccd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:58:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:58:26Z,use_quota=True,user_id='9c785ac07168487b84ec55149a6baaf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:58:30 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-32fd7505-dd80-49ec-9860-5d42597c1fa8 tempest-ProjectReaderTests-482077113 None] Creating volume 8d8c72c5-0c41-4f75-88dc-f3ff6473fce5 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:58:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-32fd7505-dd80-49ec-9860-5d42597c1fa8 tempest-ProjectReaderTests-482077113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-32fd7505-dd80-49ec-9860-5d42597c1fa8 tempest-ProjectReaderTests-482077113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:30 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-32fd7505-dd80-49ec-9860-5d42597c1fa8 tempest-ProjectReaderTests-482077113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:58:30 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-32fd7505-dd80-49ec-9860-5d42597c1fa8 tempest-ProjectReaderTests-482077113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:58:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-32fd7505-dd80-49ec-9860-5d42597c1fa8 tempest-ProjectReaderTests-482077113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:30 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-32fd7505-dd80-49ec-9860-5d42597c1fa8 tempest-ProjectReaderTests-482077113 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:58:30 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-32fd7505-dd80-49ec-9860-5d42597c1fa8 tempest-ProjectReaderTests-482077113 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:58:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-32fd7505-dd80-49ec-9860-5d42597c1fa8 tempest-ProjectReaderTests-482077113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8d8c72c5-0c41-4f75-88dc-f3ff6473fce5 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:30 devstack sudo[105276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8d8c72c5-0c41-4f75-88dc-f3ff6473fce5 1073741824 Jul 08 18:58:30 devstack sudo[105276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:30 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-8a4ed5ad-fc9c-46c7-b318-90b5a2e25612 tempest-ProjectMemberTests-704047872 None] Create snapshot completed successfully Jul 08 18:58:30 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-bcc279c7-2a3f-4db7-bd4c-b78e9cf21ce1 tempest-ProjectMemberTests-704047872 None] Acquiring lock "cinder-c7de6cac-b34a-4698-a6ff-b9af07e81dba-delete_snapshot" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:58:30 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-bcc279c7-2a3f-4db7-bd4c-b78e9cf21ce1 tempest-ProjectMemberTests-704047872 None] Lock "cinder-c7de6cac-b34a-4698-a6ff-b9af07e81dba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:58:30 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-bcc279c7-2a3f-4db7-bd4c-b78e9cf21ce1 tempest-ProjectMemberTests-704047872 None] Acquiring lock "cinder-quobyte-5e56e100-db99-481d-85f3-d1b517d7c1e3" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:58:30 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-bcc279c7-2a3f-4db7-bd4c-b78e9cf21ce1 tempest-ProjectMemberTests-704047872 None] Lock "cinder-quobyte-5e56e100-db99-481d-85f3-d1b517d7c1e3" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:58:30 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-bcc279c7-2a3f-4db7-bd4c-b78e9cf21ce1 tempest-ProjectMemberTests-704047872 None] Acquiring lock "cinder-quobyte-c7de6cac-b34a-4698-a6ff-b9af07e81dba" by "_delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:58:30 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-bcc279c7-2a3f-4db7-bd4c-b78e9cf21ce1 tempest-ProjectMemberTests-704047872 None] Lock "cinder-quobyte-c7de6cac-b34a-4698-a6ff-b9af07e81dba" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:58:30 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-bcc279c7-2a3f-4db7-bd4c-b78e9cf21ce1 tempest-ProjectMemberTests-704047872 None] Deleting offline snapshot c7de6cac-b34a-4698-a6ff-b9af07e81dba of volume 5e56e100-db99-481d-85f3-d1b517d7c1e3 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:58:30 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-bcc279c7-2a3f-4db7-bd4c-b78e9cf21ce1 tempest-ProjectMemberTests-704047872 None] snapshot_file for this snap is: volume-5e56e100-db99-481d-85f3-d1b517d7c1e3.c7de6cac-b34a-4698-a6ff-b9af07e81dba {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:58:30 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e031c5b-d73c-492a-a6d9-30adc0b31bfb]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:58:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-bcc279c7-2a3f-4db7-bd4c-b78e9cf21ce1 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5e56e100-db99-481d-85f3-d1b517d7c1e3.c7de6cac-b34a-4698-a6ff-b9af07e81dba {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:30 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa310fd9-7020-4072-856a-2a1e3a73ac29 tempest-ProjectReaderTests-422434555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:58:30 devstack sudo[105278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5e56e100-db99-481d-85f3-d1b517d7c1e3.c7de6cac-b34a-4698-a6ff-b9af07e81dba Jul 08 18:58:30 devstack sudo[105278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:30 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fa310fd9-7020-4072-856a-2a1e3a73ac29 tempest-ProjectReaderTests-422434555 None] Flow 'volume_create_manager' (257ac26e-c23e-4ab9-88f8-b709b9bbfddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:58:30 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fa310fd9-7020-4072-856a-2a1e3a73ac29 tempest-ProjectReaderTests-422434555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42c0b804-f9ba-4d6c-9ecf-fcacaf932d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:30 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fa310fd9-7020-4072-856a-2a1e3a73ac29 tempest-ProjectReaderTests-422434555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42c0b804-f9ba-4d6c-9ecf-fcacaf932d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:58:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1280889301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d840737-5552-408c-8ccb-30f1f01099d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29c32154c507487cbafd67a692df63f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:58:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:58:31Z,use_quota=True,user_id='2a3842f74d0646b8824351eff025b80e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:30 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fa310fd9-7020-4072-856a-2a1e3a73ac29 tempest-ProjectReaderTests-422434555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb930697-28f4-4078-9e70-4b7b6cfffecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:30 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fa310fd9-7020-4072-856a-2a1e3a73ac29 tempest-ProjectReaderTests-422434555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb930697-28f4-4078-9e70-4b7b6cfffecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:30 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fa310fd9-7020-4072-856a-2a1e3a73ac29 tempest-ProjectReaderTests-422434555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd66bfa3-2433-44cb-8482-e6c9399af93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:30 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fa310fd9-7020-4072-856a-2a1e3a73ac29 tempest-ProjectReaderTests-422434555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd66bfa3-2433-44cb-8482-e6c9399af93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d840737-5552-408c-8ccb-30f1f01099d3', 'volume_name': 'volume-9d840737-5552-408c-8ccb-30f1f01099d3', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:30 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fa310fd9-7020-4072-856a-2a1e3a73ac29 tempest-ProjectReaderTests-422434555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fd24f4c-3d10-461a-a901-01b53dd97a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:30 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fa310fd9-7020-4072-856a-2a1e3a73ac29 tempest-ProjectReaderTests-422434555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fd24f4c-3d10-461a-a901-01b53dd97a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:30 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fa310fd9-7020-4072-856a-2a1e3a73ac29 tempest-ProjectReaderTests-422434555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50d2ca02-7e11-493b-8e47-7f50ae36c35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:30 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-fa310fd9-7020-4072-856a-2a1e3a73ac29 tempest-ProjectReaderTests-422434555 None] Volume 9d840737-5552-408c-8ccb-30f1f01099d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d840737-5552-408c-8ccb-30f1f01099d3', 'volume_size': 1} Jul 08 18:58:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-fa310fd9-7020-4072-856a-2a1e3a73ac29 tempest-ProjectReaderTests-422434555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:31 devstack sudo[105276]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-32fd7505-dd80-49ec-9860-5d42597c1fa8 tempest-ProjectReaderTests-482077113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8d8c72c5-0c41-4f75-88dc-f3ff6473fce5 1073741824" returned: 0 in 1.053s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-32fd7505-dd80-49ec-9860-5d42597c1fa8 tempest-ProjectReaderTests-482077113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8d8c72c5-0c41-4f75-88dc-f3ff6473fce5 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:31 devstack sudo[105284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8d8c72c5-0c41-4f75-88dc-f3ff6473fce5 Jul 08 18:58:31 devstack sudo[105284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:31 devstack sudo[105278]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-bcc279c7-2a3f-4db7-bd4c-b78e9cf21ce1 tempest-ProjectMemberTests-704047872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5e56e100-db99-481d-85f3-d1b517d7c1e3.c7de6cac-b34a-4698-a6ff-b9af07e81dba" returned: 0 in 0.896s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:31 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-bcc279c7-2a3f-4db7-bd4c-b78e9cf21ce1 tempest-ProjectMemberTests-704047872 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e56e100-db99-481d-85f3-d1b517d7c1e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:58:31 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd678de-ed13-418d-b662-32e7cb8f0ec7]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:58:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-bcc279c7-2a3f-4db7-bd4c-b78e9cf21ce1 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5e56e100-db99-481d-85f3-d1b517d7c1e3 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:31 devstack sudo[105289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5e56e100-db99-481d-85f3-d1b517d7c1e3 Jul 08 18:58:31 devstack sudo[105289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:32 devstack sudo[105284]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:32 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-32fd7505-dd80-49ec-9860-5d42597c1fa8 tempest-ProjectReaderTests-482077113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8d8c72c5-0c41-4f75-88dc-f3ff6473fce5" returned: 0 in 0.803s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:32 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-32fd7505-dd80-49ec-9860-5d42597c1fa8 tempest-ProjectReaderTests-482077113 None] <== create_volume: return (1906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:58:32 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-32fd7505-dd80-49ec-9860-5d42597c1fa8 tempest-ProjectReaderTests-482077113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.909s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:32 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-fa310fd9-7020-4072-856a-2a1e3a73ac29 tempest-ProjectReaderTests-422434555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.241s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:32 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-fa310fd9-7020-4072-856a-2a1e3a73ac29 tempest-ProjectReaderTests-422434555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:58:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1280889301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d840737-5552-408c-8ccb-30f1f01099d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29c32154c507487cbafd67a692df63f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:58:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:58:31Z,use_quota=True,user_id='2a3842f74d0646b8824351eff025b80e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:58:32 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-fa310fd9-7020-4072-856a-2a1e3a73ac29 tempest-ProjectReaderTests-422434555 None] Creating volume 9d840737-5552-408c-8ccb-30f1f01099d3 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:58:32 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-fa310fd9-7020-4072-856a-2a1e3a73ac29 tempest-ProjectReaderTests-422434555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:32 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-fa310fd9-7020-4072-856a-2a1e3a73ac29 tempest-ProjectReaderTests-422434555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:32 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-fa310fd9-7020-4072-856a-2a1e3a73ac29 tempest-ProjectReaderTests-422434555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:58:32 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-fa310fd9-7020-4072-856a-2a1e3a73ac29 tempest-ProjectReaderTests-422434555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:58:32 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-fa310fd9-7020-4072-856a-2a1e3a73ac29 tempest-ProjectReaderTests-422434555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:32 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-fa310fd9-7020-4072-856a-2a1e3a73ac29 tempest-ProjectReaderTests-422434555 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:58:32 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-fa310fd9-7020-4072-856a-2a1e3a73ac29 tempest-ProjectReaderTests-422434555 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:58:32 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-fa310fd9-7020-4072-856a-2a1e3a73ac29 tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9d840737-5552-408c-8ccb-30f1f01099d3 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:32 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-32fd7505-dd80-49ec-9860-5d42597c1fa8 tempest-ProjectReaderTests-482077113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab3de947-a140-4771-b2cc-08e92ccd3259) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d8c72c5-0c41-4f75-88dc-f3ff6473fce5', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:32 devstack sudo[105292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9d840737-5552-408c-8ccb-30f1f01099d3 1073741824 Jul 08 18:58:32 devstack sudo[105292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:32 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-32fd7505-dd80-49ec-9860-5d42597c1fa8 tempest-ProjectReaderTests-482077113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9b7770b-0cfb-421f-96fd-d06586b1bbbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:32 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-32fd7505-dd80-49ec-9860-5d42597c1fa8 tempest-ProjectReaderTests-482077113 None] Volume volume-8d8c72c5-0c41-4f75-88dc-f3ff6473fce5 (8d8c72c5-0c41-4f75-88dc-f3ff6473fce5): created successfully Jul 08 18:58:32 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-32fd7505-dd80-49ec-9860-5d42597c1fa8 tempest-ProjectReaderTests-482077113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9b7770b-0cfb-421f-96fd-d06586b1bbbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:32 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-32fd7505-dd80-49ec-9860-5d42597c1fa8 tempest-ProjectReaderTests-482077113 None] Flow 'volume_create_manager' (3d85d5f9-ea6c-4208-bccf-846ba00e9c6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:58:32 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-32fd7505-dd80-49ec-9860-5d42597c1fa8 tempest-ProjectReaderTests-482077113 None] Created volume successfully. Jul 08 18:58:32 devstack sudo[105289]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:32 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-bcc279c7-2a3f-4db7-bd4c-b78e9cf21ce1 tempest-ProjectMemberTests-704047872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5e56e100-db99-481d-85f3-d1b517d7c1e3" returned: 0 in 0.885s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:32 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-bcc279c7-2a3f-4db7-bd4c-b78e9cf21ce1 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5e56e100-db99-481d-85f3-d1b517d7c1e3.c7de6cac-b34a-4698-a6ff-b9af07e81dba {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:32 devstack sudo[105297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5e56e100-db99-481d-85f3-d1b517d7c1e3.c7de6cac-b34a-4698-a6ff-b9af07e81dba Jul 08 18:58:32 devstack sudo[105297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:32 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ec2f89a9-899e-4141-b060-8a885b8f1abb tempest-ProjectReaderTests-482077113 None] Acquiring lock "cinder-8d8c72c5-0c41-4f75-88dc-f3ff6473fce5-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:58:32 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ec2f89a9-899e-4141-b060-8a885b8f1abb tempest-ProjectReaderTests-482077113 None] Lock "cinder-8d8c72c5-0c41-4f75-88dc-f3ff6473fce5-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:58:32 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:SELECT=159,cinder:INSERT=66,cinder:UPDATE=234,cinder:DELETE=16 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:58:32 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ec2f89a9-899e-4141-b060-8a885b8f1abb tempest-ProjectReaderTests-482077113 None] Acquiring lock "cinder-quobyte-8d8c72c5-0c41-4f75-88dc-f3ff6473fce5" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:58:32 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ec2f89a9-899e-4141-b060-8a885b8f1abb tempest-ProjectReaderTests-482077113 None] Lock "cinder-quobyte-8d8c72c5-0c41-4f75-88dc-f3ff6473fce5" acquired by "delete_volume" :: waited 0.022s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:58:32 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7d24ca-ae48-4dd0-a1e8-a0bb507bb7e6]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:58:32 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ec2f89a9-899e-4141-b060-8a885b8f1abb tempest-ProjectReaderTests-482077113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8d8c72c5-0c41-4f75-88dc-f3ff6473fce5 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:33 devstack sudo[105303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8d8c72c5-0c41-4f75-88dc-f3ff6473fce5 Jul 08 18:58:33 devstack sudo[105303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:33 devstack sudo[105292]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-fa310fd9-7020-4072-856a-2a1e3a73ac29 tempest-ProjectReaderTests-422434555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9d840737-5552-408c-8ccb-30f1f01099d3 1073741824" returned: 0 in 1.132s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:33 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:SELECT=169,cinder:UPDATE=217,cinder:INSERT=56,cinder:DELETE=21 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:58:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-fa310fd9-7020-4072-856a-2a1e3a73ac29 tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9d840737-5552-408c-8ccb-30f1f01099d3 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:33 devstack sudo[105309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9d840737-5552-408c-8ccb-30f1f01099d3 Jul 08 18:58:33 devstack sudo[105309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:33 devstack sudo[105297]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-bcc279c7-2a3f-4db7-bd4c-b78e9cf21ce1 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5e56e100-db99-481d-85f3-d1b517d7c1e3.c7de6cac-b34a-4698-a6ff-b9af07e81dba" returned: 0 in 1.058s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-bcc279c7-2a3f-4db7-bd4c-b78e9cf21ce1 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5e56e100-db99-481d-85f3-d1b517d7c1e3.c7de6cac-b34a-4698-a6ff-b9af07e81dba {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:33 devstack sudo[105311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5e56e100-db99-481d-85f3-d1b517d7c1e3.c7de6cac-b34a-4698-a6ff-b9af07e81dba Jul 08 18:58:33 devstack sudo[105311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:33 devstack sudo[105303]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ec2f89a9-899e-4141-b060-8a885b8f1abb tempest-ProjectReaderTests-482077113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8d8c72c5-0c41-4f75-88dc-f3ff6473fce5" returned: 0 in 1.036s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ec2f89a9-899e-4141-b060-8a885b8f1abb tempest-ProjectReaderTests-482077113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8d8c72c5-0c41-4f75-88dc-f3ff6473fce5 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:33 devstack sudo[105316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8d8c72c5-0c41-4f75-88dc-f3ff6473fce5 Jul 08 18:58:33 devstack sudo[105316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:34 devstack sudo[105309]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-fa310fd9-7020-4072-856a-2a1e3a73ac29 tempest-ProjectReaderTests-422434555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9d840737-5552-408c-8ccb-30f1f01099d3" returned: 0 in 0.855s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:34 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-fa310fd9-7020-4072-856a-2a1e3a73ac29 tempest-ProjectReaderTests-422434555 None] <== create_volume: return (2063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:58:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-fa310fd9-7020-4072-856a-2a1e3a73ac29 tempest-ProjectReaderTests-422434555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.069s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:34 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fa310fd9-7020-4072-856a-2a1e3a73ac29 tempest-ProjectReaderTests-422434555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50d2ca02-7e11-493b-8e47-7f50ae36c35e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d840737-5552-408c-8ccb-30f1f01099d3', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:34 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fa310fd9-7020-4072-856a-2a1e3a73ac29 tempest-ProjectReaderTests-422434555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (712023a7-8dfb-4eb8-a732-58a96a091e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:34 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-fa310fd9-7020-4072-856a-2a1e3a73ac29 tempest-ProjectReaderTests-422434555 None] Volume volume-9d840737-5552-408c-8ccb-30f1f01099d3 (9d840737-5552-408c-8ccb-30f1f01099d3): created successfully Jul 08 18:58:34 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fa310fd9-7020-4072-856a-2a1e3a73ac29 tempest-ProjectReaderTests-422434555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (712023a7-8dfb-4eb8-a732-58a96a091e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:34 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fa310fd9-7020-4072-856a-2a1e3a73ac29 tempest-ProjectReaderTests-422434555 None] Flow 'volume_create_manager' (257ac26e-c23e-4ab9-88f8-b709b9bbfddd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:58:34 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-fa310fd9-7020-4072-856a-2a1e3a73ac29 tempest-ProjectReaderTests-422434555 None] Created volume successfully. Jul 08 18:58:34 devstack sudo[105311]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-bcc279c7-2a3f-4db7-bd4c-b78e9cf21ce1 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5e56e100-db99-481d-85f3-d1b517d7c1e3.c7de6cac-b34a-4698-a6ff-b9af07e81dba" returned: 0 in 0.822s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:34 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-bcc279c7-2a3f-4db7-bd4c-b78e9cf21ce1 tempest-ProjectMemberTests-704047872 None] Lock "cinder-quobyte-c7de6cac-b34a-4698-a6ff-b9af07e81dba" released by "_delete_snapshot" :: held 3.793s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:34 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-bcc279c7-2a3f-4db7-bd4c-b78e9cf21ce1 tempest-ProjectMemberTests-704047872 None] Lock "cinder-quobyte-5e56e100-db99-481d-85f3-d1b517d7c1e3" released by "delete_snapshot" :: held 3.822s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:34 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-bcc279c7-2a3f-4db7-bd4c-b78e9cf21ce1 tempest-ProjectMemberTests-704047872 None] Created reservations ['d7b59407-c62e-4f88-95bd-5a63ac1884e8', '7c519bcd-4b31-4c25-8199-c634ab8b45cc', 'df0c04a2-374b-4160-a2a5-7e1429824424', '28e1fb7c-164e-4f0c-be4d-2554a9cf5340'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:58:34 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-bcc279c7-2a3f-4db7-bd4c-b78e9cf21ce1 tempest-ProjectMemberTests-704047872 None] Delete snapshot completed successfully. Jul 08 18:58:34 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-bcc279c7-2a3f-4db7-bd4c-b78e9cf21ce1 tempest-ProjectMemberTests-704047872 None] Lock "cinder-c7de6cac-b34a-4698-a6ff-b9af07e81dba-delete_snapshot" released by "delete_snapshot" :: held 3.983s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:34 devstack sudo[105316]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ec2f89a9-899e-4141-b060-8a885b8f1abb tempest-ProjectReaderTests-482077113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8d8c72c5-0c41-4f75-88dc-f3ff6473fce5" returned: 0 in 0.716s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:34 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ec2f89a9-899e-4141-b060-8a885b8f1abb tempest-ProjectReaderTests-482077113 None] Lock "cinder-quobyte-8d8c72c5-0c41-4f75-88dc-f3ff6473fce5" released by "delete_volume" :: held 1.807s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:34 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-ec2f89a9-899e-4141-b060-8a885b8f1abb tempest-ProjectReaderTests-482077113 None] Created reservations ['ff654855-d113-4c80-8e42-ecd963c32633', '0d6af57e-1b12-4e6b-a33a-590b701231a3', '7ab63ff2-d9ac-4bf0-8e36-cf834d229006', 'de66963e-3090-4460-bed9-8baded693c47'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:58:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-ec2f89a9-899e-4141-b060-8a885b8f1abb tempest-ProjectReaderTests-482077113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-ec2f89a9-899e-4141-b060-8a885b8f1abb tempest-ProjectReaderTests-482077113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:34 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-ec2f89a9-899e-4141-b060-8a885b8f1abb tempest-ProjectReaderTests-482077113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:58:34 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-ec2f89a9-899e-4141-b060-8a885b8f1abb tempest-ProjectReaderTests-482077113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:58:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-ec2f89a9-899e-4141-b060-8a885b8f1abb tempest-ProjectReaderTests-482077113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ec2f89a9-899e-4141-b060-8a885b8f1abb tempest-ProjectReaderTests-482077113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:34 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9b5a420c-f8a8-4cf0-a798-127585dc2f2e tempest-ProjectMemberTests-704047872 None] Acquiring lock "cinder-5e56e100-db99-481d-85f3-d1b517d7c1e3-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:58:34 devstack sudo[105321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:58:34 devstack sudo[105321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:34 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9b5a420c-f8a8-4cf0-a798-127585dc2f2e tempest-ProjectMemberTests-704047872 None] Lock "cinder-5e56e100-db99-481d-85f3-d1b517d7c1e3-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:58:34 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9b5a420c-f8a8-4cf0-a798-127585dc2f2e tempest-ProjectMemberTests-704047872 None] Acquiring lock "cinder-quobyte-5e56e100-db99-481d-85f3-d1b517d7c1e3" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:58:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-48d1caff-c700-4f66-a150-6f4c061565ec tempest-ProjectReaderTests-422434555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-48d1caff-c700-4f66-a150-6f4c061565ec tempest-ProjectReaderTests-422434555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:35 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9b5a420c-f8a8-4cf0-a798-127585dc2f2e tempest-ProjectMemberTests-704047872 None] Lock "cinder-quobyte-5e56e100-db99-481d-85f3-d1b517d7c1e3" acquired by "delete_volume" :: waited 0.024s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:58:35 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-48d1caff-c700-4f66-a150-6f4c061565ec tempest-ProjectReaderTests-422434555 None] Creating offline snapshot f6c3225e-8204-43b7-8b21-288bffcb0446 of volume 9d840737-5552-408c-8ccb-30f1f01099d3 {{(pid=86873) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:58:35 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[820757cc-a0b6-43d8-a071-07f39314a9b0]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:58:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9b5a420c-f8a8-4cf0-a798-127585dc2f2e tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5e56e100-db99-481d-85f3-d1b517d7c1e3 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:35 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[8837db35-f26a-42b9-b235-33e9bbc62ea1]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:58:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-48d1caff-c700-4f66-a150-6f4c061565ec tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9d840737-5552-408c-8ccb-30f1f01099d3 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:35 devstack sudo[105323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5e56e100-db99-481d-85f3-d1b517d7c1e3 Jul 08 18:58:35 devstack sudo[105323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:35 devstack sudo[105324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9d840737-5552-408c-8ccb-30f1f01099d3 Jul 08 18:58:35 devstack sudo[105324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:35 devstack sudo[105321]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ec2f89a9-899e-4141-b060-8a885b8f1abb tempest-ProjectReaderTests-482077113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 1.133s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:35 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-ec2f89a9-899e-4141-b060-8a885b8f1abb tempest-ProjectReaderTests-482077113 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:58:35 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-ec2f89a9-899e-4141-b060-8a885b8f1abb tempest-ProjectReaderTests-482077113 None] Deleted volume successfully. Jul 08 18:58:36 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ec2f89a9-899e-4141-b060-8a885b8f1abb tempest-ProjectReaderTests-482077113 None] Lock "cinder-8d8c72c5-0c41-4f75-88dc-f3ff6473fce5-delete_volume" released by "delete_volume" :: held 3.293s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:36 devstack sudo[105323]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9b5a420c-f8a8-4cf0-a798-127585dc2f2e tempest-ProjectMemberTests-704047872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5e56e100-db99-481d-85f3-d1b517d7c1e3" returned: 0 in 1.059s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9b5a420c-f8a8-4cf0-a798-127585dc2f2e tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5e56e100-db99-481d-85f3-d1b517d7c1e3 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:36 devstack sudo[105324]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-48d1caff-c700-4f66-a150-6f4c061565ec tempest-ProjectReaderTests-422434555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9d840737-5552-408c-8ccb-30f1f01099d3" returned: 0 in 1.075s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-48d1caff-c700-4f66-a150-6f4c061565ec tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9d840737-5552-408c-8ccb-30f1f01099d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9d840737-5552-408c-8ccb-30f1f01099d3.f6c3225e-8204-43b7-8b21-288bffcb0446 1G {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:36 devstack sudo[105334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5e56e100-db99-481d-85f3-d1b517d7c1e3 Jul 08 18:58:36 devstack sudo[105334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:36 devstack sudo[105335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9d840737-5552-408c-8ccb-30f1f01099d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9d840737-5552-408c-8ccb-30f1f01099d3.f6c3225e-8204-43b7-8b21-288bffcb0446 1G Jul 08 18:58:36 devstack sudo[105335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:37 devstack sudo[105334]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9b5a420c-f8a8-4cf0-a798-127585dc2f2e tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-5e56e100-db99-481d-85f3-d1b517d7c1e3" returned: 0 in 0.946s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:37 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9b5a420c-f8a8-4cf0-a798-127585dc2f2e tempest-ProjectMemberTests-704047872 None] Lock "cinder-quobyte-5e56e100-db99-481d-85f3-d1b517d7c1e3" released by "delete_volume" :: held 2.121s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:37 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-9b5a420c-f8a8-4cf0-a798-127585dc2f2e tempest-ProjectMemberTests-704047872 None] Created reservations ['667f9f80-847f-4a80-828a-02db39c3b941', 'd41170ac-011d-4688-beb7-fadf0fd25538', 'f747ff6c-78d4-4a97-822f-6ae001971020', '2a8a3cd6-28e3-4c41-95c8-0c28e1e05197'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:58:37 devstack sudo[105335]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-48d1caff-c700-4f66-a150-6f4c061565ec tempest-ProjectReaderTests-422434555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9d840737-5552-408c-8ccb-30f1f01099d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9d840737-5552-408c-8ccb-30f1f01099d3.f6c3225e-8204-43b7-8b21-288bffcb0446 1G" returned: 0 in 1.081s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-48d1caff-c700-4f66-a150-6f4c061565ec tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d840737-5552-408c-8ccb-30f1f01099d3 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9d840737-5552-408c-8ccb-30f1f01099d3.f6c3225e-8204-43b7-8b21-288bffcb0446 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:37 devstack sudo[105343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d840737-5552-408c-8ccb-30f1f01099d3 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9d840737-5552-408c-8ccb-30f1f01099d3.f6c3225e-8204-43b7-8b21-288bffcb0446 Jul 08 18:58:37 devstack sudo[105343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-9b5a420c-f8a8-4cf0-a798-127585dc2f2e tempest-ProjectMemberTests-704047872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-9b5a420c-f8a8-4cf0-a798-127585dc2f2e tempest-ProjectMemberTests-704047872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:37 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-9b5a420c-f8a8-4cf0-a798-127585dc2f2e tempest-ProjectMemberTests-704047872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:58:37 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-9b5a420c-f8a8-4cf0-a798-127585dc2f2e tempest-ProjectMemberTests-704047872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:58:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-9b5a420c-f8a8-4cf0-a798-127585dc2f2e tempest-ProjectMemberTests-704047872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9b5a420c-f8a8-4cf0-a798-127585dc2f2e tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:37 devstack sudo[105345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:58:37 devstack sudo[105345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:38 devstack sudo[105343]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:38 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-48d1caff-c700-4f66-a150-6f4c061565ec tempest-ProjectReaderTests-422434555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d840737-5552-408c-8ccb-30f1f01099d3 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9d840737-5552-408c-8ccb-30f1f01099d3.f6c3225e-8204-43b7-8b21-288bffcb0446" returned: 0 in 0.876s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:38 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-48d1caff-c700-4f66-a150-6f4c061565ec tempest-ProjectReaderTests-422434555 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9d840737-5552-408c-8ccb-30f1f01099d3.f6c3225e-8204-43b7-8b21-288bffcb0446 is being set with open permissions: ugo+rw Jul 08 18:58:38 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-48d1caff-c700-4f66-a150-6f4c061565ec tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9d840737-5552-408c-8ccb-30f1f01099d3.f6c3225e-8204-43b7-8b21-288bffcb0446 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:38 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9d840737-5552-408c-8ccb-30f1f01099d3.f6c3225e-8204-43b7-8b21-288bffcb0446 Jul 08 18:58:38 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:38 devstack sudo[105345]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:38 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9b5a420c-f8a8-4cf0-a798-127585dc2f2e tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.945s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:38 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-9b5a420c-f8a8-4cf0-a798-127585dc2f2e tempest-ProjectMemberTests-704047872 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:58:38 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-9b5a420c-f8a8-4cf0-a798-127585dc2f2e tempest-ProjectMemberTests-704047872 None] Deleted volume successfully. Jul 08 18:58:38 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9b5a420c-f8a8-4cf0-a798-127585dc2f2e tempest-ProjectMemberTests-704047872 None] Lock "cinder-5e56e100-db99-481d-85f3-d1b517d7c1e3-delete_volume" released by "delete_volume" :: held 3.498s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:38 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-0954ae9a-5e1c-468d-9dee-fb5728340e61 tempest-ProjectMemberTests-704047872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:58:38 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:38 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-0954ae9a-5e1c-468d-9dee-fb5728340e61 tempest-ProjectMemberTests-704047872 None] Flow 'volume_create_manager' (8cbc43fa-c48e-4718-bb00-43eb599b4dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:58:38 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-0954ae9a-5e1c-468d-9dee-fb5728340e61 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78e1fdf3-e46b-4a54-80f1-ee33e5034256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:38 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-48d1caff-c700-4f66-a150-6f4c061565ec tempest-ProjectReaderTests-422434555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9d840737-5552-408c-8ccb-30f1f01099d3.f6c3225e-8204-43b7-8b21-288bffcb0446" returned: 0 in 0.786s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:38 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-0954ae9a-5e1c-468d-9dee-fb5728340e61 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78e1fdf3-e46b-4a54-80f1-ee33e5034256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:58:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1977056864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=544cd579-5ae3-4370-8a5a-d987d7a3a261,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23f6feda0dc341ae9dff1be67ef4c54c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:58:39Z,use_quota=True,user_id='ebff52e9980446ed8de939cd8116db5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:38 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-0954ae9a-5e1c-468d-9dee-fb5728340e61 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6041eb2d-4f37-49c1-adb9-e6eb8de85648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:38 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-0954ae9a-5e1c-468d-9dee-fb5728340e61 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6041eb2d-4f37-49c1-adb9-e6eb8de85648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:38 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-0954ae9a-5e1c-468d-9dee-fb5728340e61 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1b051a2-0307-493d-939b-f8163118295a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:38 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-0954ae9a-5e1c-468d-9dee-fb5728340e61 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1b051a2-0307-493d-939b-f8163118295a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '544cd579-5ae3-4370-8a5a-d987d7a3a261', 'volume_name': 'volume-544cd579-5ae3-4370-8a5a-d987d7a3a261', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:38 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-0954ae9a-5e1c-468d-9dee-fb5728340e61 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0786f0c5-eaf5-4431-98eb-68f7a6b451f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:38 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-0954ae9a-5e1c-468d-9dee-fb5728340e61 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0786f0c5-eaf5-4431-98eb-68f7a6b451f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:38 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-0954ae9a-5e1c-468d-9dee-fb5728340e61 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cd9c510-d82e-4077-998c-279729590ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:38 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-0954ae9a-5e1c-468d-9dee-fb5728340e61 tempest-ProjectMemberTests-704047872 None] Volume 544cd579-5ae3-4370-8a5a-d987d7a3a261: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-544cd579-5ae3-4370-8a5a-d987d7a3a261', 'volume_size': 1} Jul 08 18:58:38 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-0954ae9a-5e1c-468d-9dee-fb5728340e61 tempest-ProjectMemberTests-704047872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:39 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-48d1caff-c700-4f66-a150-6f4c061565ec tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9d840737-5552-408c-8ccb-30f1f01099d3.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:39 devstack sudo[105355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9d840737-5552-408c-8ccb-30f1f01099d3.info Jul 08 18:58:39 devstack sudo[105355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:39 devstack sudo[105355]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:39 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-48d1caff-c700-4f66-a150-6f4c061565ec tempest-ProjectReaderTests-422434555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9d840737-5552-408c-8ccb-30f1f01099d3.info" returned: 0 in 0.726s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:39 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-48d1caff-c700-4f66-a150-6f4c061565ec tempest-ProjectReaderTests-422434555 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9d840737-5552-408c-8ccb-30f1f01099d3.info is being set with open permissions: ugo+rw Jul 08 18:58:39 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-48d1caff-c700-4f66-a150-6f4c061565ec tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9d840737-5552-408c-8ccb-30f1f01099d3.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:39 devstack sudo[105358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9d840737-5552-408c-8ccb-30f1f01099d3.info Jul 08 18:58:39 devstack sudo[105358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:40 devstack sudo[105358]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-48d1caff-c700-4f66-a150-6f4c061565ec tempest-ProjectReaderTests-422434555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9d840737-5552-408c-8ccb-30f1f01099d3.info" returned: 0 in 0.781s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-48d1caff-c700-4f66-a150-6f4c061565ec tempest-ProjectReaderTests-422434555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.519s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-0954ae9a-5e1c-468d-9dee-fb5728340e61 tempest-ProjectMemberTests-704047872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.548s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:40 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-0954ae9a-5e1c-468d-9dee-fb5728340e61 tempest-ProjectMemberTests-704047872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:58:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1977056864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=544cd579-5ae3-4370-8a5a-d987d7a3a261,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23f6feda0dc341ae9dff1be67ef4c54c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:58:39Z,use_quota=True,user_id='ebff52e9980446ed8de939cd8116db5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:58:40 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-0954ae9a-5e1c-468d-9dee-fb5728340e61 tempest-ProjectMemberTests-704047872 None] Creating volume 544cd579-5ae3-4370-8a5a-d987d7a3a261 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:58:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-0954ae9a-5e1c-468d-9dee-fb5728340e61 tempest-ProjectMemberTests-704047872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-0954ae9a-5e1c-468d-9dee-fb5728340e61 tempest-ProjectMemberTests-704047872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:40 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-0954ae9a-5e1c-468d-9dee-fb5728340e61 tempest-ProjectMemberTests-704047872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:58:40 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-0954ae9a-5e1c-468d-9dee-fb5728340e61 tempest-ProjectMemberTests-704047872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:58:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-0954ae9a-5e1c-468d-9dee-fb5728340e61 tempest-ProjectMemberTests-704047872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:40 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-0954ae9a-5e1c-468d-9dee-fb5728340e61 tempest-ProjectMemberTests-704047872 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:58:40 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-0954ae9a-5e1c-468d-9dee-fb5728340e61 tempest-ProjectMemberTests-704047872 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:58:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-0954ae9a-5e1c-468d-9dee-fb5728340e61 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-544cd579-5ae3-4370-8a5a-d987d7a3a261 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:40 devstack sudo[105361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-544cd579-5ae3-4370-8a5a-d987d7a3a261 1073741824 Jul 08 18:58:40 devstack sudo[105361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:40 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-48d1caff-c700-4f66-a150-6f4c061565ec tempest-ProjectReaderTests-422434555 None] Create snapshot completed successfully Jul 08 18:58:41 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-91aabdcf-8ac8-4eee-b063-c6d124a98663 tempest-ProjectReaderTests-422434555 None] Acquiring lock "cinder-f6c3225e-8204-43b7-8b21-288bffcb0446-delete_snapshot" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:58:41 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-91aabdcf-8ac8-4eee-b063-c6d124a98663 tempest-ProjectReaderTests-422434555 None] Lock "cinder-f6c3225e-8204-43b7-8b21-288bffcb0446-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:58:41 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-91aabdcf-8ac8-4eee-b063-c6d124a98663 tempest-ProjectReaderTests-422434555 None] Acquiring lock "cinder-quobyte-9d840737-5552-408c-8ccb-30f1f01099d3" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:58:41 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-91aabdcf-8ac8-4eee-b063-c6d124a98663 tempest-ProjectReaderTests-422434555 None] Lock "cinder-quobyte-9d840737-5552-408c-8ccb-30f1f01099d3" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:58:41 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-91aabdcf-8ac8-4eee-b063-c6d124a98663 tempest-ProjectReaderTests-422434555 None] Acquiring lock "cinder-quobyte-f6c3225e-8204-43b7-8b21-288bffcb0446" by "_delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:58:41 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-91aabdcf-8ac8-4eee-b063-c6d124a98663 tempest-ProjectReaderTests-422434555 None] Lock "cinder-quobyte-f6c3225e-8204-43b7-8b21-288bffcb0446" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:58:41 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-91aabdcf-8ac8-4eee-b063-c6d124a98663 tempest-ProjectReaderTests-422434555 None] Deleting offline snapshot f6c3225e-8204-43b7-8b21-288bffcb0446 of volume 9d840737-5552-408c-8ccb-30f1f01099d3 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:58:41 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-91aabdcf-8ac8-4eee-b063-c6d124a98663 tempest-ProjectReaderTests-422434555 None] snapshot_file for this snap is: volume-9d840737-5552-408c-8ccb-30f1f01099d3.f6c3225e-8204-43b7-8b21-288bffcb0446 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:58:41 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[b011d5f4-f523-4930-bbdf-82a234bc898e]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:58:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-91aabdcf-8ac8-4eee-b063-c6d124a98663 tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9d840737-5552-408c-8ccb-30f1f01099d3.f6c3225e-8204-43b7-8b21-288bffcb0446 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:41 devstack sudo[105361]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-0954ae9a-5e1c-468d-9dee-fb5728340e61 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-544cd579-5ae3-4370-8a5a-d987d7a3a261 1073741824" returned: 0 in 0.927s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:41 devstack sudo[105367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9d840737-5552-408c-8ccb-30f1f01099d3.f6c3225e-8204-43b7-8b21-288bffcb0446 Jul 08 18:58:41 devstack sudo[105367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-0954ae9a-5e1c-468d-9dee-fb5728340e61 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-544cd579-5ae3-4370-8a5a-d987d7a3a261 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:41 devstack sudo[105370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-544cd579-5ae3-4370-8a5a-d987d7a3a261 Jul 08 18:58:41 devstack sudo[105370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:42 devstack sudo[105367]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-91aabdcf-8ac8-4eee-b063-c6d124a98663 tempest-ProjectReaderTests-422434555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9d840737-5552-408c-8ccb-30f1f01099d3.f6c3225e-8204-43b7-8b21-288bffcb0446" returned: 0 in 0.789s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:42 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-91aabdcf-8ac8-4eee-b063-c6d124a98663 tempest-ProjectReaderTests-422434555 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d840737-5552-408c-8ccb-30f1f01099d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:58:42 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[e725c489-f849-4855-8311-fd5e7eb6cb65]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:58:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-91aabdcf-8ac8-4eee-b063-c6d124a98663 tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9d840737-5552-408c-8ccb-30f1f01099d3 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:42 devstack sudo[105375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9d840737-5552-408c-8ccb-30f1f01099d3 Jul 08 18:58:42 devstack sudo[105375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:42 devstack sudo[105370]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-0954ae9a-5e1c-468d-9dee-fb5728340e61 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-544cd579-5ae3-4370-8a5a-d987d7a3a261" returned: 0 in 0.750s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:42 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-0954ae9a-5e1c-468d-9dee-fb5728340e61 tempest-ProjectMemberTests-704047872 None] <== create_volume: return (1969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:58:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-0954ae9a-5e1c-468d-9dee-fb5728340e61 tempest-ProjectMemberTests-704047872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.973s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-0954ae9a-5e1c-468d-9dee-fb5728340e61 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cd9c510-d82e-4077-998c-279729590ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-544cd579-5ae3-4370-8a5a-d987d7a3a261', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-0954ae9a-5e1c-468d-9dee-fb5728340e61 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a276edac-42dd-44b8-b640-9b8df6a3de88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:42 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-0954ae9a-5e1c-468d-9dee-fb5728340e61 tempest-ProjectMemberTests-704047872 None] Volume volume-544cd579-5ae3-4370-8a5a-d987d7a3a261 (544cd579-5ae3-4370-8a5a-d987d7a3a261): created successfully Jul 08 18:58:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-0954ae9a-5e1c-468d-9dee-fb5728340e61 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a276edac-42dd-44b8-b640-9b8df6a3de88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:42 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-0954ae9a-5e1c-468d-9dee-fb5728340e61 tempest-ProjectMemberTests-704047872 None] Flow 'volume_create_manager' (8cbc43fa-c48e-4718-bb00-43eb599b4dc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:58:42 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-0954ae9a-5e1c-468d-9dee-fb5728340e61 tempest-ProjectMemberTests-704047872 None] Created volume successfully. Jul 08 18:58:43 devstack sudo[105375]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-91aabdcf-8ac8-4eee-b063-c6d124a98663 tempest-ProjectReaderTests-422434555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9d840737-5552-408c-8ccb-30f1f01099d3" returned: 0 in 0.835s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-91aabdcf-8ac8-4eee-b063-c6d124a98663 tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9d840737-5552-408c-8ccb-30f1f01099d3.f6c3225e-8204-43b7-8b21-288bffcb0446 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:43 devstack sudo[105382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9d840737-5552-408c-8ccb-30f1f01099d3.f6c3225e-8204-43b7-8b21-288bffcb0446 Jul 08 18:58:43 devstack sudo[105382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-55bace35-c4e4-4d07-b6f7-d26cdc4dc9fb tempest-ProjectMemberTests-704047872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-55bace35-c4e4-4d07-b6f7-d26cdc4dc9fb tempest-ProjectMemberTests-704047872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:43 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-55bace35-c4e4-4d07-b6f7-d26cdc4dc9fb tempest-ProjectMemberTests-704047872 None] Creating offline snapshot 5c30f15b-4597-4c1e-948c-a40ead89e7ce of volume 544cd579-5ae3-4370-8a5a-d987d7a3a261 {{(pid=86873) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:58:43 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[80201d07-7f4d-4dea-9be2-ec6211b9819f]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:58:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-55bace35-c4e4-4d07-b6f7-d26cdc4dc9fb tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-544cd579-5ae3-4370-8a5a-d987d7a3a261 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:43 devstack sudo[105382]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-91aabdcf-8ac8-4eee-b063-c6d124a98663 tempest-ProjectReaderTests-422434555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9d840737-5552-408c-8ccb-30f1f01099d3.f6c3225e-8204-43b7-8b21-288bffcb0446" returned: 0 in 0.823s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-91aabdcf-8ac8-4eee-b063-c6d124a98663 tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9d840737-5552-408c-8ccb-30f1f01099d3.f6c3225e-8204-43b7-8b21-288bffcb0446 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:43 devstack sudo[105388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-544cd579-5ae3-4370-8a5a-d987d7a3a261 Jul 08 18:58:43 devstack sudo[105388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:43 devstack sudo[105389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9d840737-5552-408c-8ccb-30f1f01099d3.f6c3225e-8204-43b7-8b21-288bffcb0446 Jul 08 18:58:43 devstack sudo[105389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:44 devstack sudo[105388]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-55bace35-c4e4-4d07-b6f7-d26cdc4dc9fb tempest-ProjectMemberTests-704047872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-544cd579-5ae3-4370-8a5a-d987d7a3a261" returned: 0 in 0.806s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-55bace35-c4e4-4d07-b6f7-d26cdc4dc9fb tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-544cd579-5ae3-4370-8a5a-d987d7a3a261,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-544cd579-5ae3-4370-8a5a-d987d7a3a261.5c30f15b-4597-4c1e-948c-a40ead89e7ce 1G {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:44 devstack sudo[105389]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-91aabdcf-8ac8-4eee-b063-c6d124a98663 tempest-ProjectReaderTests-422434555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9d840737-5552-408c-8ccb-30f1f01099d3.f6c3225e-8204-43b7-8b21-288bffcb0446" returned: 0 in 0.725s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:44 devstack sudo[105396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-544cd579-5ae3-4370-8a5a-d987d7a3a261,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-544cd579-5ae3-4370-8a5a-d987d7a3a261.5c30f15b-4597-4c1e-948c-a40ead89e7ce 1G Jul 08 18:58:44 devstack sudo[105396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:44 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-91aabdcf-8ac8-4eee-b063-c6d124a98663 tempest-ProjectReaderTests-422434555 None] Lock "cinder-quobyte-f6c3225e-8204-43b7-8b21-288bffcb0446" released by "_delete_snapshot" :: held 3.305s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:44 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-91aabdcf-8ac8-4eee-b063-c6d124a98663 tempest-ProjectReaderTests-422434555 None] Lock "cinder-quobyte-9d840737-5552-408c-8ccb-30f1f01099d3" released by "delete_snapshot" :: held 3.331s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:44 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-91aabdcf-8ac8-4eee-b063-c6d124a98663 tempest-ProjectReaderTests-422434555 None] Created reservations ['d521f133-755d-4448-b7b8-fc5de5304ff6', '8398bed0-e43a-4b9d-b60a-5dc692f7790f', 'ffd82fc7-81e9-48c1-ad25-f92baad3d726', '770856ab-7baf-4d34-90c6-06a8060b6358'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:58:45 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-91aabdcf-8ac8-4eee-b063-c6d124a98663 tempest-ProjectReaderTests-422434555 None] Delete snapshot completed successfully. Jul 08 18:58:45 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-91aabdcf-8ac8-4eee-b063-c6d124a98663 tempest-ProjectReaderTests-422434555 None] Lock "cinder-f6c3225e-8204-43b7-8b21-288bffcb0446-delete_snapshot" released by "delete_snapshot" :: held 3.772s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:45 devstack sudo[105396]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-55bace35-c4e4-4d07-b6f7-d26cdc4dc9fb tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-544cd579-5ae3-4370-8a5a-d987d7a3a261,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-544cd579-5ae3-4370-8a5a-d987d7a3a261.5c30f15b-4597-4c1e-948c-a40ead89e7ce 1G" returned: 0 in 0.841s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-55bace35-c4e4-4d07-b6f7-d26cdc4dc9fb tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-544cd579-5ae3-4370-8a5a-d987d7a3a261 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-544cd579-5ae3-4370-8a5a-d987d7a3a261.5c30f15b-4597-4c1e-948c-a40ead89e7ce {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:45 devstack sudo[105401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-544cd579-5ae3-4370-8a5a-d987d7a3a261 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-544cd579-5ae3-4370-8a5a-d987d7a3a261.5c30f15b-4597-4c1e-948c-a40ead89e7ce Jul 08 18:58:45 devstack sudo[105401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:45 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9d3211c4-2512-4df7-ac89-52ad30b278ed tempest-ProjectReaderTests-422434555 None] Acquiring lock "cinder-9d840737-5552-408c-8ccb-30f1f01099d3-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:58:45 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9d3211c4-2512-4df7-ac89-52ad30b278ed tempest-ProjectReaderTests-422434555 None] Lock "cinder-9d840737-5552-408c-8ccb-30f1f01099d3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:58:46 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9d3211c4-2512-4df7-ac89-52ad30b278ed tempest-ProjectReaderTests-422434555 None] Acquiring lock "cinder-quobyte-9d840737-5552-408c-8ccb-30f1f01099d3" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:58:46 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9d3211c4-2512-4df7-ac89-52ad30b278ed tempest-ProjectReaderTests-422434555 None] Lock "cinder-quobyte-9d840737-5552-408c-8ccb-30f1f01099d3" acquired by "delete_volume" :: waited 0.022s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:58:46 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[a272affb-17b3-40b4-b3dd-adc69551312a]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:58:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9d3211c4-2512-4df7-ac89-52ad30b278ed tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9d840737-5552-408c-8ccb-30f1f01099d3 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:46 devstack sudo[105401]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-55bace35-c4e4-4d07-b6f7-d26cdc4dc9fb tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-544cd579-5ae3-4370-8a5a-d987d7a3a261 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-544cd579-5ae3-4370-8a5a-d987d7a3a261.5c30f15b-4597-4c1e-948c-a40ead89e7ce" returned: 0 in 0.752s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:46 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-55bace35-c4e4-4d07-b6f7-d26cdc4dc9fb tempest-ProjectMemberTests-704047872 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-544cd579-5ae3-4370-8a5a-d987d7a3a261.5c30f15b-4597-4c1e-948c-a40ead89e7ce is being set with open permissions: ugo+rw Jul 08 18:58:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-55bace35-c4e4-4d07-b6f7-d26cdc4dc9fb tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-544cd579-5ae3-4370-8a5a-d987d7a3a261.5c30f15b-4597-4c1e-948c-a40ead89e7ce {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:46 devstack sudo[105408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-544cd579-5ae3-4370-8a5a-d987d7a3a261.5c30f15b-4597-4c1e-948c-a40ead89e7ce Jul 08 18:58:46 devstack sudo[105408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:46 devstack sudo[105407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9d840737-5552-408c-8ccb-30f1f01099d3 Jul 08 18:58:46 devstack sudo[105407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:46 devstack sudo[105408]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-55bace35-c4e4-4d07-b6f7-d26cdc4dc9fb tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-544cd579-5ae3-4370-8a5a-d987d7a3a261.5c30f15b-4597-4c1e-948c-a40ead89e7ce" returned: 0 in 0.700s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-55bace35-c4e4-4d07-b6f7-d26cdc4dc9fb tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-544cd579-5ae3-4370-8a5a-d987d7a3a261.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:47 devstack sudo[105415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-544cd579-5ae3-4370-8a5a-d987d7a3a261.info Jul 08 18:58:47 devstack sudo[105415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:47 devstack sudo[105407]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9d3211c4-2512-4df7-ac89-52ad30b278ed tempest-ProjectReaderTests-422434555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9d840737-5552-408c-8ccb-30f1f01099d3" returned: 0 in 0.841s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9d3211c4-2512-4df7-ac89-52ad30b278ed tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9d840737-5552-408c-8ccb-30f1f01099d3 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:47 devstack sudo[105417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9d840737-5552-408c-8ccb-30f1f01099d3 Jul 08 18:58:47 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:47 devstack sudo[105415]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-55bace35-c4e4-4d07-b6f7-d26cdc4dc9fb tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-544cd579-5ae3-4370-8a5a-d987d7a3a261.info" returned: 0 in 0.716s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:47 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-55bace35-c4e4-4d07-b6f7-d26cdc4dc9fb tempest-ProjectMemberTests-704047872 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-544cd579-5ae3-4370-8a5a-d987d7a3a261.info is being set with open permissions: ugo+rw Jul 08 18:58:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-55bace35-c4e4-4d07-b6f7-d26cdc4dc9fb tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-544cd579-5ae3-4370-8a5a-d987d7a3a261.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:47 devstack sudo[105421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-544cd579-5ae3-4370-8a5a-d987d7a3a261.info Jul 08 18:58:47 devstack sudo[105421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:47 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9d3211c4-2512-4df7-ac89-52ad30b278ed tempest-ProjectReaderTests-422434555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-9d840737-5552-408c-8ccb-30f1f01099d3" returned: 0 in 0.727s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:47 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9d3211c4-2512-4df7-ac89-52ad30b278ed tempest-ProjectReaderTests-422434555 None] Lock "cinder-quobyte-9d840737-5552-408c-8ccb-30f1f01099d3" released by "delete_volume" :: held 1.665s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:47 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-9d3211c4-2512-4df7-ac89-52ad30b278ed tempest-ProjectReaderTests-422434555 None] Created reservations ['d03daec6-7349-4140-bf31-816e921c9f5b', 'cfa28357-8753-49d6-8fe7-63600dcfe774', '1b4130e5-6b2a-4427-bb9e-4760c2b4d7d2', '575463b9-57f7-47e0-b468-ea8fd5f58c6c'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:58:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-9d3211c4-2512-4df7-ac89-52ad30b278ed tempest-ProjectReaderTests-422434555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-9d3211c4-2512-4df7-ac89-52ad30b278ed tempest-ProjectReaderTests-422434555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:47 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-9d3211c4-2512-4df7-ac89-52ad30b278ed tempest-ProjectReaderTests-422434555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:58:47 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-9d3211c4-2512-4df7-ac89-52ad30b278ed tempest-ProjectReaderTests-422434555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:58:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-9d3211c4-2512-4df7-ac89-52ad30b278ed tempest-ProjectReaderTests-422434555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9d3211c4-2512-4df7-ac89-52ad30b278ed tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:47 devstack sudo[105423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:58:47 devstack sudo[105423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:48 devstack cinder-volume[86873]: DEBUG oslo_service.periodic_task [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86873) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:58:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:58:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:58:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:48 devstack sudo[105425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:58:48 devstack sudo[105425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:48 devstack sudo[105421]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-55bace35-c4e4-4d07-b6f7-d26cdc4dc9fb tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-544cd579-5ae3-4370-8a5a-d987d7a3a261.info" returned: 0 in 0.713s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-55bace35-c4e4-4d07-b6f7-d26cdc4dc9fb tempest-ProjectMemberTests-704047872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.642s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:48 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-55bace35-c4e4-4d07-b6f7-d26cdc4dc9fb tempest-ProjectMemberTests-704047872 None] Create snapshot completed successfully Jul 08 18:58:48 devstack sudo[105423]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9d3211c4-2512-4df7-ac89-52ad30b278ed tempest-ProjectReaderTests-422434555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.680s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:48 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-9d3211c4-2512-4df7-ac89-52ad30b278ed tempest-ProjectReaderTests-422434555 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:58:48 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-9d3211c4-2512-4df7-ac89-52ad30b278ed tempest-ProjectReaderTests-422434555 None] Deleted volume successfully. Jul 08 18:58:48 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9d3211c4-2512-4df7-ac89-52ad30b278ed tempest-ProjectReaderTests-422434555 None] Lock "cinder-9d840737-5552-408c-8ccb-30f1f01099d3-delete_volume" released by "delete_volume" :: held 2.738s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:48 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5cd5bbd-d380-4db6-b16b-c80555aba34e tempest-ProjectReaderTests-422434555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:58:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c5cd5bbd-d380-4db6-b16b-c80555aba34e tempest-ProjectReaderTests-422434555 None] Flow 'volume_create_manager' (0efe3d18-32e9-4fb9-8425-32af7d2a6f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:58:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c5cd5bbd-d380-4db6-b16b-c80555aba34e tempest-ProjectReaderTests-422434555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c4adef8-3dfc-411b-9b6d-188328e34270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c5cd5bbd-d380-4db6-b16b-c80555aba34e tempest-ProjectReaderTests-422434555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c4adef8-3dfc-411b-9b6d-188328e34270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:58:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1352623964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a405464-6d4d-4b73-807c-dd993a618c48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29c32154c507487cbafd67a692df63f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:58:49Z,use_quota=True,user_id='2a3842f74d0646b8824351eff025b80e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c5cd5bbd-d380-4db6-b16b-c80555aba34e tempest-ProjectReaderTests-422434555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (936a8063-4c7e-4030-8859-30cfcf061aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c5cd5bbd-d380-4db6-b16b-c80555aba34e tempest-ProjectReaderTests-422434555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (936a8063-4c7e-4030-8859-30cfcf061aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c5cd5bbd-d380-4db6-b16b-c80555aba34e tempest-ProjectReaderTests-422434555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af2fffdd-f35c-408b-9d3d-3fa7873ba9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c5cd5bbd-d380-4db6-b16b-c80555aba34e tempest-ProjectReaderTests-422434555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af2fffdd-f35c-408b-9d3d-3fa7873ba9b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a405464-6d4d-4b73-807c-dd993a618c48', 'volume_name': 'volume-8a405464-6d4d-4b73-807c-dd993a618c48', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c5cd5bbd-d380-4db6-b16b-c80555aba34e tempest-ProjectReaderTests-422434555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55e45b58-b7ea-492d-8ac1-74d6217a138f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c5cd5bbd-d380-4db6-b16b-c80555aba34e tempest-ProjectReaderTests-422434555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55e45b58-b7ea-492d-8ac1-74d6217a138f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c5cd5bbd-d380-4db6-b16b-c80555aba34e tempest-ProjectReaderTests-422434555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (349d905c-ab34-45cb-a72d-b6e271784fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:48 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-c5cd5bbd-d380-4db6-b16b-c80555aba34e tempest-ProjectReaderTests-422434555 None] Volume 8a405464-6d4d-4b73-807c-dd993a618c48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a405464-6d4d-4b73-807c-dd993a618c48', 'volume_size': 1} Jul 08 18:58:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c5cd5bbd-d380-4db6-b16b-c80555aba34e tempest-ProjectReaderTests-422434555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c5cd5bbd-d380-4db6-b16b-c80555aba34e tempest-ProjectReaderTests-422434555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c5cd5bbd-d380-4db6-b16b-c80555aba34e tempest-ProjectReaderTests-422434555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:58:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1352623964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a405464-6d4d-4b73-807c-dd993a618c48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29c32154c507487cbafd67a692df63f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:58:49Z,use_quota=True,user_id='2a3842f74d0646b8824351eff025b80e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:58:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-c5cd5bbd-d380-4db6-b16b-c80555aba34e tempest-ProjectReaderTests-422434555 None] Creating volume 8a405464-6d4d-4b73-807c-dd993a618c48 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:58:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c5cd5bbd-d380-4db6-b16b-c80555aba34e tempest-ProjectReaderTests-422434555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c5cd5bbd-d380-4db6-b16b-c80555aba34e tempest-ProjectReaderTests-422434555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c5cd5bbd-d380-4db6-b16b-c80555aba34e tempest-ProjectReaderTests-422434555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:58:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c5cd5bbd-d380-4db6-b16b-c80555aba34e tempest-ProjectReaderTests-422434555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:58:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c5cd5bbd-d380-4db6-b16b-c80555aba34e tempest-ProjectReaderTests-422434555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c5cd5bbd-d380-4db6-b16b-c80555aba34e tempest-ProjectReaderTests-422434555 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:58:48 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-c5cd5bbd-d380-4db6-b16b-c80555aba34e tempest-ProjectReaderTests-422434555 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:58:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c5cd5bbd-d380-4db6-b16b-c80555aba34e tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8a405464-6d4d-4b73-807c-dd993a618c48 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:48 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-83542d2c-77db-4d56-98bc-fcce090491a9 tempest-ProjectMemberTests-704047872 None] Acquiring lock "cinder-5c30f15b-4597-4c1e-948c-a40ead89e7ce-delete_snapshot" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:58:48 devstack sudo[105429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8a405464-6d4d-4b73-807c-dd993a618c48 1073741824 Jul 08 18:58:48 devstack sudo[105429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:48 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-83542d2c-77db-4d56-98bc-fcce090491a9 tempest-ProjectMemberTests-704047872 None] Lock "cinder-5c30f15b-4597-4c1e-948c-a40ead89e7ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:58:48 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-83542d2c-77db-4d56-98bc-fcce090491a9 tempest-ProjectMemberTests-704047872 None] Acquiring lock "cinder-quobyte-544cd579-5ae3-4370-8a5a-d987d7a3a261" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:58:48 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-83542d2c-77db-4d56-98bc-fcce090491a9 tempest-ProjectMemberTests-704047872 None] Lock "cinder-quobyte-544cd579-5ae3-4370-8a5a-d987d7a3a261" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:58:48 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-83542d2c-77db-4d56-98bc-fcce090491a9 tempest-ProjectMemberTests-704047872 None] Acquiring lock "cinder-quobyte-5c30f15b-4597-4c1e-948c-a40ead89e7ce" by "_delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:58:48 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-83542d2c-77db-4d56-98bc-fcce090491a9 tempest-ProjectMemberTests-704047872 None] Lock "cinder-quobyte-5c30f15b-4597-4c1e-948c-a40ead89e7ce" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:58:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-83542d2c-77db-4d56-98bc-fcce090491a9 tempest-ProjectMemberTests-704047872 None] Deleting offline snapshot 5c30f15b-4597-4c1e-948c-a40ead89e7ce of volume 544cd579-5ae3-4370-8a5a-d987d7a3a261 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:58:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-83542d2c-77db-4d56-98bc-fcce090491a9 tempest-ProjectMemberTests-704047872 None] snapshot_file for this snap is: volume-544cd579-5ae3-4370-8a5a-d987d7a3a261.5c30f15b-4597-4c1e-948c-a40ead89e7ce {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:58:49 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e6ccaf-81b0-4b30-a27e-eb51609a674b]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:58:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-83542d2c-77db-4d56-98bc-fcce090491a9 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-544cd579-5ae3-4370-8a5a-d987d7a3a261.5c30f15b-4597-4c1e-948c-a40ead89e7ce {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:49 devstack sudo[105425]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.826s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:49 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:58:49 devstack cinder-volume[86873]: DEBUG oslo_service.periodic_task [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running periodic task VolumeManager._thread_info {{(pid=86873) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:58:49 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] thread count: 29 {{(pid=86873) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:58:49 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] thread info: [<_MainThread(MainThread, started 138577734545536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86873) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:58:49 devstack sudo[105432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-544cd579-5ae3-4370-8a5a-d987d7a3a261.5c30f15b-4597-4c1e-948c-a40ead89e7ce Jul 08 18:58:49 devstack sudo[105432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:49 devstack sudo[105429]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c5cd5bbd-d380-4db6-b16b-c80555aba34e tempest-ProjectReaderTests-422434555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8a405464-6d4d-4b73-807c-dd993a618c48 1073741824" returned: 0 in 0.857s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c5cd5bbd-d380-4db6-b16b-c80555aba34e tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8a405464-6d4d-4b73-807c-dd993a618c48 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:49 devstack sudo[105440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8a405464-6d4d-4b73-807c-dd993a618c48 Jul 08 18:58:49 devstack sudo[105440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:49 devstack sudo[105432]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-83542d2c-77db-4d56-98bc-fcce090491a9 tempest-ProjectMemberTests-704047872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-544cd579-5ae3-4370-8a5a-d987d7a3a261.5c30f15b-4597-4c1e-948c-a40ead89e7ce" returned: 0 in 0.816s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:49 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-83542d2c-77db-4d56-98bc-fcce090491a9 tempest-ProjectMemberTests-704047872 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-544cd579-5ae3-4370-8a5a-d987d7a3a261(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:58:49 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[138ebb5d-023b-4ae5-8166-b993230d10f3]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:58:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-83542d2c-77db-4d56-98bc-fcce090491a9 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-544cd579-5ae3-4370-8a5a-d987d7a3a261 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:49 devstack sudo[105442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-544cd579-5ae3-4370-8a5a-d987d7a3a261 Jul 08 18:58:49 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:50 devstack sudo[105440]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c5cd5bbd-d380-4db6-b16b-c80555aba34e tempest-ProjectReaderTests-422434555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8a405464-6d4d-4b73-807c-dd993a618c48" returned: 0 in 0.660s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:50 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c5cd5bbd-d380-4db6-b16b-c80555aba34e tempest-ProjectReaderTests-422434555 None] <== create_volume: return (1560ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:58:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c5cd5bbd-d380-4db6-b16b-c80555aba34e tempest-ProjectReaderTests-422434555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.562s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:50 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c5cd5bbd-d380-4db6-b16b-c80555aba34e tempest-ProjectReaderTests-422434555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (349d905c-ab34-45cb-a72d-b6e271784fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a405464-6d4d-4b73-807c-dd993a618c48', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:50 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c5cd5bbd-d380-4db6-b16b-c80555aba34e tempest-ProjectReaderTests-422434555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc2fb26e-aa7b-4108-89f7-1cfe2cc7d846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:50 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-c5cd5bbd-d380-4db6-b16b-c80555aba34e tempest-ProjectReaderTests-422434555 None] Volume volume-8a405464-6d4d-4b73-807c-dd993a618c48 (8a405464-6d4d-4b73-807c-dd993a618c48): created successfully Jul 08 18:58:50 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c5cd5bbd-d380-4db6-b16b-c80555aba34e tempest-ProjectReaderTests-422434555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc2fb26e-aa7b-4108-89f7-1cfe2cc7d846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:50 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c5cd5bbd-d380-4db6-b16b-c80555aba34e tempest-ProjectReaderTests-422434555 None] Flow 'volume_create_manager' (0efe3d18-32e9-4fb9-8425-32af7d2a6f7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:58:50 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-c5cd5bbd-d380-4db6-b16b-c80555aba34e tempest-ProjectReaderTests-422434555 None] Created volume successfully. Jul 08 18:58:50 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-83542d2c-77db-4d56-98bc-fcce090491a9 tempest-ProjectMemberTests-704047872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-544cd579-5ae3-4370-8a5a-d987d7a3a261" returned: 0 in 0.757s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:50 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-83542d2c-77db-4d56-98bc-fcce090491a9 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-544cd579-5ae3-4370-8a5a-d987d7a3a261.5c30f15b-4597-4c1e-948c-a40ead89e7ce {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:50 devstack sudo[105448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-544cd579-5ae3-4370-8a5a-d987d7a3a261.5c30f15b-4597-4c1e-948c-a40ead89e7ce Jul 08 18:58:50 devstack sudo[105448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-508c91e9-1e41-42c1-a989-ff6134823c1a tempest-ProjectReaderTests-422434555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-508c91e9-1e41-42c1-a989-ff6134823c1a tempest-ProjectReaderTests-422434555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:51 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-508c91e9-1e41-42c1-a989-ff6134823c1a tempest-ProjectReaderTests-422434555 None] Creating offline snapshot 8edb8f97-a8c8-4c23-9239-f2db339f421f of volume 8a405464-6d4d-4b73-807c-dd993a618c48 {{(pid=86873) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:58:51 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84e0fd8-807e-4434-a5fa-11b34193eb9d]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:58:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-508c91e9-1e41-42c1-a989-ff6134823c1a tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8a405464-6d4d-4b73-807c-dd993a618c48 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:51 devstack sudo[105450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8a405464-6d4d-4b73-807c-dd993a618c48 Jul 08 18:58:51 devstack sudo[105450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:51 devstack sudo[105448]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-83542d2c-77db-4d56-98bc-fcce090491a9 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-544cd579-5ae3-4370-8a5a-d987d7a3a261.5c30f15b-4597-4c1e-948c-a40ead89e7ce" returned: 0 in 0.766s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-83542d2c-77db-4d56-98bc-fcce090491a9 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-544cd579-5ae3-4370-8a5a-d987d7a3a261.5c30f15b-4597-4c1e-948c-a40ead89e7ce {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:51 devstack sudo[105456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-544cd579-5ae3-4370-8a5a-d987d7a3a261.5c30f15b-4597-4c1e-948c-a40ead89e7ce Jul 08 18:58:51 devstack sudo[105456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:51 devstack sudo[105450]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-508c91e9-1e41-42c1-a989-ff6134823c1a tempest-ProjectReaderTests-422434555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8a405464-6d4d-4b73-807c-dd993a618c48" returned: 0 in 0.794s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-508c91e9-1e41-42c1-a989-ff6134823c1a tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8a405464-6d4d-4b73-807c-dd993a618c48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8a405464-6d4d-4b73-807c-dd993a618c48.8edb8f97-a8c8-4c23-9239-f2db339f421f 1G {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:51 devstack sudo[105461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8a405464-6d4d-4b73-807c-dd993a618c48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8a405464-6d4d-4b73-807c-dd993a618c48.8edb8f97-a8c8-4c23-9239-f2db339f421f 1G Jul 08 18:58:51 devstack sudo[105461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:52 devstack sudo[105456]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-83542d2c-77db-4d56-98bc-fcce090491a9 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-544cd579-5ae3-4370-8a5a-d987d7a3a261.5c30f15b-4597-4c1e-948c-a40ead89e7ce" returned: 0 in 0.641s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:52 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-83542d2c-77db-4d56-98bc-fcce090491a9 tempest-ProjectMemberTests-704047872 None] Lock "cinder-quobyte-5c30f15b-4597-4c1e-948c-a40ead89e7ce" released by "_delete_snapshot" :: held 3.097s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:52 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-83542d2c-77db-4d56-98bc-fcce090491a9 tempest-ProjectMemberTests-704047872 None] Lock "cinder-quobyte-544cd579-5ae3-4370-8a5a-d987d7a3a261" released by "delete_snapshot" :: held 3.128s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:52 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-83542d2c-77db-4d56-98bc-fcce090491a9 tempest-ProjectMemberTests-704047872 None] Created reservations ['2100183f-ee0c-452a-8e3c-483f44c7b338', '906f980a-c612-4c19-92da-132f0824eb84', '7530e74c-d667-401f-ab37-bdf5c87f0157', '288bb7b5-341d-4cfd-a080-5ae40be2e864'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:58:52 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-83542d2c-77db-4d56-98bc-fcce090491a9 tempest-ProjectMemberTests-704047872 None] Delete snapshot completed successfully. Jul 08 18:58:52 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-83542d2c-77db-4d56-98bc-fcce090491a9 tempest-ProjectMemberTests-704047872 None] Lock "cinder-5c30f15b-4597-4c1e-948c-a40ead89e7ce-delete_snapshot" released by "delete_snapshot" :: held 3.269s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:52 devstack sudo[105461]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-508c91e9-1e41-42c1-a989-ff6134823c1a tempest-ProjectReaderTests-422434555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8a405464-6d4d-4b73-807c-dd993a618c48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8a405464-6d4d-4b73-807c-dd993a618c48.8edb8f97-a8c8-4c23-9239-f2db339f421f 1G" returned: 0 in 0.854s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-508c91e9-1e41-42c1-a989-ff6134823c1a tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a405464-6d4d-4b73-807c-dd993a618c48 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8a405464-6d4d-4b73-807c-dd993a618c48.8edb8f97-a8c8-4c23-9239-f2db339f421f {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:52 devstack sudo[105468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a405464-6d4d-4b73-807c-dd993a618c48 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8a405464-6d4d-4b73-807c-dd993a618c48.8edb8f97-a8c8-4c23-9239-f2db339f421f Jul 08 18:58:52 devstack sudo[105468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:53 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-47c34b77-6526-4d06-bba8-8218101a3b0f tempest-ProjectMemberTests-704047872 None] Acquiring lock "cinder-544cd579-5ae3-4370-8a5a-d987d7a3a261-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:58:53 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-47c34b77-6526-4d06-bba8-8218101a3b0f tempest-ProjectMemberTests-704047872 None] Lock "cinder-544cd579-5ae3-4370-8a5a-d987d7a3a261-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:58:53 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-47c34b77-6526-4d06-bba8-8218101a3b0f tempest-ProjectMemberTests-704047872 None] Acquiring lock "cinder-quobyte-544cd579-5ae3-4370-8a5a-d987d7a3a261" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:58:53 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-47c34b77-6526-4d06-bba8-8218101a3b0f tempest-ProjectMemberTests-704047872 None] Lock "cinder-quobyte-544cd579-5ae3-4370-8a5a-d987d7a3a261" acquired by "delete_volume" :: waited 0.016s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:58:53 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[b618bcb5-4b93-469c-af5a-f3c85df01a8f]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:58:53 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-47c34b77-6526-4d06-bba8-8218101a3b0f tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-544cd579-5ae3-4370-8a5a-d987d7a3a261 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:53 devstack sudo[105473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-544cd579-5ae3-4370-8a5a-d987d7a3a261 Jul 08 18:58:53 devstack sudo[105473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:53 devstack sudo[105468]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:53 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-508c91e9-1e41-42c1-a989-ff6134823c1a tempest-ProjectReaderTests-422434555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a405464-6d4d-4b73-807c-dd993a618c48 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8a405464-6d4d-4b73-807c-dd993a618c48.8edb8f97-a8c8-4c23-9239-f2db339f421f" returned: 0 in 0.717s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:53 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-508c91e9-1e41-42c1-a989-ff6134823c1a tempest-ProjectReaderTests-422434555 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8a405464-6d4d-4b73-807c-dd993a618c48.8edb8f97-a8c8-4c23-9239-f2db339f421f is being set with open permissions: ugo+rw Jul 08 18:58:53 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-508c91e9-1e41-42c1-a989-ff6134823c1a tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8a405464-6d4d-4b73-807c-dd993a618c48.8edb8f97-a8c8-4c23-9239-f2db339f421f {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:53 devstack sudo[105475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8a405464-6d4d-4b73-807c-dd993a618c48.8edb8f97-a8c8-4c23-9239-f2db339f421f Jul 08 18:58:53 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:54 devstack sudo[105473]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-47c34b77-6526-4d06-bba8-8218101a3b0f tempest-ProjectMemberTests-704047872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-544cd579-5ae3-4370-8a5a-d987d7a3a261" returned: 0 in 0.808s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-47c34b77-6526-4d06-bba8-8218101a3b0f tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-544cd579-5ae3-4370-8a5a-d987d7a3a261 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:54 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-508c91e9-1e41-42c1-a989-ff6134823c1a tempest-ProjectReaderTests-422434555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8a405464-6d4d-4b73-807c-dd993a618c48.8edb8f97-a8c8-4c23-9239-f2db339f421f" returned: 0 in 0.692s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:54 devstack sudo[105481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-544cd579-5ae3-4370-8a5a-d987d7a3a261 Jul 08 18:58:54 devstack sudo[105481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-508c91e9-1e41-42c1-a989-ff6134823c1a tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8a405464-6d4d-4b73-807c-dd993a618c48.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:54 devstack sudo[105483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8a405464-6d4d-4b73-807c-dd993a618c48.info Jul 08 18:58:54 devstack sudo[105483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:54 devstack sudo[105481]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-47c34b77-6526-4d06-bba8-8218101a3b0f tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-544cd579-5ae3-4370-8a5a-d987d7a3a261" returned: 0 in 0.692s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:54 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-47c34b77-6526-4d06-bba8-8218101a3b0f tempest-ProjectMemberTests-704047872 None] Lock "cinder-quobyte-544cd579-5ae3-4370-8a5a-d987d7a3a261" released by "delete_volume" :: held 1.571s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:54 devstack sudo[105483]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-508c91e9-1e41-42c1-a989-ff6134823c1a tempest-ProjectReaderTests-422434555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8a405464-6d4d-4b73-807c-dd993a618c48.info" returned: 0 in 0.698s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:54 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-508c91e9-1e41-42c1-a989-ff6134823c1a tempest-ProjectReaderTests-422434555 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8a405464-6d4d-4b73-807c-dd993a618c48.info is being set with open permissions: ugo+rw Jul 08 18:58:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-508c91e9-1e41-42c1-a989-ff6134823c1a tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8a405464-6d4d-4b73-807c-dd993a618c48.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:54 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-47c34b77-6526-4d06-bba8-8218101a3b0f tempest-ProjectMemberTests-704047872 None] Created reservations ['a052ce3a-8828-4373-8f77-fef8fea1cd5b', 'b9733b89-511b-4efc-81d7-46c36a40e944', '5ee8e762-625c-4bc9-b7ae-855d593bbe28', '4ca0d24e-87a2-4b9c-9e98-428e8074faff'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:58:54 devstack sudo[105487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8a405464-6d4d-4b73-807c-dd993a618c48.info Jul 08 18:58:54 devstack sudo[105487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-47c34b77-6526-4d06-bba8-8218101a3b0f tempest-ProjectMemberTests-704047872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-47c34b77-6526-4d06-bba8-8218101a3b0f tempest-ProjectMemberTests-704047872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:54 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-47c34b77-6526-4d06-bba8-8218101a3b0f tempest-ProjectMemberTests-704047872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:58:54 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-47c34b77-6526-4d06-bba8-8218101a3b0f tempest-ProjectMemberTests-704047872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:58:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-47c34b77-6526-4d06-bba8-8218101a3b0f tempest-ProjectMemberTests-704047872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-47c34b77-6526-4d06-bba8-8218101a3b0f tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:54 devstack sudo[105489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:58:54 devstack sudo[105489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:55 devstack sudo[105487]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-508c91e9-1e41-42c1-a989-ff6134823c1a tempest-ProjectReaderTests-422434555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8a405464-6d4d-4b73-807c-dd993a618c48.info" returned: 0 in 0.691s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-508c91e9-1e41-42c1-a989-ff6134823c1a tempest-ProjectReaderTests-422434555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.545s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:55 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-508c91e9-1e41-42c1-a989-ff6134823c1a tempest-ProjectReaderTests-422434555 None] Create snapshot completed successfully Jul 08 18:58:55 devstack sudo[105489]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-47c34b77-6526-4d06-bba8-8218101a3b0f tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.709s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:55 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-47c34b77-6526-4d06-bba8-8218101a3b0f tempest-ProjectMemberTests-704047872 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:58:55 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-47c34b77-6526-4d06-bba8-8218101a3b0f tempest-ProjectMemberTests-704047872 None] Deleted volume successfully. Jul 08 18:58:55 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-47c34b77-6526-4d06-bba8-8218101a3b0f tempest-ProjectMemberTests-704047872 None] Lock "cinder-544cd579-5ae3-4370-8a5a-d987d7a3a261-delete_volume" released by "delete_volume" :: held 2.511s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:55 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c77a21c-e225-4ad4-97a3-2c9a7d8c6815 tempest-ProjectMemberTests-704047872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:58:55 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-0c77a21c-e225-4ad4-97a3-2c9a7d8c6815 tempest-ProjectMemberTests-704047872 None] Flow 'volume_create_manager' (46846d07-ec6e-40ba-89ac-d85abff8e7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:58:55 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-0c77a21c-e225-4ad4-97a3-2c9a7d8c6815 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54dccfc4-707d-4366-8458-51ebcb3ea5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:55 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-0c77a21c-e225-4ad4-97a3-2c9a7d8c6815 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54dccfc4-707d-4366-8458-51ebcb3ea5a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:58:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1671566211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98ff82a1-abc7-4ea3-b750-ff598c9df841,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23f6feda0dc341ae9dff1be67ef4c54c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:58:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:58:56Z,use_quota=True,user_id='ebff52e9980446ed8de939cd8116db5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:55 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-0c77a21c-e225-4ad4-97a3-2c9a7d8c6815 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de3a407f-4808-4296-8fb5-8a99646e7da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:55 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-0c77a21c-e225-4ad4-97a3-2c9a7d8c6815 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de3a407f-4808-4296-8fb5-8a99646e7da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:55 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-0c77a21c-e225-4ad4-97a3-2c9a7d8c6815 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7bf6436-138e-4422-847d-68f543cddd1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:55 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-0c77a21c-e225-4ad4-97a3-2c9a7d8c6815 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7bf6436-138e-4422-847d-68f543cddd1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98ff82a1-abc7-4ea3-b750-ff598c9df841', 'volume_name': 'volume-98ff82a1-abc7-4ea3-b750-ff598c9df841', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:55 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-0c77a21c-e225-4ad4-97a3-2c9a7d8c6815 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c011fc9-793a-459d-b606-82d12d48c3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:55 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-0c77a21c-e225-4ad4-97a3-2c9a7d8c6815 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c011fc9-793a-459d-b606-82d12d48c3db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:55 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-0c77a21c-e225-4ad4-97a3-2c9a7d8c6815 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8123b695-5bdf-4926-8d92-48b901b28f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:55 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-0c77a21c-e225-4ad4-97a3-2c9a7d8c6815 tempest-ProjectMemberTests-704047872 None] Volume 98ff82a1-abc7-4ea3-b750-ff598c9df841: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98ff82a1-abc7-4ea3-b750-ff598c9df841', 'volume_size': 1} Jul 08 18:58:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-0c77a21c-e225-4ad4-97a3-2c9a7d8c6815 tempest-ProjectMemberTests-704047872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-0c77a21c-e225-4ad4-97a3-2c9a7d8c6815 tempest-ProjectMemberTests-704047872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:55 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-0c77a21c-e225-4ad4-97a3-2c9a7d8c6815 tempest-ProjectMemberTests-704047872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:58:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1671566211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98ff82a1-abc7-4ea3-b750-ff598c9df841,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23f6feda0dc341ae9dff1be67ef4c54c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:58:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:58:56Z,use_quota=True,user_id='ebff52e9980446ed8de939cd8116db5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:58:55 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-0c77a21c-e225-4ad4-97a3-2c9a7d8c6815 tempest-ProjectMemberTests-704047872 None] Creating volume 98ff82a1-abc7-4ea3-b750-ff598c9df841 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:58:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-0c77a21c-e225-4ad4-97a3-2c9a7d8c6815 tempest-ProjectMemberTests-704047872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-0c77a21c-e225-4ad4-97a3-2c9a7d8c6815 tempest-ProjectMemberTests-704047872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:55 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-0c77a21c-e225-4ad4-97a3-2c9a7d8c6815 tempest-ProjectMemberTests-704047872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:58:55 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-0c77a21c-e225-4ad4-97a3-2c9a7d8c6815 tempest-ProjectMemberTests-704047872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:58:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-0c77a21c-e225-4ad4-97a3-2c9a7d8c6815 tempest-ProjectMemberTests-704047872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:55 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-0c77a21c-e225-4ad4-97a3-2c9a7d8c6815 tempest-ProjectMemberTests-704047872 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:58:55 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-0c77a21c-e225-4ad4-97a3-2c9a7d8c6815 tempest-ProjectMemberTests-704047872 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:58:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-0c77a21c-e225-4ad4-97a3-2c9a7d8c6815 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-98ff82a1-abc7-4ea3-b750-ff598c9df841 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:55 devstack sudo[105493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-98ff82a1-abc7-4ea3-b750-ff598c9df841 1073741824 Jul 08 18:58:55 devstack sudo[105493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:56 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-5f7eb924-ff58-4be9-919c-495ff73a9736 tempest-ProjectReaderTests-422434555 None] Acquiring lock "cinder-8edb8f97-a8c8-4c23-9239-f2db339f421f-delete_snapshot" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:58:56 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-5f7eb924-ff58-4be9-919c-495ff73a9736 tempest-ProjectReaderTests-422434555 None] Lock "cinder-8edb8f97-a8c8-4c23-9239-f2db339f421f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:58:56 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-5f7eb924-ff58-4be9-919c-495ff73a9736 tempest-ProjectReaderTests-422434555 None] Acquiring lock "cinder-quobyte-8a405464-6d4d-4b73-807c-dd993a618c48" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:58:56 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-5f7eb924-ff58-4be9-919c-495ff73a9736 tempest-ProjectReaderTests-422434555 None] Lock "cinder-quobyte-8a405464-6d4d-4b73-807c-dd993a618c48" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:58:56 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-5f7eb924-ff58-4be9-919c-495ff73a9736 tempest-ProjectReaderTests-422434555 None] Acquiring lock "cinder-quobyte-8edb8f97-a8c8-4c23-9239-f2db339f421f" by "_delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:58:56 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-5f7eb924-ff58-4be9-919c-495ff73a9736 tempest-ProjectReaderTests-422434555 None] Lock "cinder-quobyte-8edb8f97-a8c8-4c23-9239-f2db339f421f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:58:56 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-5f7eb924-ff58-4be9-919c-495ff73a9736 tempest-ProjectReaderTests-422434555 None] Deleting offline snapshot 8edb8f97-a8c8-4c23-9239-f2db339f421f of volume 8a405464-6d4d-4b73-807c-dd993a618c48 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:58:56 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-5f7eb924-ff58-4be9-919c-495ff73a9736 tempest-ProjectReaderTests-422434555 None] snapshot_file for this snap is: volume-8a405464-6d4d-4b73-807c-dd993a618c48.8edb8f97-a8c8-4c23-9239-f2db339f421f {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:58:56 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e13229-91ce-438d-bea8-594d742e22ea]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:58:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5f7eb924-ff58-4be9-919c-495ff73a9736 tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8a405464-6d4d-4b73-807c-dd993a618c48.8edb8f97-a8c8-4c23-9239-f2db339f421f {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:56 devstack sudo[105495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8a405464-6d4d-4b73-807c-dd993a618c48.8edb8f97-a8c8-4c23-9239-f2db339f421f Jul 08 18:58:56 devstack sudo[105495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:56 devstack sudo[105493]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-0c77a21c-e225-4ad4-97a3-2c9a7d8c6815 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-98ff82a1-abc7-4ea3-b750-ff598c9df841 1073741824" returned: 0 in 0.837s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-0c77a21c-e225-4ad4-97a3-2c9a7d8c6815 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-98ff82a1-abc7-4ea3-b750-ff598c9df841 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:56 devstack sudo[105500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-98ff82a1-abc7-4ea3-b750-ff598c9df841 Jul 08 18:58:56 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:57 devstack sudo[105495]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5f7eb924-ff58-4be9-919c-495ff73a9736 tempest-ProjectReaderTests-422434555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8a405464-6d4d-4b73-807c-dd993a618c48.8edb8f97-a8c8-4c23-9239-f2db339f421f" returned: 0 in 0.816s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:57 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-5f7eb924-ff58-4be9-919c-495ff73a9736 tempest-ProjectReaderTests-422434555 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a405464-6d4d-4b73-807c-dd993a618c48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:58:57 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0aeb1e4-2fe8-41d3-b2f4-df8f77660918]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:58:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5f7eb924-ff58-4be9-919c-495ff73a9736 tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8a405464-6d4d-4b73-807c-dd993a618c48 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:57 devstack sudo[105505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8a405464-6d4d-4b73-807c-dd993a618c48 Jul 08 18:58:57 devstack sudo[105505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:57 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-0c77a21c-e225-4ad4-97a3-2c9a7d8c6815 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-98ff82a1-abc7-4ea3-b750-ff598c9df841" returned: 0 in 0.668s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:57 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-0c77a21c-e225-4ad4-97a3-2c9a7d8c6815 tempest-ProjectMemberTests-704047872 None] <== create_volume: return (1563ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:58:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-0c77a21c-e225-4ad4-97a3-2c9a7d8c6815 tempest-ProjectMemberTests-704047872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:57 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-0c77a21c-e225-4ad4-97a3-2c9a7d8c6815 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8123b695-5bdf-4926-8d92-48b901b28f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98ff82a1-abc7-4ea3-b750-ff598c9df841', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:57 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-0c77a21c-e225-4ad4-97a3-2c9a7d8c6815 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1f4d8d7-715d-4dd6-be77-e7126e1c3812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:57 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-0c77a21c-e225-4ad4-97a3-2c9a7d8c6815 tempest-ProjectMemberTests-704047872 None] Volume volume-98ff82a1-abc7-4ea3-b750-ff598c9df841 (98ff82a1-abc7-4ea3-b750-ff598c9df841): created successfully Jul 08 18:58:57 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-0c77a21c-e225-4ad4-97a3-2c9a7d8c6815 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1f4d8d7-715d-4dd6-be77-e7126e1c3812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:57 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-0c77a21c-e225-4ad4-97a3-2c9a7d8c6815 tempest-ProjectMemberTests-704047872 None] Flow 'volume_create_manager' (46846d07-ec6e-40ba-89ac-d85abff8e7eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:58:57 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-0c77a21c-e225-4ad4-97a3-2c9a7d8c6815 tempest-ProjectMemberTests-704047872 None] Created volume successfully. Jul 08 18:58:58 devstack sudo[105505]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5f7eb924-ff58-4be9-919c-495ff73a9736 tempest-ProjectReaderTests-422434555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8a405464-6d4d-4b73-807c-dd993a618c48" returned: 0 in 0.787s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5f7eb924-ff58-4be9-919c-495ff73a9736 tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8a405464-6d4d-4b73-807c-dd993a618c48.8edb8f97-a8c8-4c23-9239-f2db339f421f {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:58 devstack sudo[105511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8a405464-6d4d-4b73-807c-dd993a618c48.8edb8f97-a8c8-4c23-9239-f2db339f421f Jul 08 18:58:58 devstack sudo[105511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3bb098b-2ffe-4bfc-8a38-6662467e008d tempest-ProjectMemberTests-704047872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3bb098b-2ffe-4bfc-8a38-6662467e008d tempest-ProjectMemberTests-704047872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:58 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-c3bb098b-2ffe-4bfc-8a38-6662467e008d tempest-ProjectMemberTests-704047872 None] Creating offline snapshot d3a6e280-e1d2-41b9-9296-548525821539 of volume 98ff82a1-abc7-4ea3-b750-ff598c9df841 {{(pid=86873) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:58:58 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6faa2c-b230-4f67-a9da-489f4f792a0f]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:58:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3bb098b-2ffe-4bfc-8a38-6662467e008d tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-98ff82a1-abc7-4ea3-b750-ff598c9df841 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:58 devstack sudo[105513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-98ff82a1-abc7-4ea3-b750-ff598c9df841 Jul 08 18:58:58 devstack sudo[105513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:58 devstack sudo[105511]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5f7eb924-ff58-4be9-919c-495ff73a9736 tempest-ProjectReaderTests-422434555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8a405464-6d4d-4b73-807c-dd993a618c48.8edb8f97-a8c8-4c23-9239-f2db339f421f" returned: 0 in 0.778s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5f7eb924-ff58-4be9-919c-495ff73a9736 tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8a405464-6d4d-4b73-807c-dd993a618c48.8edb8f97-a8c8-4c23-9239-f2db339f421f {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:58 devstack sudo[105520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8a405464-6d4d-4b73-807c-dd993a618c48.8edb8f97-a8c8-4c23-9239-f2db339f421f Jul 08 18:58:58 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:58 devstack sudo[105513]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3bb098b-2ffe-4bfc-8a38-6662467e008d tempest-ProjectMemberTests-704047872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-98ff82a1-abc7-4ea3-b750-ff598c9df841" returned: 0 in 0.773s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3bb098b-2ffe-4bfc-8a38-6662467e008d tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-98ff82a1-abc7-4ea3-b750-ff598c9df841,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-98ff82a1-abc7-4ea3-b750-ff598c9df841.d3a6e280-e1d2-41b9-9296-548525821539 1G {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:58 devstack sudo[105523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-98ff82a1-abc7-4ea3-b750-ff598c9df841,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-98ff82a1-abc7-4ea3-b750-ff598c9df841.d3a6e280-e1d2-41b9-9296-548525821539 1G Jul 08 18:58:58 devstack sudo[105523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:59 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-5f7eb924-ff58-4be9-919c-495ff73a9736 tempest-ProjectReaderTests-422434555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8a405464-6d4d-4b73-807c-dd993a618c48.8edb8f97-a8c8-4c23-9239-f2db339f421f" returned: 0 in 0.668s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:59 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-5f7eb924-ff58-4be9-919c-495ff73a9736 tempest-ProjectReaderTests-422434555 None] Lock "cinder-quobyte-8edb8f97-a8c8-4c23-9239-f2db339f421f" released by "_delete_snapshot" :: held 3.140s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:59 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-5f7eb924-ff58-4be9-919c-495ff73a9736 tempest-ProjectReaderTests-422434555 None] Lock "cinder-quobyte-8a405464-6d4d-4b73-807c-dd993a618c48" released by "delete_snapshot" :: held 3.163s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:59 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-5f7eb924-ff58-4be9-919c-495ff73a9736 tempest-ProjectReaderTests-422434555 None] Created reservations ['d798faf0-5c78-44c8-a3c5-948f7b4173c2', '8325651e-0964-4c75-a445-d89bd9f03d6b', '56a64580-a71f-4b39-94a5-d43ad344a74b', '28bd9f38-c775-443c-a0cb-1ec87e30936a'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:58:59 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-5f7eb924-ff58-4be9-919c-495ff73a9736 tempest-ProjectReaderTests-422434555 None] Delete snapshot completed successfully. Jul 08 18:58:59 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-5f7eb924-ff58-4be9-919c-495ff73a9736 tempest-ProjectReaderTests-422434555 None] Lock "cinder-8edb8f97-a8c8-4c23-9239-f2db339f421f-delete_snapshot" released by "delete_snapshot" :: held 3.302s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:59 devstack sudo[105523]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3bb098b-2ffe-4bfc-8a38-6662467e008d tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-98ff82a1-abc7-4ea3-b750-ff598c9df841,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-98ff82a1-abc7-4ea3-b750-ff598c9df841.d3a6e280-e1d2-41b9-9296-548525821539 1G" returned: 0 in 0.834s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3bb098b-2ffe-4bfc-8a38-6662467e008d tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98ff82a1-abc7-4ea3-b750-ff598c9df841 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-98ff82a1-abc7-4ea3-b750-ff598c9df841.d3a6e280-e1d2-41b9-9296-548525821539 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:59 devstack sudo[105531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98ff82a1-abc7-4ea3-b750-ff598c9df841 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-98ff82a1-abc7-4ea3-b750-ff598c9df841.d3a6e280-e1d2-41b9-9296-548525821539 Jul 08 18:58:59 devstack sudo[105531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:00 devstack sudo[105531]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3bb098b-2ffe-4bfc-8a38-6662467e008d tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98ff82a1-abc7-4ea3-b750-ff598c9df841 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-98ff82a1-abc7-4ea3-b750-ff598c9df841.d3a6e280-e1d2-41b9-9296-548525821539" returned: 0 in 0.699s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:00 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-c3bb098b-2ffe-4bfc-8a38-6662467e008d tempest-ProjectMemberTests-704047872 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-98ff82a1-abc7-4ea3-b750-ff598c9df841.d3a6e280-e1d2-41b9-9296-548525821539 is being set with open permissions: ugo+rw Jul 08 18:59:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3bb098b-2ffe-4bfc-8a38-6662467e008d tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-98ff82a1-abc7-4ea3-b750-ff598c9df841.d3a6e280-e1d2-41b9-9296-548525821539 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:00 devstack sudo[105536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-98ff82a1-abc7-4ea3-b750-ff598c9df841.d3a6e280-e1d2-41b9-9296-548525821539 Jul 08 18:59:00 devstack sudo[105536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:00 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-0eb51902-85cd-40b9-994c-810eca615f66 tempest-ProjectReaderTests-422434555 None] Acquiring lock "cinder-8a405464-6d4d-4b73-807c-dd993a618c48-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:59:00 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-0eb51902-85cd-40b9-994c-810eca615f66 tempest-ProjectReaderTests-422434555 None] Lock "cinder-8a405464-6d4d-4b73-807c-dd993a618c48-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:59:00 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-0eb51902-85cd-40b9-994c-810eca615f66 tempest-ProjectReaderTests-422434555 None] Acquiring lock "cinder-quobyte-8a405464-6d4d-4b73-807c-dd993a618c48" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:59:00 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-0eb51902-85cd-40b9-994c-810eca615f66 tempest-ProjectReaderTests-422434555 None] Lock "cinder-quobyte-8a405464-6d4d-4b73-807c-dd993a618c48" acquired by "delete_volume" :: waited 0.019s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:59:00 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d33ee0-5a0b-41d7-991d-e551018de4d1]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:59:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-0eb51902-85cd-40b9-994c-810eca615f66 tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8a405464-6d4d-4b73-807c-dd993a618c48 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:00 devstack sudo[105538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8a405464-6d4d-4b73-807c-dd993a618c48 Jul 08 18:59:00 devstack sudo[105538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:01 devstack sudo[105536]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3bb098b-2ffe-4bfc-8a38-6662467e008d tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-98ff82a1-abc7-4ea3-b750-ff598c9df841.d3a6e280-e1d2-41b9-9296-548525821539" returned: 0 in 0.672s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3bb098b-2ffe-4bfc-8a38-6662467e008d tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-98ff82a1-abc7-4ea3-b750-ff598c9df841.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:01 devstack sudo[105541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-98ff82a1-abc7-4ea3-b750-ff598c9df841.info Jul 08 18:59:01 devstack sudo[105541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:01 devstack sudo[105538]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-0eb51902-85cd-40b9-994c-810eca615f66 tempest-ProjectReaderTests-422434555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8a405464-6d4d-4b73-807c-dd993a618c48" returned: 0 in 0.781s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-0eb51902-85cd-40b9-994c-810eca615f66 tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8a405464-6d4d-4b73-807c-dd993a618c48 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:01 devstack sudo[105546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8a405464-6d4d-4b73-807c-dd993a618c48 Jul 08 18:59:01 devstack sudo[105546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:01 devstack sudo[105541]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3bb098b-2ffe-4bfc-8a38-6662467e008d tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-98ff82a1-abc7-4ea3-b750-ff598c9df841.info" returned: 0 in 0.675s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:01 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-c3bb098b-2ffe-4bfc-8a38-6662467e008d tempest-ProjectMemberTests-704047872 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-98ff82a1-abc7-4ea3-b750-ff598c9df841.info is being set with open permissions: ugo+rw Jul 08 18:59:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3bb098b-2ffe-4bfc-8a38-6662467e008d tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-98ff82a1-abc7-4ea3-b750-ff598c9df841.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:01 devstack sudo[105549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-98ff82a1-abc7-4ea3-b750-ff598c9df841.info Jul 08 18:59:01 devstack sudo[105549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:02 devstack sudo[105546]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-0eb51902-85cd-40b9-994c-810eca615f66 tempest-ProjectReaderTests-422434555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8a405464-6d4d-4b73-807c-dd993a618c48" returned: 0 in 0.681s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:02 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-0eb51902-85cd-40b9-994c-810eca615f66 tempest-ProjectReaderTests-422434555 None] Lock "cinder-quobyte-8a405464-6d4d-4b73-807c-dd993a618c48" released by "delete_volume" :: held 1.525s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:59:02 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-0eb51902-85cd-40b9-994c-810eca615f66 tempest-ProjectReaderTests-422434555 None] Created reservations ['0f30851f-fe13-4ec9-9939-0c7698c6c8f0', '7407018b-16d7-4631-9a61-b6516a63ea31', 'e84b1060-32c0-4519-a981-28a1110ef33d', '2cf2eb58-37fc-4a81-8054-3c0105487609'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:59:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-0eb51902-85cd-40b9-994c-810eca615f66 tempest-ProjectReaderTests-422434555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:59:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-0eb51902-85cd-40b9-994c-810eca615f66 tempest-ProjectReaderTests-422434555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:59:02 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-0eb51902-85cd-40b9-994c-810eca615f66 tempest-ProjectReaderTests-422434555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:59:02 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-0eb51902-85cd-40b9-994c-810eca615f66 tempest-ProjectReaderTests-422434555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:59:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-0eb51902-85cd-40b9-994c-810eca615f66 tempest-ProjectReaderTests-422434555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:59:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-0eb51902-85cd-40b9-994c-810eca615f66 tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:02 devstack sudo[105552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:59:02 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:02 devstack sudo[105549]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3bb098b-2ffe-4bfc-8a38-6662467e008d tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-98ff82a1-abc7-4ea3-b750-ff598c9df841.info" returned: 0 in 0.658s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3bb098b-2ffe-4bfc-8a38-6662467e008d tempest-ProjectMemberTests-704047872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.396s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:59:02 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-c3bb098b-2ffe-4bfc-8a38-6662467e008d tempest-ProjectMemberTests-704047872 None] Create snapshot completed successfully Jul 08 18:59:02 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-0eb51902-85cd-40b9-994c-810eca615f66 tempest-ProjectReaderTests-422434555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.677s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:02 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-0eb51902-85cd-40b9-994c-810eca615f66 tempest-ProjectReaderTests-422434555 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:59:02 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-0eb51902-85cd-40b9-994c-810eca615f66 tempest-ProjectReaderTests-422434555 None] Deleted volume successfully. Jul 08 18:59:02 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-0eb51902-85cd-40b9-994c-810eca615f66 tempest-ProjectReaderTests-422434555 None] Lock "cinder-8a405464-6d4d-4b73-807c-dd993a618c48-delete_volume" released by "delete_volume" :: held 2.415s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:59:03 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1c57299-a272-4a92-bc33-2584b3229715 tempest-ProjectReaderTests-422434555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:59:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b1c57299-a272-4a92-bc33-2584b3229715 tempest-ProjectReaderTests-422434555 None] Flow 'volume_create_manager' (102ae0b9-fe7a-4ed4-b5fa-294cd17ed4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:59:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b1c57299-a272-4a92-bc33-2584b3229715 tempest-ProjectReaderTests-422434555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6061dcd-9a31-4568-8a31-2d877f1793df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:59:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b1c57299-a272-4a92-bc33-2584b3229715 tempest-ProjectReaderTests-422434555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6061dcd-9a31-4568-8a31-2d877f1793df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:59:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-114719388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1c223c9-d331-481f-8103-bdbfc8050a5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29c32154c507487cbafd67a692df63f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:59:03Z,use_quota=True,user_id='2a3842f74d0646b8824351eff025b80e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:59:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b1c57299-a272-4a92-bc33-2584b3229715 tempest-ProjectReaderTests-422434555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1b7bbb0-a1b1-4b70-a0cf-8f2aeabee51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:59:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b1c57299-a272-4a92-bc33-2584b3229715 tempest-ProjectReaderTests-422434555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1b7bbb0-a1b1-4b70-a0cf-8f2aeabee51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:59:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b1c57299-a272-4a92-bc33-2584b3229715 tempest-ProjectReaderTests-422434555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a6c8e40-da72-4cf7-93e7-84d6a70cbf19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:59:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b1c57299-a272-4a92-bc33-2584b3229715 tempest-ProjectReaderTests-422434555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a6c8e40-da72-4cf7-93e7-84d6a70cbf19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1c223c9-d331-481f-8103-bdbfc8050a5a', 'volume_name': 'volume-e1c223c9-d331-481f-8103-bdbfc8050a5a', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:59:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b1c57299-a272-4a92-bc33-2584b3229715 tempest-ProjectReaderTests-422434555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (149f3320-5075-451c-a595-0848567cb0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:59:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b1c57299-a272-4a92-bc33-2584b3229715 tempest-ProjectReaderTests-422434555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (149f3320-5075-451c-a595-0848567cb0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:59:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b1c57299-a272-4a92-bc33-2584b3229715 tempest-ProjectReaderTests-422434555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f6cb0ef-91de-49d5-af96-12195c0e28a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:59:03 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-b1c57299-a272-4a92-bc33-2584b3229715 tempest-ProjectReaderTests-422434555 None] Volume e1c223c9-d331-481f-8103-bdbfc8050a5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1c223c9-d331-481f-8103-bdbfc8050a5a', 'volume_size': 1} Jul 08 18:59:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b1c57299-a272-4a92-bc33-2584b3229715 tempest-ProjectReaderTests-422434555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:59:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b1c57299-a272-4a92-bc33-2584b3229715 tempest-ProjectReaderTests-422434555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:59:03 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b1c57299-a272-4a92-bc33-2584b3229715 tempest-ProjectReaderTests-422434555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:59:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-114719388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1c223c9-d331-481f-8103-bdbfc8050a5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29c32154c507487cbafd67a692df63f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:59:03Z,use_quota=True,user_id='2a3842f74d0646b8824351eff025b80e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:59:03 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-b1c57299-a272-4a92-bc33-2584b3229715 tempest-ProjectReaderTests-422434555 None] Creating volume e1c223c9-d331-481f-8103-bdbfc8050a5a {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:59:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b1c57299-a272-4a92-bc33-2584b3229715 tempest-ProjectReaderTests-422434555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:59:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b1c57299-a272-4a92-bc33-2584b3229715 tempest-ProjectReaderTests-422434555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:59:03 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b1c57299-a272-4a92-bc33-2584b3229715 tempest-ProjectReaderTests-422434555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:59:03 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b1c57299-a272-4a92-bc33-2584b3229715 tempest-ProjectReaderTests-422434555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:59:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b1c57299-a272-4a92-bc33-2584b3229715 tempest-ProjectReaderTests-422434555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:59:03 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b1c57299-a272-4a92-bc33-2584b3229715 tempest-ProjectReaderTests-422434555 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:59:03 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-b1c57299-a272-4a92-bc33-2584b3229715 tempest-ProjectReaderTests-422434555 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:59:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b1c57299-a272-4a92-bc33-2584b3229715 tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1c223c9-d331-481f-8103-bdbfc8050a5a 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:03 devstack sudo[105559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1c223c9-d331-481f-8103-bdbfc8050a5a 1073741824 Jul 08 18:59:03 devstack sudo[105559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:03 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-fe092eef-af90-4254-aa4e-4e466f958519 tempest-ProjectMemberTests-704047872 None] Acquiring lock "cinder-d3a6e280-e1d2-41b9-9296-548525821539-delete_snapshot" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:59:03 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-fe092eef-af90-4254-aa4e-4e466f958519 tempest-ProjectMemberTests-704047872 None] Lock "cinder-d3a6e280-e1d2-41b9-9296-548525821539-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:59:03 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-fe092eef-af90-4254-aa4e-4e466f958519 tempest-ProjectMemberTests-704047872 None] Acquiring lock "cinder-quobyte-98ff82a1-abc7-4ea3-b750-ff598c9df841" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:59:03 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-fe092eef-af90-4254-aa4e-4e466f958519 tempest-ProjectMemberTests-704047872 None] Lock "cinder-quobyte-98ff82a1-abc7-4ea3-b750-ff598c9df841" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:59:03 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-fe092eef-af90-4254-aa4e-4e466f958519 tempest-ProjectMemberTests-704047872 None] Acquiring lock "cinder-quobyte-d3a6e280-e1d2-41b9-9296-548525821539" by "_delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:59:03 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-fe092eef-af90-4254-aa4e-4e466f958519 tempest-ProjectMemberTests-704047872 None] Lock "cinder-quobyte-d3a6e280-e1d2-41b9-9296-548525821539" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:59:03 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-fe092eef-af90-4254-aa4e-4e466f958519 tempest-ProjectMemberTests-704047872 None] Deleting offline snapshot d3a6e280-e1d2-41b9-9296-548525821539 of volume 98ff82a1-abc7-4ea3-b750-ff598c9df841 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:59:03 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-fe092eef-af90-4254-aa4e-4e466f958519 tempest-ProjectMemberTests-704047872 None] snapshot_file for this snap is: volume-98ff82a1-abc7-4ea3-b750-ff598c9df841.d3a6e280-e1d2-41b9-9296-548525821539 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:59:03 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f04e9e5-9e8b-422e-b50d-1f85394ff98a]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:59:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-fe092eef-af90-4254-aa4e-4e466f958519 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-98ff82a1-abc7-4ea3-b750-ff598c9df841.d3a6e280-e1d2-41b9-9296-548525821539 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:03 devstack sudo[105561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-98ff82a1-abc7-4ea3-b750-ff598c9df841.d3a6e280-e1d2-41b9-9296-548525821539 Jul 08 18:59:03 devstack sudo[105561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:04 devstack sudo[105559]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b1c57299-a272-4a92-bc33-2584b3229715 tempest-ProjectReaderTests-422434555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1c223c9-d331-481f-8103-bdbfc8050a5a 1073741824" returned: 0 in 0.847s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b1c57299-a272-4a92-bc33-2584b3229715 tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1c223c9-d331-481f-8103-bdbfc8050a5a {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:04 devstack sudo[105569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1c223c9-d331-481f-8103-bdbfc8050a5a Jul 08 18:59:04 devstack sudo[105569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:04 devstack sudo[105561]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-fe092eef-af90-4254-aa4e-4e466f958519 tempest-ProjectMemberTests-704047872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-98ff82a1-abc7-4ea3-b750-ff598c9df841.d3a6e280-e1d2-41b9-9296-548525821539" returned: 0 in 0.782s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:04 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-fe092eef-af90-4254-aa4e-4e466f958519 tempest-ProjectMemberTests-704047872 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98ff82a1-abc7-4ea3-b750-ff598c9df841(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:59:04 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[06507aaa-b5e1-4788-9d92-594be99c8d4e]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:59:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-fe092eef-af90-4254-aa4e-4e466f958519 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-98ff82a1-abc7-4ea3-b750-ff598c9df841 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:04 devstack sudo[105571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-98ff82a1-abc7-4ea3-b750-ff598c9df841 Jul 08 18:59:04 devstack sudo[105571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:04 devstack sudo[105569]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b1c57299-a272-4a92-bc33-2584b3229715 tempest-ProjectReaderTests-422434555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1c223c9-d331-481f-8103-bdbfc8050a5a" returned: 0 in 0.662s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:04 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b1c57299-a272-4a92-bc33-2584b3229715 tempest-ProjectReaderTests-422434555 None] <== create_volume: return (1563ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:59:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b1c57299-a272-4a92-bc33-2584b3229715 tempest-ProjectReaderTests-422434555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:59:04 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b1c57299-a272-4a92-bc33-2584b3229715 tempest-ProjectReaderTests-422434555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f6cb0ef-91de-49d5-af96-12195c0e28a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1c223c9-d331-481f-8103-bdbfc8050a5a', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:59:04 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b1c57299-a272-4a92-bc33-2584b3229715 tempest-ProjectReaderTests-422434555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (953fb57c-8c41-4e4f-ba5d-6ccb73509516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:59:04 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-b1c57299-a272-4a92-bc33-2584b3229715 tempest-ProjectReaderTests-422434555 None] Volume volume-e1c223c9-d331-481f-8103-bdbfc8050a5a (e1c223c9-d331-481f-8103-bdbfc8050a5a): created successfully Jul 08 18:59:04 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b1c57299-a272-4a92-bc33-2584b3229715 tempest-ProjectReaderTests-422434555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (953fb57c-8c41-4e4f-ba5d-6ccb73509516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:59:04 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-b1c57299-a272-4a92-bc33-2584b3229715 tempest-ProjectReaderTests-422434555 None] Flow 'volume_create_manager' (102ae0b9-fe7a-4ed4-b5fa-294cd17ed4d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:59:04 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-b1c57299-a272-4a92-bc33-2584b3229715 tempest-ProjectReaderTests-422434555 None] Created volume successfully. Jul 08 18:59:05 devstack sudo[105571]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-fe092eef-af90-4254-aa4e-4e466f958519 tempest-ProjectMemberTests-704047872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-98ff82a1-abc7-4ea3-b750-ff598c9df841" returned: 0 in 0.778s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-fe092eef-af90-4254-aa4e-4e466f958519 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-98ff82a1-abc7-4ea3-b750-ff598c9df841.d3a6e280-e1d2-41b9-9296-548525821539 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:05 devstack sudo[105577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-98ff82a1-abc7-4ea3-b750-ff598c9df841.d3a6e280-e1d2-41b9-9296-548525821539 Jul 08 18:59:05 devstack sudo[105577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c60ce1f4-9f93-4c48-a1ff-a5f23934d11f tempest-ProjectReaderTests-422434555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:59:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c60ce1f4-9f93-4c48-a1ff-a5f23934d11f tempest-ProjectReaderTests-422434555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:59:05 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-c60ce1f4-9f93-4c48-a1ff-a5f23934d11f tempest-ProjectReaderTests-422434555 None] Creating offline snapshot d893e904-fac7-4c4a-9164-2bc20ee9b6ca of volume e1c223c9-d331-481f-8103-bdbfc8050a5a {{(pid=86873) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:59:05 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[646065fa-681a-4abe-b459-d336d7de5d63]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:59:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c60ce1f4-9f93-4c48-a1ff-a5f23934d11f tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1c223c9-d331-481f-8103-bdbfc8050a5a {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:05 devstack sudo[105579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1c223c9-d331-481f-8103-bdbfc8050a5a Jul 08 18:59:05 devstack sudo[105579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:05 devstack sudo[105577]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-fe092eef-af90-4254-aa4e-4e466f958519 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-98ff82a1-abc7-4ea3-b750-ff598c9df841.d3a6e280-e1d2-41b9-9296-548525821539" returned: 0 in 0.769s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-fe092eef-af90-4254-aa4e-4e466f958519 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-98ff82a1-abc7-4ea3-b750-ff598c9df841.d3a6e280-e1d2-41b9-9296-548525821539 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:05 devstack sudo[105584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-98ff82a1-abc7-4ea3-b750-ff598c9df841.d3a6e280-e1d2-41b9-9296-548525821539 Jul 08 18:59:05 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:06 devstack sudo[105579]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c60ce1f4-9f93-4c48-a1ff-a5f23934d11f tempest-ProjectReaderTests-422434555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1c223c9-d331-481f-8103-bdbfc8050a5a" returned: 0 in 0.819s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c60ce1f4-9f93-4c48-a1ff-a5f23934d11f tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1c223c9-d331-481f-8103-bdbfc8050a5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1c223c9-d331-481f-8103-bdbfc8050a5a.d893e904-fac7-4c4a-9164-2bc20ee9b6ca 1G {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:06 devstack sudo[105592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1c223c9-d331-481f-8103-bdbfc8050a5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1c223c9-d331-481f-8103-bdbfc8050a5a.d893e904-fac7-4c4a-9164-2bc20ee9b6ca 1G Jul 08 18:59:06 devstack sudo[105592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:06 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-fe092eef-af90-4254-aa4e-4e466f958519 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-98ff82a1-abc7-4ea3-b750-ff598c9df841.d3a6e280-e1d2-41b9-9296-548525821539" returned: 0 in 0.689s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:06 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-fe092eef-af90-4254-aa4e-4e466f958519 tempest-ProjectMemberTests-704047872 None] Lock "cinder-quobyte-d3a6e280-e1d2-41b9-9296-548525821539" released by "_delete_snapshot" :: held 3.121s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:59:06 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-fe092eef-af90-4254-aa4e-4e466f958519 tempest-ProjectMemberTests-704047872 None] Lock "cinder-quobyte-98ff82a1-abc7-4ea3-b750-ff598c9df841" released by "delete_snapshot" :: held 3.147s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:59:06 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-fe092eef-af90-4254-aa4e-4e466f958519 tempest-ProjectMemberTests-704047872 None] Created reservations ['d2508a40-d767-457c-895b-1b8c8ba52ca4', '3980bf7e-9c31-4418-818b-0def7c00ee57', '1132652f-53dd-4095-9501-1934e59d9ce2', 'c862ecce-0b75-4e74-9b49-b629d39ca2ee'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:59:06 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-fe092eef-af90-4254-aa4e-4e466f958519 tempest-ProjectMemberTests-704047872 None] Delete snapshot completed successfully. Jul 08 18:59:06 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-fe092eef-af90-4254-aa4e-4e466f958519 tempest-ProjectMemberTests-704047872 None] Lock "cinder-d3a6e280-e1d2-41b9-9296-548525821539-delete_snapshot" released by "delete_snapshot" :: held 3.286s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:59:07 devstack sudo[105592]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c60ce1f4-9f93-4c48-a1ff-a5f23934d11f tempest-ProjectReaderTests-422434555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1c223c9-d331-481f-8103-bdbfc8050a5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1c223c9-d331-481f-8103-bdbfc8050a5a.d893e904-fac7-4c4a-9164-2bc20ee9b6ca 1G" returned: 0 in 0.820s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c60ce1f4-9f93-4c48-a1ff-a5f23934d11f tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1c223c9-d331-481f-8103-bdbfc8050a5a -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1c223c9-d331-481f-8103-bdbfc8050a5a.d893e904-fac7-4c4a-9164-2bc20ee9b6ca {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:07 devstack sudo[105599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1c223c9-d331-481f-8103-bdbfc8050a5a -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1c223c9-d331-481f-8103-bdbfc8050a5a.d893e904-fac7-4c4a-9164-2bc20ee9b6ca Jul 08 18:59:07 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:07 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-dcc72bc7-e03f-4c93-a086-0d5b7b6f7aae tempest-ProjectMemberTests-704047872 None] Acquiring lock "cinder-98ff82a1-abc7-4ea3-b750-ff598c9df841-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:59:07 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-dcc72bc7-e03f-4c93-a086-0d5b7b6f7aae tempest-ProjectMemberTests-704047872 None] Lock "cinder-98ff82a1-abc7-4ea3-b750-ff598c9df841-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:59:07 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-dcc72bc7-e03f-4c93-a086-0d5b7b6f7aae tempest-ProjectMemberTests-704047872 None] Acquiring lock "cinder-quobyte-98ff82a1-abc7-4ea3-b750-ff598c9df841" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:59:07 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-dcc72bc7-e03f-4c93-a086-0d5b7b6f7aae tempest-ProjectMemberTests-704047872 None] Lock "cinder-quobyte-98ff82a1-abc7-4ea3-b750-ff598c9df841" acquired by "delete_volume" :: waited 0.017s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:59:07 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b10371-49f2-4238-8474-4065bb51e958]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:59:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dcc72bc7-e03f-4c93-a086-0d5b7b6f7aae tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-98ff82a1-abc7-4ea3-b750-ff598c9df841 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:07 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c60ce1f4-9f93-4c48-a1ff-a5f23934d11f tempest-ProjectReaderTests-422434555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1c223c9-d331-481f-8103-bdbfc8050a5a -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1c223c9-d331-481f-8103-bdbfc8050a5a.d893e904-fac7-4c4a-9164-2bc20ee9b6ca" returned: 0 in 0.712s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:07 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-c60ce1f4-9f93-4c48-a1ff-a5f23934d11f tempest-ProjectReaderTests-422434555 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1c223c9-d331-481f-8103-bdbfc8050a5a.d893e904-fac7-4c4a-9164-2bc20ee9b6ca is being set with open permissions: ugo+rw Jul 08 18:59:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c60ce1f4-9f93-4c48-a1ff-a5f23934d11f tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1c223c9-d331-481f-8103-bdbfc8050a5a.d893e904-fac7-4c4a-9164-2bc20ee9b6ca {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:07 devstack sudo[105642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1c223c9-d331-481f-8103-bdbfc8050a5a.d893e904-fac7-4c4a-9164-2bc20ee9b6ca Jul 08 18:59:07 devstack sudo[105642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:07 devstack sudo[105641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-98ff82a1-abc7-4ea3-b750-ff598c9df841 Jul 08 18:59:07 devstack sudo[105641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:08 devstack sudo[105642]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c60ce1f4-9f93-4c48-a1ff-a5f23934d11f tempest-ProjectReaderTests-422434555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1c223c9-d331-481f-8103-bdbfc8050a5a.d893e904-fac7-4c4a-9164-2bc20ee9b6ca" returned: 0 in 0.686s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:08 devstack sudo[105641]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dcc72bc7-e03f-4c93-a086-0d5b7b6f7aae tempest-ProjectMemberTests-704047872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-98ff82a1-abc7-4ea3-b750-ff598c9df841" returned: 0 in 0.776s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c60ce1f4-9f93-4c48-a1ff-a5f23934d11f tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1c223c9-d331-481f-8103-bdbfc8050a5a.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dcc72bc7-e03f-4c93-a086-0d5b7b6f7aae tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-98ff82a1-abc7-4ea3-b750-ff598c9df841 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:08 devstack sudo[105649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1c223c9-d331-481f-8103-bdbfc8050a5a.info Jul 08 18:59:08 devstack sudo[105649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:08 devstack sudo[105650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-98ff82a1-abc7-4ea3-b750-ff598c9df841 Jul 08 18:59:08 devstack sudo[105650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:09 devstack sudo[105650]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:09 devstack sudo[105649]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dcc72bc7-e03f-4c93-a086-0d5b7b6f7aae tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-98ff82a1-abc7-4ea3-b750-ff598c9df841" returned: 0 in 0.665s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c60ce1f4-9f93-4c48-a1ff-a5f23934d11f tempest-ProjectReaderTests-422434555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1c223c9-d331-481f-8103-bdbfc8050a5a.info" returned: 0 in 0.689s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:09 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-c60ce1f4-9f93-4c48-a1ff-a5f23934d11f tempest-ProjectReaderTests-422434555 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1c223c9-d331-481f-8103-bdbfc8050a5a.info is being set with open permissions: ugo+rw Jul 08 18:59:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c60ce1f4-9f93-4c48-a1ff-a5f23934d11f tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1c223c9-d331-481f-8103-bdbfc8050a5a.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:09 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-dcc72bc7-e03f-4c93-a086-0d5b7b6f7aae tempest-ProjectMemberTests-704047872 None] Lock "cinder-quobyte-98ff82a1-abc7-4ea3-b750-ff598c9df841" released by "delete_volume" :: held 1.523s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:59:09 devstack sudo[105655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1c223c9-d331-481f-8103-bdbfc8050a5a.info Jul 08 18:59:09 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:09 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-dcc72bc7-e03f-4c93-a086-0d5b7b6f7aae tempest-ProjectMemberTests-704047872 None] Created reservations ['ceda68b1-638d-41e9-824a-97e8c73f6542', '6fd64a8a-b34e-44c9-aa47-ea4b3d580dfe', '79d8f319-b4af-4710-8011-9155dfd33a14', 'c277aa15-dc4e-49e9-a8dd-78224682ab1b'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:59:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-dcc72bc7-e03f-4c93-a086-0d5b7b6f7aae tempest-ProjectMemberTests-704047872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:59:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-dcc72bc7-e03f-4c93-a086-0d5b7b6f7aae tempest-ProjectMemberTests-704047872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:59:09 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-dcc72bc7-e03f-4c93-a086-0d5b7b6f7aae tempest-ProjectMemberTests-704047872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:59:09 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-dcc72bc7-e03f-4c93-a086-0d5b7b6f7aae tempest-ProjectMemberTests-704047872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:59:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-dcc72bc7-e03f-4c93-a086-0d5b7b6f7aae tempest-ProjectMemberTests-704047872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:59:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dcc72bc7-e03f-4c93-a086-0d5b7b6f7aae tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:09 devstack sudo[105657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:59:09 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:09 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c60ce1f4-9f93-4c48-a1ff-a5f23934d11f tempest-ProjectReaderTests-422434555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1c223c9-d331-481f-8103-bdbfc8050a5a.info" returned: 0 in 0.690s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:09 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c60ce1f4-9f93-4c48-a1ff-a5f23934d11f tempest-ProjectReaderTests-422434555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.519s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:59:10 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-c60ce1f4-9f93-4c48-a1ff-a5f23934d11f tempest-ProjectReaderTests-422434555 None] Create snapshot completed successfully Jul 08 18:59:10 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-dcc72bc7-e03f-4c93-a086-0d5b7b6f7aae tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.698s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:10 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-dcc72bc7-e03f-4c93-a086-0d5b7b6f7aae tempest-ProjectMemberTests-704047872 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:59:10 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-dcc72bc7-e03f-4c93-a086-0d5b7b6f7aae tempest-ProjectMemberTests-704047872 None] Deleted volume successfully. Jul 08 18:59:10 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-dcc72bc7-e03f-4c93-a086-0d5b7b6f7aae tempest-ProjectMemberTests-704047872 None] Lock "cinder-98ff82a1-abc7-4ea3-b750-ff598c9df841-delete_volume" released by "delete_volume" :: held 2.427s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:59:10 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-218c056a-d07b-43df-b995-f8af63f99c64 tempest-ProjectMemberTests-704047872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:59:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-218c056a-d07b-43df-b995-f8af63f99c64 tempest-ProjectMemberTests-704047872 None] Flow 'volume_create_manager' (0530e846-2248-4fd6-8d75-36a660753740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:59:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-218c056a-d07b-43df-b995-f8af63f99c64 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (685bbd76-8c3b-498d-8886-338d34b17206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:59:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-218c056a-d07b-43df-b995-f8af63f99c64 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (685bbd76-8c3b-498d-8886-338d34b17206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:59:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1195556796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea7d933a-4970-4980-b75e-832425fe38ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23f6feda0dc341ae9dff1be67ef4c54c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:59:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:59:10Z,use_quota=True,user_id='ebff52e9980446ed8de939cd8116db5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:59:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-218c056a-d07b-43df-b995-f8af63f99c64 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36af2440-feba-4003-9833-8c1ebcb58e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:59:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-218c056a-d07b-43df-b995-f8af63f99c64 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36af2440-feba-4003-9833-8c1ebcb58e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:59:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-218c056a-d07b-43df-b995-f8af63f99c64 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f49472aa-cd3a-4aef-a8b7-dce493698bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:59:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-218c056a-d07b-43df-b995-f8af63f99c64 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f49472aa-cd3a-4aef-a8b7-dce493698bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea7d933a-4970-4980-b75e-832425fe38ab', 'volume_name': 'volume-ea7d933a-4970-4980-b75e-832425fe38ab', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:59:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-218c056a-d07b-43df-b995-f8af63f99c64 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0c614ac-cf1d-4e69-a51f-e5efed9a9a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:59:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-218c056a-d07b-43df-b995-f8af63f99c64 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0c614ac-cf1d-4e69-a51f-e5efed9a9a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:59:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-218c056a-d07b-43df-b995-f8af63f99c64 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcd52192-24b4-44b4-8d7b-82b04608ae07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:59:10 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-218c056a-d07b-43df-b995-f8af63f99c64 tempest-ProjectMemberTests-704047872 None] Volume ea7d933a-4970-4980-b75e-832425fe38ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea7d933a-4970-4980-b75e-832425fe38ab', 'volume_size': 1} Jul 08 18:59:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-218c056a-d07b-43df-b995-f8af63f99c64 tempest-ProjectMemberTests-704047872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:59:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-218c056a-d07b-43df-b995-f8af63f99c64 tempest-ProjectMemberTests-704047872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:59:10 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-218c056a-d07b-43df-b995-f8af63f99c64 tempest-ProjectMemberTests-704047872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:59:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1195556796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea7d933a-4970-4980-b75e-832425fe38ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23f6feda0dc341ae9dff1be67ef4c54c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:59:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:59:10Z,use_quota=True,user_id='ebff52e9980446ed8de939cd8116db5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:59:10 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-218c056a-d07b-43df-b995-f8af63f99c64 tempest-ProjectMemberTests-704047872 None] Creating volume ea7d933a-4970-4980-b75e-832425fe38ab {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:59:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-218c056a-d07b-43df-b995-f8af63f99c64 tempest-ProjectMemberTests-704047872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:59:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-218c056a-d07b-43df-b995-f8af63f99c64 tempest-ProjectMemberTests-704047872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:59:10 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-218c056a-d07b-43df-b995-f8af63f99c64 tempest-ProjectMemberTests-704047872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:59:10 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-218c056a-d07b-43df-b995-f8af63f99c64 tempest-ProjectMemberTests-704047872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:59:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-218c056a-d07b-43df-b995-f8af63f99c64 tempest-ProjectMemberTests-704047872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:59:10 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-218c056a-d07b-43df-b995-f8af63f99c64 tempest-ProjectMemberTests-704047872 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:59:10 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-218c056a-d07b-43df-b995-f8af63f99c64 tempest-ProjectMemberTests-704047872 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:59:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-218c056a-d07b-43df-b995-f8af63f99c64 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ea7d933a-4970-4980-b75e-832425fe38ab 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:10 devstack sudo[105661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ea7d933a-4970-4980-b75e-832425fe38ab 1073741824 Jul 08 18:59:10 devstack sudo[105661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:10 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-7970a8a7-eec4-4aa2-abe1-df1ff00b664f tempest-ProjectReaderTests-422434555 None] Acquiring lock "cinder-d893e904-fac7-4c4a-9164-2bc20ee9b6ca-delete_snapshot" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:59:10 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-7970a8a7-eec4-4aa2-abe1-df1ff00b664f tempest-ProjectReaderTests-422434555 None] Lock "cinder-d893e904-fac7-4c4a-9164-2bc20ee9b6ca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:59:10 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-7970a8a7-eec4-4aa2-abe1-df1ff00b664f tempest-ProjectReaderTests-422434555 None] Acquiring lock "cinder-quobyte-e1c223c9-d331-481f-8103-bdbfc8050a5a" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:59:10 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-7970a8a7-eec4-4aa2-abe1-df1ff00b664f tempest-ProjectReaderTests-422434555 None] Lock "cinder-quobyte-e1c223c9-d331-481f-8103-bdbfc8050a5a" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:59:10 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-7970a8a7-eec4-4aa2-abe1-df1ff00b664f tempest-ProjectReaderTests-422434555 None] Acquiring lock "cinder-quobyte-d893e904-fac7-4c4a-9164-2bc20ee9b6ca" by "_delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:59:10 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-7970a8a7-eec4-4aa2-abe1-df1ff00b664f tempest-ProjectReaderTests-422434555 None] Lock "cinder-quobyte-d893e904-fac7-4c4a-9164-2bc20ee9b6ca" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:59:10 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-7970a8a7-eec4-4aa2-abe1-df1ff00b664f tempest-ProjectReaderTests-422434555 None] Deleting offline snapshot d893e904-fac7-4c4a-9164-2bc20ee9b6ca of volume e1c223c9-d331-481f-8103-bdbfc8050a5a {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:59:10 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-7970a8a7-eec4-4aa2-abe1-df1ff00b664f tempest-ProjectReaderTests-422434555 None] snapshot_file for this snap is: volume-e1c223c9-d331-481f-8103-bdbfc8050a5a.d893e904-fac7-4c4a-9164-2bc20ee9b6ca {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:59:10 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[4550388b-9de6-4aad-9d8a-027f1cb0a466]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:59:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-7970a8a7-eec4-4aa2-abe1-df1ff00b664f tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1c223c9-d331-481f-8103-bdbfc8050a5a.d893e904-fac7-4c4a-9164-2bc20ee9b6ca {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:10 devstack sudo[105663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1c223c9-d331-481f-8103-bdbfc8050a5a.d893e904-fac7-4c4a-9164-2bc20ee9b6ca Jul 08 18:59:10 devstack sudo[105663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:11 devstack sudo[105661]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-218c056a-d07b-43df-b995-f8af63f99c64 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ea7d933a-4970-4980-b75e-832425fe38ab 1073741824" returned: 0 in 0.910s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-218c056a-d07b-43df-b995-f8af63f99c64 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ea7d933a-4970-4980-b75e-832425fe38ab {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:11 devstack sudo[105668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ea7d933a-4970-4980-b75e-832425fe38ab Jul 08 18:59:11 devstack sudo[105668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:11 devstack sudo[105663]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-7970a8a7-eec4-4aa2-abe1-df1ff00b664f tempest-ProjectReaderTests-422434555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1c223c9-d331-481f-8103-bdbfc8050a5a.d893e904-fac7-4c4a-9164-2bc20ee9b6ca" returned: 0 in 0.818s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:11 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-7970a8a7-eec4-4aa2-abe1-df1ff00b664f tempest-ProjectReaderTests-422434555 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1c223c9-d331-481f-8103-bdbfc8050a5a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:59:11 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[0713b5ef-d9e8-4f31-b8af-9430b5da4563]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:59:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-7970a8a7-eec4-4aa2-abe1-df1ff00b664f tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1c223c9-d331-481f-8103-bdbfc8050a5a {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:11 devstack sudo[105673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1c223c9-d331-481f-8103-bdbfc8050a5a Jul 08 18:59:11 devstack sudo[105673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:12 devstack sudo[105668]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-218c056a-d07b-43df-b995-f8af63f99c64 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ea7d933a-4970-4980-b75e-832425fe38ab" returned: 0 in 0.651s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:12 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-218c056a-d07b-43df-b995-f8af63f99c64 tempest-ProjectMemberTests-704047872 None] <== create_volume: return (1607ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:59:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-218c056a-d07b-43df-b995-f8af63f99c64 tempest-ProjectMemberTests-704047872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.610s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:59:12 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-218c056a-d07b-43df-b995-f8af63f99c64 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcd52192-24b4-44b4-8d7b-82b04608ae07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea7d933a-4970-4980-b75e-832425fe38ab', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:59:12 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-218c056a-d07b-43df-b995-f8af63f99c64 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd6071ae-67c0-41e6-9568-08ee18703da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:59:12 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-218c056a-d07b-43df-b995-f8af63f99c64 tempest-ProjectMemberTests-704047872 None] Volume volume-ea7d933a-4970-4980-b75e-832425fe38ab (ea7d933a-4970-4980-b75e-832425fe38ab): created successfully Jul 08 18:59:12 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-218c056a-d07b-43df-b995-f8af63f99c64 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd6071ae-67c0-41e6-9568-08ee18703da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:59:12 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-218c056a-d07b-43df-b995-f8af63f99c64 tempest-ProjectMemberTests-704047872 None] Flow 'volume_create_manager' (0530e846-2248-4fd6-8d75-36a660753740) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:59:12 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-218c056a-d07b-43df-b995-f8af63f99c64 tempest-ProjectMemberTests-704047872 None] Created volume successfully. Jul 08 18:59:12 devstack sudo[105673]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-7970a8a7-eec4-4aa2-abe1-df1ff00b664f tempest-ProjectReaderTests-422434555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1c223c9-d331-481f-8103-bdbfc8050a5a" returned: 0 in 0.803s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-7970a8a7-eec4-4aa2-abe1-df1ff00b664f tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1c223c9-d331-481f-8103-bdbfc8050a5a.d893e904-fac7-4c4a-9164-2bc20ee9b6ca {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:12 devstack sudo[105680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1c223c9-d331-481f-8103-bdbfc8050a5a.d893e904-fac7-4c4a-9164-2bc20ee9b6ca Jul 08 18:59:12 devstack sudo[105680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b09e168a-5b52-4c35-baac-f5ec0ca93f57 tempest-ProjectMemberTests-704047872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:59:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b09e168a-5b52-4c35-baac-f5ec0ca93f57 tempest-ProjectMemberTests-704047872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:59:12 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-b09e168a-5b52-4c35-baac-f5ec0ca93f57 tempest-ProjectMemberTests-704047872 None] Creating offline snapshot 080056b8-61e1-4adf-a7f1-de0d80bc5205 of volume ea7d933a-4970-4980-b75e-832425fe38ab {{(pid=86873) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:59:12 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[93deebe1-4ea9-4a3f-8f8f-c816b80c3063]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:59:12 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b09e168a-5b52-4c35-baac-f5ec0ca93f57 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ea7d933a-4970-4980-b75e-832425fe38ab {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:12 devstack sudo[105682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ea7d933a-4970-4980-b75e-832425fe38ab Jul 08 18:59:12 devstack sudo[105682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:13 devstack sudo[105680]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-7970a8a7-eec4-4aa2-abe1-df1ff00b664f tempest-ProjectReaderTests-422434555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1c223c9-d331-481f-8103-bdbfc8050a5a.d893e904-fac7-4c4a-9164-2bc20ee9b6ca" returned: 0 in 0.750s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-7970a8a7-eec4-4aa2-abe1-df1ff00b664f tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1c223c9-d331-481f-8103-bdbfc8050a5a.d893e904-fac7-4c4a-9164-2bc20ee9b6ca {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:13 devstack sudo[105688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1c223c9-d331-481f-8103-bdbfc8050a5a.d893e904-fac7-4c4a-9164-2bc20ee9b6ca Jul 08 18:59:13 devstack sudo[105688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:13 devstack sudo[105682]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b09e168a-5b52-4c35-baac-f5ec0ca93f57 tempest-ProjectMemberTests-704047872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ea7d933a-4970-4980-b75e-832425fe38ab" returned: 0 in 0.792s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b09e168a-5b52-4c35-baac-f5ec0ca93f57 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ea7d933a-4970-4980-b75e-832425fe38ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ea7d933a-4970-4980-b75e-832425fe38ab.080056b8-61e1-4adf-a7f1-de0d80bc5205 1G {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:13 devstack sudo[105693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ea7d933a-4970-4980-b75e-832425fe38ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ea7d933a-4970-4980-b75e-832425fe38ab.080056b8-61e1-4adf-a7f1-de0d80bc5205 1G Jul 08 18:59:13 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:13 devstack sudo[105688]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:13 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-7970a8a7-eec4-4aa2-abe1-df1ff00b664f tempest-ProjectReaderTests-422434555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1c223c9-d331-481f-8103-bdbfc8050a5a.d893e904-fac7-4c4a-9164-2bc20ee9b6ca" returned: 0 in 0.661s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:13 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-7970a8a7-eec4-4aa2-abe1-df1ff00b664f tempest-ProjectReaderTests-422434555 None] Lock "cinder-quobyte-d893e904-fac7-4c4a-9164-2bc20ee9b6ca" released by "_delete_snapshot" :: held 3.134s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:59:13 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-7970a8a7-eec4-4aa2-abe1-df1ff00b664f tempest-ProjectReaderTests-422434555 None] Lock "cinder-quobyte-e1c223c9-d331-481f-8103-bdbfc8050a5a" released by "delete_snapshot" :: held 3.157s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:59:13 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-7970a8a7-eec4-4aa2-abe1-df1ff00b664f tempest-ProjectReaderTests-422434555 None] Created reservations ['2fd992ae-ab66-412b-944f-7c03e811eef9', '182592f2-dc6c-45f7-8222-0adb1eab2e53', '7944eb4b-5a85-47b3-83cd-107926661739', '68c83c54-9b78-4660-99d6-7cdb65262b90'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:59:14 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-7970a8a7-eec4-4aa2-abe1-df1ff00b664f tempest-ProjectReaderTests-422434555 None] Delete snapshot completed successfully. Jul 08 18:59:14 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-7970a8a7-eec4-4aa2-abe1-df1ff00b664f tempest-ProjectReaderTests-422434555 None] Lock "cinder-d893e904-fac7-4c4a-9164-2bc20ee9b6ca-delete_snapshot" released by "delete_snapshot" :: held 3.303s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:59:14 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b09e168a-5b52-4c35-baac-f5ec0ca93f57 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ea7d933a-4970-4980-b75e-832425fe38ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ea7d933a-4970-4980-b75e-832425fe38ab.080056b8-61e1-4adf-a7f1-de0d80bc5205 1G" returned: 0 in 0.808s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b09e168a-5b52-4c35-baac-f5ec0ca93f57 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea7d933a-4970-4980-b75e-832425fe38ab -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ea7d933a-4970-4980-b75e-832425fe38ab.080056b8-61e1-4adf-a7f1-de0d80bc5205 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:14 devstack sudo[105701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea7d933a-4970-4980-b75e-832425fe38ab -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ea7d933a-4970-4980-b75e-832425fe38ab.080056b8-61e1-4adf-a7f1-de0d80bc5205 Jul 08 18:59:14 devstack sudo[105701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:14 devstack sudo[105701]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:14 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-20ad1886-e03c-40e1-b386-e547e5560da8 tempest-ProjectReaderTests-422434555 None] Acquiring lock "cinder-e1c223c9-d331-481f-8103-bdbfc8050a5a-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:59:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b09e168a-5b52-4c35-baac-f5ec0ca93f57 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea7d933a-4970-4980-b75e-832425fe38ab -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ea7d933a-4970-4980-b75e-832425fe38ab.080056b8-61e1-4adf-a7f1-de0d80bc5205" returned: 0 in 0.705s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:14 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-b09e168a-5b52-4c35-baac-f5ec0ca93f57 tempest-ProjectMemberTests-704047872 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ea7d933a-4970-4980-b75e-832425fe38ab.080056b8-61e1-4adf-a7f1-de0d80bc5205 is being set with open permissions: ugo+rw Jul 08 18:59:14 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b09e168a-5b52-4c35-baac-f5ec0ca93f57 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ea7d933a-4970-4980-b75e-832425fe38ab.080056b8-61e1-4adf-a7f1-de0d80bc5205 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:14 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-20ad1886-e03c-40e1-b386-e547e5560da8 tempest-ProjectReaderTests-422434555 None] Lock "cinder-e1c223c9-d331-481f-8103-bdbfc8050a5a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:59:14 devstack sudo[105706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ea7d933a-4970-4980-b75e-832425fe38ab.080056b8-61e1-4adf-a7f1-de0d80bc5205 Jul 08 18:59:14 devstack sudo[105706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:15 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-20ad1886-e03c-40e1-b386-e547e5560da8 tempest-ProjectReaderTests-422434555 None] Acquiring lock "cinder-quobyte-e1c223c9-d331-481f-8103-bdbfc8050a5a" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:59:15 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-20ad1886-e03c-40e1-b386-e547e5560da8 tempest-ProjectReaderTests-422434555 None] Lock "cinder-quobyte-e1c223c9-d331-481f-8103-bdbfc8050a5a" acquired by "delete_volume" :: waited 0.015s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:59:15 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf9abd2-eb08-450f-b17c-f6fccc5db173]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:59:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-20ad1886-e03c-40e1-b386-e547e5560da8 tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1c223c9-d331-481f-8103-bdbfc8050a5a {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:15 devstack sudo[105708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1c223c9-d331-481f-8103-bdbfc8050a5a Jul 08 18:59:15 devstack sudo[105708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:15 devstack sudo[105706]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b09e168a-5b52-4c35-baac-f5ec0ca93f57 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ea7d933a-4970-4980-b75e-832425fe38ab.080056b8-61e1-4adf-a7f1-de0d80bc5205" returned: 0 in 0.685s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b09e168a-5b52-4c35-baac-f5ec0ca93f57 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ea7d933a-4970-4980-b75e-832425fe38ab.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:15 devstack sudo[105711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ea7d933a-4970-4980-b75e-832425fe38ab.info Jul 08 18:59:15 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:15 devstack sudo[105708]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-20ad1886-e03c-40e1-b386-e547e5560da8 tempest-ProjectReaderTests-422434555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1c223c9-d331-481f-8103-bdbfc8050a5a" returned: 0 in 0.776s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:15 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-20ad1886-e03c-40e1-b386-e547e5560da8 tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1c223c9-d331-481f-8103-bdbfc8050a5a {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:15 devstack sudo[105716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1c223c9-d331-481f-8103-bdbfc8050a5a Jul 08 18:59:15 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:16 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b09e168a-5b52-4c35-baac-f5ec0ca93f57 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ea7d933a-4970-4980-b75e-832425fe38ab.info" returned: 0 in 0.684s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:16 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-b09e168a-5b52-4c35-baac-f5ec0ca93f57 tempest-ProjectMemberTests-704047872 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ea7d933a-4970-4980-b75e-832425fe38ab.info is being set with open permissions: ugo+rw Jul 08 18:59:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b09e168a-5b52-4c35-baac-f5ec0ca93f57 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ea7d933a-4970-4980-b75e-832425fe38ab.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:16 devstack sudo[105719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ea7d933a-4970-4980-b75e-832425fe38ab.info Jul 08 18:59:16 devstack sudo[105719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:16 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-20ad1886-e03c-40e1-b386-e547e5560da8 tempest-ProjectReaderTests-422434555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e1c223c9-d331-481f-8103-bdbfc8050a5a" returned: 0 in 0.712s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:16 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-20ad1886-e03c-40e1-b386-e547e5560da8 tempest-ProjectReaderTests-422434555 None] Lock "cinder-quobyte-e1c223c9-d331-481f-8103-bdbfc8050a5a" released by "delete_volume" :: held 1.558s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:59:16 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-20ad1886-e03c-40e1-b386-e547e5560da8 tempest-ProjectReaderTests-422434555 None] Created reservations ['0ce237c5-b97a-4456-be4f-6cbc9eb41ae6', 'b217b235-fb08-437a-b546-cef9f8cecdd5', '220b0983-ddad-4c7d-8bbc-bc3128536d80', 'b259a23b-4a41-45a1-ab70-b024fd01a621'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:59:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-20ad1886-e03c-40e1-b386-e547e5560da8 tempest-ProjectReaderTests-422434555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:59:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-20ad1886-e03c-40e1-b386-e547e5560da8 tempest-ProjectReaderTests-422434555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:59:16 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-20ad1886-e03c-40e1-b386-e547e5560da8 tempest-ProjectReaderTests-422434555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:59:16 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-20ad1886-e03c-40e1-b386-e547e5560da8 tempest-ProjectReaderTests-422434555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:59:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-20ad1886-e03c-40e1-b386-e547e5560da8 tempest-ProjectReaderTests-422434555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:59:16 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-20ad1886-e03c-40e1-b386-e547e5560da8 tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:16 devstack sudo[105722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:59:16 devstack sudo[105722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:16 devstack sudo[105719]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b09e168a-5b52-4c35-baac-f5ec0ca93f57 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ea7d933a-4970-4980-b75e-832425fe38ab.info" returned: 0 in 0.674s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b09e168a-5b52-4c35-baac-f5ec0ca93f57 tempest-ProjectMemberTests-704047872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.442s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:59:17 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-b09e168a-5b52-4c35-baac-f5ec0ca93f57 tempest-ProjectMemberTests-704047872 None] Create snapshot completed successfully Jul 08 18:59:17 devstack sudo[105722]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-20ad1886-e03c-40e1-b386-e547e5560da8 tempest-ProjectReaderTests-422434555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.703s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:17 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-20ad1886-e03c-40e1-b386-e547e5560da8 tempest-ProjectReaderTests-422434555 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:59:17 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-20ad1886-e03c-40e1-b386-e547e5560da8 tempest-ProjectReaderTests-422434555 None] Deleted volume successfully. Jul 08 18:59:17 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-20ad1886-e03c-40e1-b386-e547e5560da8 tempest-ProjectReaderTests-422434555 None] Lock "cinder-e1c223c9-d331-481f-8103-bdbfc8050a5a-delete_volume" released by "delete_volume" :: held 2.524s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:59:17 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbe0ffdc-75cb-45ed-92f2-1be232b046b6 tempest-ProjectReaderTests-422434555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:59:17 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fbe0ffdc-75cb-45ed-92f2-1be232b046b6 tempest-ProjectReaderTests-422434555 None] Flow 'volume_create_manager' (bb325063-b2f3-4fca-9024-d96b6b71f78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:59:17 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fbe0ffdc-75cb-45ed-92f2-1be232b046b6 tempest-ProjectReaderTests-422434555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d75e847e-45a8-4ac0-9378-1fcc69e14168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:59:17 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fbe0ffdc-75cb-45ed-92f2-1be232b046b6 tempest-ProjectReaderTests-422434555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d75e847e-45a8-4ac0-9378-1fcc69e14168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:59:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-713254653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b9955d4-9ba0-42de-a015-ccf7941577e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29c32154c507487cbafd67a692df63f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:59:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:59:18Z,use_quota=True,user_id='2a3842f74d0646b8824351eff025b80e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:59:17 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fbe0ffdc-75cb-45ed-92f2-1be232b046b6 tempest-ProjectReaderTests-422434555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09ba8108-3946-45b1-ba96-28b5a21413b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:59:17 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fbe0ffdc-75cb-45ed-92f2-1be232b046b6 tempest-ProjectReaderTests-422434555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09ba8108-3946-45b1-ba96-28b5a21413b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:59:17 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fbe0ffdc-75cb-45ed-92f2-1be232b046b6 tempest-ProjectReaderTests-422434555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c57db67-fdb0-48ed-b82d-5071d32bd5c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:59:17 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fbe0ffdc-75cb-45ed-92f2-1be232b046b6 tempest-ProjectReaderTests-422434555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c57db67-fdb0-48ed-b82d-5071d32bd5c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b9955d4-9ba0-42de-a015-ccf7941577e1', 'volume_name': 'volume-2b9955d4-9ba0-42de-a015-ccf7941577e1', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:59:17 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fbe0ffdc-75cb-45ed-92f2-1be232b046b6 tempest-ProjectReaderTests-422434555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3647b28-f400-455d-a5d7-2e82d0d9fa2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:59:17 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fbe0ffdc-75cb-45ed-92f2-1be232b046b6 tempest-ProjectReaderTests-422434555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3647b28-f400-455d-a5d7-2e82d0d9fa2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:59:17 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fbe0ffdc-75cb-45ed-92f2-1be232b046b6 tempest-ProjectReaderTests-422434555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feafe47c-1924-44f4-8926-e76fd20dfbef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:59:17 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-fbe0ffdc-75cb-45ed-92f2-1be232b046b6 tempest-ProjectReaderTests-422434555 None] Volume 2b9955d4-9ba0-42de-a015-ccf7941577e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b9955d4-9ba0-42de-a015-ccf7941577e1', 'volume_size': 1} Jul 08 18:59:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-fbe0ffdc-75cb-45ed-92f2-1be232b046b6 tempest-ProjectReaderTests-422434555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:59:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-fbe0ffdc-75cb-45ed-92f2-1be232b046b6 tempest-ProjectReaderTests-422434555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:59:17 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-fbe0ffdc-75cb-45ed-92f2-1be232b046b6 tempest-ProjectReaderTests-422434555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:59:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-713254653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b9955d4-9ba0-42de-a015-ccf7941577e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29c32154c507487cbafd67a692df63f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:59:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:59:18Z,use_quota=True,user_id='2a3842f74d0646b8824351eff025b80e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:59:17 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-fbe0ffdc-75cb-45ed-92f2-1be232b046b6 tempest-ProjectReaderTests-422434555 None] Creating volume 2b9955d4-9ba0-42de-a015-ccf7941577e1 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:59:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-fbe0ffdc-75cb-45ed-92f2-1be232b046b6 tempest-ProjectReaderTests-422434555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:59:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-fbe0ffdc-75cb-45ed-92f2-1be232b046b6 tempest-ProjectReaderTests-422434555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:59:17 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-fbe0ffdc-75cb-45ed-92f2-1be232b046b6 tempest-ProjectReaderTests-422434555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:59:17 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-fbe0ffdc-75cb-45ed-92f2-1be232b046b6 tempest-ProjectReaderTests-422434555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:59:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-fbe0ffdc-75cb-45ed-92f2-1be232b046b6 tempest-ProjectReaderTests-422434555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:59:17 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-fbe0ffdc-75cb-45ed-92f2-1be232b046b6 tempest-ProjectReaderTests-422434555 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:59:17 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-fbe0ffdc-75cb-45ed-92f2-1be232b046b6 tempest-ProjectReaderTests-422434555 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:59:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-fbe0ffdc-75cb-45ed-92f2-1be232b046b6 tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2b9955d4-9ba0-42de-a015-ccf7941577e1 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:17 devstack sudo[105734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2b9955d4-9ba0-42de-a015-ccf7941577e1 1073741824 Jul 08 18:59:17 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:17 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b9944bc4-857c-421d-890d-2112bce442e3 tempest-ProjectMemberTests-704047872 None] Acquiring lock "cinder-080056b8-61e1-4adf-a7f1-de0d80bc5205-delete_snapshot" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:59:17 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b9944bc4-857c-421d-890d-2112bce442e3 tempest-ProjectMemberTests-704047872 None] Lock "cinder-080056b8-61e1-4adf-a7f1-de0d80bc5205-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:59:17 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b9944bc4-857c-421d-890d-2112bce442e3 tempest-ProjectMemberTests-704047872 None] Acquiring lock "cinder-quobyte-ea7d933a-4970-4980-b75e-832425fe38ab" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:59:17 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b9944bc4-857c-421d-890d-2112bce442e3 tempest-ProjectMemberTests-704047872 None] Lock "cinder-quobyte-ea7d933a-4970-4980-b75e-832425fe38ab" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:59:17 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b9944bc4-857c-421d-890d-2112bce442e3 tempest-ProjectMemberTests-704047872 None] Acquiring lock "cinder-quobyte-080056b8-61e1-4adf-a7f1-de0d80bc5205" by "_delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:59:17 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b9944bc4-857c-421d-890d-2112bce442e3 tempest-ProjectMemberTests-704047872 None] Lock "cinder-quobyte-080056b8-61e1-4adf-a7f1-de0d80bc5205" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:59:17 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-b9944bc4-857c-421d-890d-2112bce442e3 tempest-ProjectMemberTests-704047872 None] Deleting offline snapshot 080056b8-61e1-4adf-a7f1-de0d80bc5205 of volume ea7d933a-4970-4980-b75e-832425fe38ab {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:59:17 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-b9944bc4-857c-421d-890d-2112bce442e3 tempest-ProjectMemberTests-704047872 None] snapshot_file for this snap is: volume-ea7d933a-4970-4980-b75e-832425fe38ab.080056b8-61e1-4adf-a7f1-de0d80bc5205 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:59:17 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff637188-79a6-4102-8097-379230c7fec4]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:59:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b9944bc4-857c-421d-890d-2112bce442e3 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ea7d933a-4970-4980-b75e-832425fe38ab.080056b8-61e1-4adf-a7f1-de0d80bc5205 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:18 devstack sudo[105736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ea7d933a-4970-4980-b75e-832425fe38ab.080056b8-61e1-4adf-a7f1-de0d80bc5205 Jul 08 18:59:18 devstack sudo[105736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:18 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-fbe0ffdc-75cb-45ed-92f2-1be232b046b6 tempest-ProjectReaderTests-422434555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2b9955d4-9ba0-42de-a015-ccf7941577e1 1073741824" returned: 0 in 0.865s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-fbe0ffdc-75cb-45ed-92f2-1be232b046b6 tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2b9955d4-9ba0-42de-a015-ccf7941577e1 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:18 devstack sudo[105743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2b9955d4-9ba0-42de-a015-ccf7941577e1 Jul 08 18:59:18 devstack sudo[105743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:18 devstack sudo[105736]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b9944bc4-857c-421d-890d-2112bce442e3 tempest-ProjectMemberTests-704047872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ea7d933a-4970-4980-b75e-832425fe38ab.080056b8-61e1-4adf-a7f1-de0d80bc5205" returned: 0 in 0.826s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:18 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-b9944bc4-857c-421d-890d-2112bce442e3 tempest-ProjectMemberTests-704047872 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea7d933a-4970-4980-b75e-832425fe38ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:59:18 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd945912-4d53-4020-a4e0-9de60302db22]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:59:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b9944bc4-857c-421d-890d-2112bce442e3 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ea7d933a-4970-4980-b75e-832425fe38ab {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:18 devstack sudo[105746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ea7d933a-4970-4980-b75e-832425fe38ab Jul 08 18:59:18 devstack sudo[105746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:19 devstack sudo[105743]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:19 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-fbe0ffdc-75cb-45ed-92f2-1be232b046b6 tempest-ProjectReaderTests-422434555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2b9955d4-9ba0-42de-a015-ccf7941577e1" returned: 0 in 0.672s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:19 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-fbe0ffdc-75cb-45ed-92f2-1be232b046b6 tempest-ProjectReaderTests-422434555 None] <== create_volume: return (1581ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:59:19 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-fbe0ffdc-75cb-45ed-92f2-1be232b046b6 tempest-ProjectReaderTests-422434555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.585s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:59:19 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fbe0ffdc-75cb-45ed-92f2-1be232b046b6 tempest-ProjectReaderTests-422434555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feafe47c-1924-44f4-8926-e76fd20dfbef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b9955d4-9ba0-42de-a015-ccf7941577e1', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:59:19 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fbe0ffdc-75cb-45ed-92f2-1be232b046b6 tempest-ProjectReaderTests-422434555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1bd3006-27c8-4afe-82cb-6135dd556e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:59:19 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-fbe0ffdc-75cb-45ed-92f2-1be232b046b6 tempest-ProjectReaderTests-422434555 None] Volume volume-2b9955d4-9ba0-42de-a015-ccf7941577e1 (2b9955d4-9ba0-42de-a015-ccf7941577e1): created successfully Jul 08 18:59:19 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fbe0ffdc-75cb-45ed-92f2-1be232b046b6 tempest-ProjectReaderTests-422434555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1bd3006-27c8-4afe-82cb-6135dd556e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:59:19 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-fbe0ffdc-75cb-45ed-92f2-1be232b046b6 tempest-ProjectReaderTests-422434555 None] Flow 'volume_create_manager' (bb325063-b2f3-4fca-9024-d96b6b71f78a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:59:19 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-fbe0ffdc-75cb-45ed-92f2-1be232b046b6 tempest-ProjectReaderTests-422434555 None] Created volume successfully. Jul 08 18:59:19 devstack sudo[105746]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:19 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b9944bc4-857c-421d-890d-2112bce442e3 tempest-ProjectMemberTests-704047872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ea7d933a-4970-4980-b75e-832425fe38ab" returned: 0 in 0.804s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:19 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b9944bc4-857c-421d-890d-2112bce442e3 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ea7d933a-4970-4980-b75e-832425fe38ab.080056b8-61e1-4adf-a7f1-de0d80bc5205 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:19 devstack sudo[105752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ea7d933a-4970-4980-b75e-832425fe38ab.080056b8-61e1-4adf-a7f1-de0d80bc5205 Jul 08 18:59:19 devstack sudo[105752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:19 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-bc3aaead-45e7-423a-ae4d-a2b33215ce7d tempest-ProjectReaderTests-422434555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:59:19 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-bc3aaead-45e7-423a-ae4d-a2b33215ce7d tempest-ProjectReaderTests-422434555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:59:19 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-bc3aaead-45e7-423a-ae4d-a2b33215ce7d tempest-ProjectReaderTests-422434555 None] Creating offline snapshot 91d539eb-f0d5-45b5-b58c-73c650ec3c4d of volume 2b9955d4-9ba0-42de-a015-ccf7941577e1 {{(pid=86873) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:59:19 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[b679a122-dd04-4c33-a5d8-68f451b2bfb9]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:59:19 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-bc3aaead-45e7-423a-ae4d-a2b33215ce7d tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2b9955d4-9ba0-42de-a015-ccf7941577e1 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:20 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2b9955d4-9ba0-42de-a015-ccf7941577e1 Jul 08 18:59:20 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:20 devstack sudo[105752]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b9944bc4-857c-421d-890d-2112bce442e3 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ea7d933a-4970-4980-b75e-832425fe38ab.080056b8-61e1-4adf-a7f1-de0d80bc5205" returned: 0 in 0.750s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b9944bc4-857c-421d-890d-2112bce442e3 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ea7d933a-4970-4980-b75e-832425fe38ab.080056b8-61e1-4adf-a7f1-de0d80bc5205 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:20 devstack sudo[105759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ea7d933a-4970-4980-b75e-832425fe38ab.080056b8-61e1-4adf-a7f1-de0d80bc5205 Jul 08 18:59:20 devstack sudo[105759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:20 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-bc3aaead-45e7-423a-ae4d-a2b33215ce7d tempest-ProjectReaderTests-422434555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2b9955d4-9ba0-42de-a015-ccf7941577e1" returned: 0 in 0.784s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-bc3aaead-45e7-423a-ae4d-a2b33215ce7d tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2b9955d4-9ba0-42de-a015-ccf7941577e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2b9955d4-9ba0-42de-a015-ccf7941577e1.91d539eb-f0d5-45b5-b58c-73c650ec3c4d 1G {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:20 devstack sudo[105764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2b9955d4-9ba0-42de-a015-ccf7941577e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2b9955d4-9ba0-42de-a015-ccf7941577e1.91d539eb-f0d5-45b5-b58c-73c650ec3c4d 1G Jul 08 18:59:20 devstack sudo[105764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:21 devstack sudo[105759]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b9944bc4-857c-421d-890d-2112bce442e3 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ea7d933a-4970-4980-b75e-832425fe38ab.080056b8-61e1-4adf-a7f1-de0d80bc5205" returned: 0 in 0.683s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:21 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b9944bc4-857c-421d-890d-2112bce442e3 tempest-ProjectMemberTests-704047872 None] Lock "cinder-quobyte-080056b8-61e1-4adf-a7f1-de0d80bc5205" released by "_delete_snapshot" :: held 3.162s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:59:21 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b9944bc4-857c-421d-890d-2112bce442e3 tempest-ProjectMemberTests-704047872 None] Lock "cinder-quobyte-ea7d933a-4970-4980-b75e-832425fe38ab" released by "delete_snapshot" :: held 3.183s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:59:21 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-b9944bc4-857c-421d-890d-2112bce442e3 tempest-ProjectMemberTests-704047872 None] Created reservations ['f0256e50-aea1-4cff-b5c1-54f21a8b4ab8', '8159c3cf-159b-436f-beb5-84ee9369670a', '9598b403-5af1-49c2-b39d-3bc8ac08ff5b', '041bf2df-5a3e-4359-9c70-07ce5e1baa4c'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:59:21 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-b9944bc4-857c-421d-890d-2112bce442e3 tempest-ProjectMemberTests-704047872 None] Delete snapshot completed successfully. Jul 08 18:59:21 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b9944bc4-857c-421d-890d-2112bce442e3 tempest-ProjectMemberTests-704047872 None] Lock "cinder-080056b8-61e1-4adf-a7f1-de0d80bc5205-delete_snapshot" released by "delete_snapshot" :: held 3.321s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:59:21 devstack sudo[105764]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-bc3aaead-45e7-423a-ae4d-a2b33215ce7d tempest-ProjectReaderTests-422434555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2b9955d4-9ba0-42de-a015-ccf7941577e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2b9955d4-9ba0-42de-a015-ccf7941577e1.91d539eb-f0d5-45b5-b58c-73c650ec3c4d 1G" returned: 0 in 0.823s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-bc3aaead-45e7-423a-ae4d-a2b33215ce7d tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b9955d4-9ba0-42de-a015-ccf7941577e1 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2b9955d4-9ba0-42de-a015-ccf7941577e1.91d539eb-f0d5-45b5-b58c-73c650ec3c4d {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:21 devstack sudo[105770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b9955d4-9ba0-42de-a015-ccf7941577e1 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2b9955d4-9ba0-42de-a015-ccf7941577e1.91d539eb-f0d5-45b5-b58c-73c650ec3c4d Jul 08 18:59:21 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:22 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-790f7846-28ea-407f-b06f-e4c50221f209 tempest-ProjectMemberTests-704047872 None] Acquiring lock "cinder-ea7d933a-4970-4980-b75e-832425fe38ab-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:59:22 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-790f7846-28ea-407f-b06f-e4c50221f209 tempest-ProjectMemberTests-704047872 None] Lock "cinder-ea7d933a-4970-4980-b75e-832425fe38ab-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:59:22 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-790f7846-28ea-407f-b06f-e4c50221f209 tempest-ProjectMemberTests-704047872 None] Acquiring lock "cinder-quobyte-ea7d933a-4970-4980-b75e-832425fe38ab" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:59:22 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-790f7846-28ea-407f-b06f-e4c50221f209 tempest-ProjectMemberTests-704047872 None] Lock "cinder-quobyte-ea7d933a-4970-4980-b75e-832425fe38ab" acquired by "delete_volume" :: waited 0.018s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:59:22 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f542c80-6359-4a66-8c14-e4044720e1f8]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:59:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-790f7846-28ea-407f-b06f-e4c50221f209 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ea7d933a-4970-4980-b75e-832425fe38ab {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:22 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-bc3aaead-45e7-423a-ae4d-a2b33215ce7d tempest-ProjectReaderTests-422434555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b9955d4-9ba0-42de-a015-ccf7941577e1 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2b9955d4-9ba0-42de-a015-ccf7941577e1.91d539eb-f0d5-45b5-b58c-73c650ec3c4d" returned: 0 in 0.740s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:22 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-bc3aaead-45e7-423a-ae4d-a2b33215ce7d tempest-ProjectReaderTests-422434555 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2b9955d4-9ba0-42de-a015-ccf7941577e1.91d539eb-f0d5-45b5-b58c-73c650ec3c4d is being set with open permissions: ugo+rw Jul 08 18:59:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-bc3aaead-45e7-423a-ae4d-a2b33215ce7d tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2b9955d4-9ba0-42de-a015-ccf7941577e1.91d539eb-f0d5-45b5-b58c-73c650ec3c4d {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:22 devstack sudo[105777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2b9955d4-9ba0-42de-a015-ccf7941577e1.91d539eb-f0d5-45b5-b58c-73c650ec3c4d Jul 08 18:59:22 devstack sudo[105777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:22 devstack sudo[105776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ea7d933a-4970-4980-b75e-832425fe38ab Jul 08 18:59:22 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:22 devstack sudo[105777]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-bc3aaead-45e7-423a-ae4d-a2b33215ce7d tempest-ProjectReaderTests-422434555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2b9955d4-9ba0-42de-a015-ccf7941577e1.91d539eb-f0d5-45b5-b58c-73c650ec3c4d" returned: 0 in 0.688s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-bc3aaead-45e7-423a-ae4d-a2b33215ce7d tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2b9955d4-9ba0-42de-a015-ccf7941577e1.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:22 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-790f7846-28ea-407f-b06f-e4c50221f209 tempest-ProjectMemberTests-704047872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ea7d933a-4970-4980-b75e-832425fe38ab" returned: 0 in 0.770s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-790f7846-28ea-407f-b06f-e4c50221f209 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ea7d933a-4970-4980-b75e-832425fe38ab {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:22 devstack sudo[105785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2b9955d4-9ba0-42de-a015-ccf7941577e1.info Jul 08 18:59:22 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:22 devstack sudo[105786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ea7d933a-4970-4980-b75e-832425fe38ab Jul 08 18:59:22 devstack sudo[105786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:23 devstack sudo[105786]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:23 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-790f7846-28ea-407f-b06f-e4c50221f209 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ea7d933a-4970-4980-b75e-832425fe38ab" returned: 0 in 0.638s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-bc3aaead-45e7-423a-ae4d-a2b33215ce7d tempest-ProjectReaderTests-422434555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2b9955d4-9ba0-42de-a015-ccf7941577e1.info" returned: 0 in 0.655s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:23 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-bc3aaead-45e7-423a-ae4d-a2b33215ce7d tempest-ProjectReaderTests-422434555 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2b9955d4-9ba0-42de-a015-ccf7941577e1.info is being set with open permissions: ugo+rw Jul 08 18:59:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-bc3aaead-45e7-423a-ae4d-a2b33215ce7d tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2b9955d4-9ba0-42de-a015-ccf7941577e1.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:23 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-790f7846-28ea-407f-b06f-e4c50221f209 tempest-ProjectMemberTests-704047872 None] Lock "cinder-quobyte-ea7d933a-4970-4980-b75e-832425fe38ab" released by "delete_volume" :: held 1.478s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:59:23 devstack sudo[105791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2b9955d4-9ba0-42de-a015-ccf7941577e1.info Jul 08 18:59:23 devstack sudo[105791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:23 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-790f7846-28ea-407f-b06f-e4c50221f209 tempest-ProjectMemberTests-704047872 None] Created reservations ['24fc1682-f8d0-4b34-872b-07f63fd351da', 'b2adf851-983e-4080-b6ed-4968a2313c4c', 'fb259c6f-9113-49a7-809f-e044c6d81758', '30dbaa2c-b7dc-4257-9628-9aaf39f11680'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:59:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-790f7846-28ea-407f-b06f-e4c50221f209 tempest-ProjectMemberTests-704047872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:59:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-790f7846-28ea-407f-b06f-e4c50221f209 tempest-ProjectMemberTests-704047872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:59:23 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-790f7846-28ea-407f-b06f-e4c50221f209 tempest-ProjectMemberTests-704047872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:59:23 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-790f7846-28ea-407f-b06f-e4c50221f209 tempest-ProjectMemberTests-704047872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:59:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-790f7846-28ea-407f-b06f-e4c50221f209 tempest-ProjectMemberTests-704047872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:59:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-790f7846-28ea-407f-b06f-e4c50221f209 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:23 devstack sudo[105793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:59:23 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:24 devstack sudo[105791]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-bc3aaead-45e7-423a-ae4d-a2b33215ce7d tempest-ProjectReaderTests-422434555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2b9955d4-9ba0-42de-a015-ccf7941577e1.info" returned: 0 in 0.696s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-bc3aaead-45e7-423a-ae4d-a2b33215ce7d tempest-ProjectReaderTests-422434555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.491s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:59:24 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-bc3aaead-45e7-423a-ae4d-a2b33215ce7d tempest-ProjectReaderTests-422434555 None] Create snapshot completed successfully Jul 08 18:59:24 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-790f7846-28ea-407f-b06f-e4c50221f209 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.664s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:24 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-790f7846-28ea-407f-b06f-e4c50221f209 tempest-ProjectMemberTests-704047872 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:59:24 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-790f7846-28ea-407f-b06f-e4c50221f209 tempest-ProjectMemberTests-704047872 None] Deleted volume successfully. Jul 08 18:59:24 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-790f7846-28ea-407f-b06f-e4c50221f209 tempest-ProjectMemberTests-704047872 None] Lock "cinder-ea7d933a-4970-4980-b75e-832425fe38ab-delete_volume" released by "delete_volume" :: held 2.351s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:59:24 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-e37d0781-4241-4928-a80e-400ae0814a10 tempest-ProjectMemberTests-704047872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:59:24 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e37d0781-4241-4928-a80e-400ae0814a10 tempest-ProjectMemberTests-704047872 None] Flow 'volume_create_manager' (3ec963a4-f6cf-4882-a4fe-4da23ba19f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:59:24 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e37d0781-4241-4928-a80e-400ae0814a10 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68c71ef8-5a0e-48d2-8575-1f5ced3ea17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:59:24 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e37d0781-4241-4928-a80e-400ae0814a10 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68c71ef8-5a0e-48d2-8575-1f5ced3ea17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:59:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1766799512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7bf217d-b529-4dfe-bfd3-6ece3138dd80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23f6feda0dc341ae9dff1be67ef4c54c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:59:25Z,use_quota=True,user_id='ebff52e9980446ed8de939cd8116db5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:59:24 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e37d0781-4241-4928-a80e-400ae0814a10 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91d608d3-05ce-4ab8-b10c-361b9a3ffbf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:59:24 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e37d0781-4241-4928-a80e-400ae0814a10 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91d608d3-05ce-4ab8-b10c-361b9a3ffbf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:59:24 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e37d0781-4241-4928-a80e-400ae0814a10 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9795f60d-2572-4e95-a828-07a9823d6f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:59:24 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e37d0781-4241-4928-a80e-400ae0814a10 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9795f60d-2572-4e95-a828-07a9823d6f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7bf217d-b529-4dfe-bfd3-6ece3138dd80', 'volume_name': 'volume-d7bf217d-b529-4dfe-bfd3-6ece3138dd80', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:59:24 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e37d0781-4241-4928-a80e-400ae0814a10 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8647211-8fde-4393-a67a-74178a1e95fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:59:24 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e37d0781-4241-4928-a80e-400ae0814a10 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8647211-8fde-4393-a67a-74178a1e95fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:59:24 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e37d0781-4241-4928-a80e-400ae0814a10 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20f47907-2465-4f1c-8576-a3c32b00500d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:59:24 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-e37d0781-4241-4928-a80e-400ae0814a10 tempest-ProjectMemberTests-704047872 None] Volume d7bf217d-b529-4dfe-bfd3-6ece3138dd80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7bf217d-b529-4dfe-bfd3-6ece3138dd80', 'volume_size': 1} Jul 08 18:59:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-e37d0781-4241-4928-a80e-400ae0814a10 tempest-ProjectMemberTests-704047872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:59:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-e37d0781-4241-4928-a80e-400ae0814a10 tempest-ProjectMemberTests-704047872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:59:24 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-e37d0781-4241-4928-a80e-400ae0814a10 tempest-ProjectMemberTests-704047872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:59:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1766799512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7bf217d-b529-4dfe-bfd3-6ece3138dd80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23f6feda0dc341ae9dff1be67ef4c54c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:59:25Z,use_quota=True,user_id='ebff52e9980446ed8de939cd8116db5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:59:24 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-e37d0781-4241-4928-a80e-400ae0814a10 tempest-ProjectMemberTests-704047872 None] Creating volume d7bf217d-b529-4dfe-bfd3-6ece3138dd80 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:59:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-e37d0781-4241-4928-a80e-400ae0814a10 tempest-ProjectMemberTests-704047872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:59:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-e37d0781-4241-4928-a80e-400ae0814a10 tempest-ProjectMemberTests-704047872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:59:24 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-e37d0781-4241-4928-a80e-400ae0814a10 tempest-ProjectMemberTests-704047872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:59:24 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-e37d0781-4241-4928-a80e-400ae0814a10 tempest-ProjectMemberTests-704047872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:59:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-e37d0781-4241-4928-a80e-400ae0814a10 tempest-ProjectMemberTests-704047872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:59:24 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-e37d0781-4241-4928-a80e-400ae0814a10 tempest-ProjectMemberTests-704047872 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:59:24 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-e37d0781-4241-4928-a80e-400ae0814a10 tempest-ProjectMemberTests-704047872 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:59:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e37d0781-4241-4928-a80e-400ae0814a10 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d7bf217d-b529-4dfe-bfd3-6ece3138dd80 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:24 devstack sudo[105797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d7bf217d-b529-4dfe-bfd3-6ece3138dd80 1073741824 Jul 08 18:59:24 devstack sudo[105797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:25 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-e0461a5a-7589-41be-8f20-21294e85afea tempest-ProjectReaderTests-422434555 None] Acquiring lock "cinder-91d539eb-f0d5-45b5-b58c-73c650ec3c4d-delete_snapshot" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:59:25 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-e0461a5a-7589-41be-8f20-21294e85afea tempest-ProjectReaderTests-422434555 None] Lock "cinder-91d539eb-f0d5-45b5-b58c-73c650ec3c4d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:59:25 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-e0461a5a-7589-41be-8f20-21294e85afea tempest-ProjectReaderTests-422434555 None] Acquiring lock "cinder-quobyte-2b9955d4-9ba0-42de-a015-ccf7941577e1" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:59:25 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-e0461a5a-7589-41be-8f20-21294e85afea tempest-ProjectReaderTests-422434555 None] Lock "cinder-quobyte-2b9955d4-9ba0-42de-a015-ccf7941577e1" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:59:25 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-e0461a5a-7589-41be-8f20-21294e85afea tempest-ProjectReaderTests-422434555 None] Acquiring lock "cinder-quobyte-91d539eb-f0d5-45b5-b58c-73c650ec3c4d" by "_delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:59:25 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-e0461a5a-7589-41be-8f20-21294e85afea tempest-ProjectReaderTests-422434555 None] Lock "cinder-quobyte-91d539eb-f0d5-45b5-b58c-73c650ec3c4d" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:59:25 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-e0461a5a-7589-41be-8f20-21294e85afea tempest-ProjectReaderTests-422434555 None] Deleting offline snapshot 91d539eb-f0d5-45b5-b58c-73c650ec3c4d of volume 2b9955d4-9ba0-42de-a015-ccf7941577e1 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:59:25 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-e0461a5a-7589-41be-8f20-21294e85afea tempest-ProjectReaderTests-422434555 None] snapshot_file for this snap is: volume-2b9955d4-9ba0-42de-a015-ccf7941577e1.91d539eb-f0d5-45b5-b58c-73c650ec3c4d {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:59:25 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[198fb1d9-1640-4d9f-9c86-6b4209170fa5]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:59:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e0461a5a-7589-41be-8f20-21294e85afea tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2b9955d4-9ba0-42de-a015-ccf7941577e1.91d539eb-f0d5-45b5-b58c-73c650ec3c4d {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:25 devstack sudo[105799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2b9955d4-9ba0-42de-a015-ccf7941577e1.91d539eb-f0d5-45b5-b58c-73c650ec3c4d Jul 08 18:59:25 devstack sudo[105799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:25 devstack sudo[105797]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e37d0781-4241-4928-a80e-400ae0814a10 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d7bf217d-b529-4dfe-bfd3-6ece3138dd80 1073741824" returned: 0 in 0.845s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e37d0781-4241-4928-a80e-400ae0814a10 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d7bf217d-b529-4dfe-bfd3-6ece3138dd80 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:25 devstack sudo[105804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d7bf217d-b529-4dfe-bfd3-6ece3138dd80 Jul 08 18:59:25 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:25 devstack sudo[105799]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e0461a5a-7589-41be-8f20-21294e85afea tempest-ProjectReaderTests-422434555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2b9955d4-9ba0-42de-a015-ccf7941577e1.91d539eb-f0d5-45b5-b58c-73c650ec3c4d" returned: 0 in 0.818s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:25 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-e0461a5a-7589-41be-8f20-21294e85afea tempest-ProjectReaderTests-422434555 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b9955d4-9ba0-42de-a015-ccf7941577e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:59:26 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[a696d6f0-262c-46aa-a2f4-4a83f3352d08]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:59:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e0461a5a-7589-41be-8f20-21294e85afea tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2b9955d4-9ba0-42de-a015-ccf7941577e1 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:26 devstack sudo[105809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2b9955d4-9ba0-42de-a015-ccf7941577e1 Jul 08 18:59:26 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:26 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e37d0781-4241-4928-a80e-400ae0814a10 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d7bf217d-b529-4dfe-bfd3-6ece3138dd80" returned: 0 in 0.690s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:26 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-e37d0781-4241-4928-a80e-400ae0814a10 tempest-ProjectMemberTests-704047872 None] <== create_volume: return (1583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:59:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-e37d0781-4241-4928-a80e-400ae0814a10 tempest-ProjectMemberTests-704047872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.586s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:59:26 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e37d0781-4241-4928-a80e-400ae0814a10 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20f47907-2465-4f1c-8576-a3c32b00500d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7bf217d-b529-4dfe-bfd3-6ece3138dd80', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:59:26 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e37d0781-4241-4928-a80e-400ae0814a10 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c205c671-10b2-4448-af2d-f9dab7e1366b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:59:26 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-e37d0781-4241-4928-a80e-400ae0814a10 tempest-ProjectMemberTests-704047872 None] Volume volume-d7bf217d-b529-4dfe-bfd3-6ece3138dd80 (d7bf217d-b529-4dfe-bfd3-6ece3138dd80): created successfully Jul 08 18:59:26 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e37d0781-4241-4928-a80e-400ae0814a10 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c205c671-10b2-4448-af2d-f9dab7e1366b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:59:26 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-e37d0781-4241-4928-a80e-400ae0814a10 tempest-ProjectMemberTests-704047872 None] Flow 'volume_create_manager' (3ec963a4-f6cf-4882-a4fe-4da23ba19f04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:59:26 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-e37d0781-4241-4928-a80e-400ae0814a10 tempest-ProjectMemberTests-704047872 None] Created volume successfully. Jul 08 18:59:26 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e0461a5a-7589-41be-8f20-21294e85afea tempest-ProjectReaderTests-422434555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2b9955d4-9ba0-42de-a015-ccf7941577e1" returned: 0 in 0.793s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e0461a5a-7589-41be-8f20-21294e85afea tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2b9955d4-9ba0-42de-a015-ccf7941577e1.91d539eb-f0d5-45b5-b58c-73c650ec3c4d {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:26 devstack sudo[105815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2b9955d4-9ba0-42de-a015-ccf7941577e1.91d539eb-f0d5-45b5-b58c-73c650ec3c4d Jul 08 18:59:26 devstack sudo[105815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-fb541098-fc3f-4b0c-bd1e-f83e0a756797 tempest-ProjectMemberTests-704047872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:59:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-fb541098-fc3f-4b0c-bd1e-f83e0a756797 tempest-ProjectMemberTests-704047872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:59:27 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-fb541098-fc3f-4b0c-bd1e-f83e0a756797 tempest-ProjectMemberTests-704047872 None] Creating offline snapshot 61467688-3615-4c1f-9324-48df566cfafe of volume d7bf217d-b529-4dfe-bfd3-6ece3138dd80 {{(pid=86873) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:59:27 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3b94a5-dc1d-4af9-89c0-e54d50a610ab]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:59:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-fb541098-fc3f-4b0c-bd1e-f83e0a756797 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d7bf217d-b529-4dfe-bfd3-6ece3138dd80 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:27 devstack sudo[105817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d7bf217d-b529-4dfe-bfd3-6ece3138dd80 Jul 08 18:59:27 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:27 devstack sudo[105815]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e0461a5a-7589-41be-8f20-21294e85afea tempest-ProjectReaderTests-422434555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2b9955d4-9ba0-42de-a015-ccf7941577e1.91d539eb-f0d5-45b5-b58c-73c650ec3c4d" returned: 0 in 0.776s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e0461a5a-7589-41be-8f20-21294e85afea tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2b9955d4-9ba0-42de-a015-ccf7941577e1.91d539eb-f0d5-45b5-b58c-73c650ec3c4d {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:27 devstack sudo[105822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2b9955d4-9ba0-42de-a015-ccf7941577e1.91d539eb-f0d5-45b5-b58c-73c650ec3c4d Jul 08 18:59:27 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:27 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-fb541098-fc3f-4b0c-bd1e-f83e0a756797 tempest-ProjectMemberTests-704047872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d7bf217d-b529-4dfe-bfd3-6ece3138dd80" returned: 0 in 0.773s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-fb541098-fc3f-4b0c-bd1e-f83e0a756797 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d7bf217d-b529-4dfe-bfd3-6ece3138dd80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d7bf217d-b529-4dfe-bfd3-6ece3138dd80.61467688-3615-4c1f-9324-48df566cfafe 1G {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:27 devstack sudo[105827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d7bf217d-b529-4dfe-bfd3-6ece3138dd80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d7bf217d-b529-4dfe-bfd3-6ece3138dd80.61467688-3615-4c1f-9324-48df566cfafe 1G Jul 08 18:59:27 devstack sudo[105827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:28 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-e0461a5a-7589-41be-8f20-21294e85afea tempest-ProjectReaderTests-422434555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2b9955d4-9ba0-42de-a015-ccf7941577e1.91d539eb-f0d5-45b5-b58c-73c650ec3c4d" returned: 0 in 0.666s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:28 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-e0461a5a-7589-41be-8f20-21294e85afea tempest-ProjectReaderTests-422434555 None] Lock "cinder-quobyte-91d539eb-f0d5-45b5-b58c-73c650ec3c4d" released by "_delete_snapshot" :: held 3.152s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:59:28 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-e0461a5a-7589-41be-8f20-21294e85afea tempest-ProjectReaderTests-422434555 None] Lock "cinder-quobyte-2b9955d4-9ba0-42de-a015-ccf7941577e1" released by "delete_snapshot" :: held 3.174s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:59:28 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-e0461a5a-7589-41be-8f20-21294e85afea tempest-ProjectReaderTests-422434555 None] Created reservations ['110236fc-acb3-42d0-8cf7-25bd8c33a8f4', '0327cfd4-ea34-4480-9700-5be8c9ed414f', '4802c0b6-110f-42b5-aa22-cb2cfc8f3273', '4be9f247-f0d0-4971-b396-8836f1271055'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:59:28 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-e0461a5a-7589-41be-8f20-21294e85afea tempest-ProjectReaderTests-422434555 None] Delete snapshot completed successfully. Jul 08 18:59:28 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-e0461a5a-7589-41be-8f20-21294e85afea tempest-ProjectReaderTests-422434555 None] Lock "cinder-91d539eb-f0d5-45b5-b58c-73c650ec3c4d-delete_snapshot" released by "delete_snapshot" :: held 3.328s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:59:28 devstack sudo[105827]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-fb541098-fc3f-4b0c-bd1e-f83e0a756797 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d7bf217d-b529-4dfe-bfd3-6ece3138dd80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d7bf217d-b529-4dfe-bfd3-6ece3138dd80.61467688-3615-4c1f-9324-48df566cfafe 1G" returned: 0 in 0.823s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-fb541098-fc3f-4b0c-bd1e-f83e0a756797 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7bf217d-b529-4dfe-bfd3-6ece3138dd80 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d7bf217d-b529-4dfe-bfd3-6ece3138dd80.61467688-3615-4c1f-9324-48df566cfafe {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:28 devstack sudo[105834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7bf217d-b529-4dfe-bfd3-6ece3138dd80 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d7bf217d-b529-4dfe-bfd3-6ece3138dd80.61467688-3615-4c1f-9324-48df566cfafe Jul 08 18:59:28 devstack sudo[105834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:29 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9c013a55-0c40-4d00-a9b9-aeab5f94ef92 tempest-ProjectReaderTests-422434555 None] Acquiring lock "cinder-2b9955d4-9ba0-42de-a015-ccf7941577e1-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:59:29 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9c013a55-0c40-4d00-a9b9-aeab5f94ef92 tempest-ProjectReaderTests-422434555 None] Lock "cinder-2b9955d4-9ba0-42de-a015-ccf7941577e1-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:59:29 devstack sudo[105834]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-fb541098-fc3f-4b0c-bd1e-f83e0a756797 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7bf217d-b529-4dfe-bfd3-6ece3138dd80 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d7bf217d-b529-4dfe-bfd3-6ece3138dd80.61467688-3615-4c1f-9324-48df566cfafe" returned: 0 in 0.697s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:29 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-fb541098-fc3f-4b0c-bd1e-f83e0a756797 tempest-ProjectMemberTests-704047872 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d7bf217d-b529-4dfe-bfd3-6ece3138dd80.61467688-3615-4c1f-9324-48df566cfafe is being set with open permissions: ugo+rw Jul 08 18:59:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-fb541098-fc3f-4b0c-bd1e-f83e0a756797 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d7bf217d-b529-4dfe-bfd3-6ece3138dd80.61467688-3615-4c1f-9324-48df566cfafe {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:29 devstack sudo[105839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d7bf217d-b529-4dfe-bfd3-6ece3138dd80.61467688-3615-4c1f-9324-48df566cfafe Jul 08 18:59:29 devstack sudo[105839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:29 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9c013a55-0c40-4d00-a9b9-aeab5f94ef92 tempest-ProjectReaderTests-422434555 None] Acquiring lock "cinder-quobyte-2b9955d4-9ba0-42de-a015-ccf7941577e1" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:59:29 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9c013a55-0c40-4d00-a9b9-aeab5f94ef92 tempest-ProjectReaderTests-422434555 None] Lock "cinder-quobyte-2b9955d4-9ba0-42de-a015-ccf7941577e1" acquired by "delete_volume" :: waited 0.017s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:59:29 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a034bc-0d7b-4a1a-b13c-c76d14ec9e93]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:59:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9c013a55-0c40-4d00-a9b9-aeab5f94ef92 tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2b9955d4-9ba0-42de-a015-ccf7941577e1 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:29 devstack sudo[105841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2b9955d4-9ba0-42de-a015-ccf7941577e1 Jul 08 18:59:29 devstack sudo[105841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:30 devstack sudo[105839]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-fb541098-fc3f-4b0c-bd1e-f83e0a756797 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d7bf217d-b529-4dfe-bfd3-6ece3138dd80.61467688-3615-4c1f-9324-48df566cfafe" returned: 0 in 0.697s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-fb541098-fc3f-4b0c-bd1e-f83e0a756797 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d7bf217d-b529-4dfe-bfd3-6ece3138dd80.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:30 devstack sudo[105846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d7bf217d-b529-4dfe-bfd3-6ece3138dd80.info Jul 08 18:59:30 devstack sudo[105846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:30 devstack sudo[105841]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9c013a55-0c40-4d00-a9b9-aeab5f94ef92 tempest-ProjectReaderTests-422434555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2b9955d4-9ba0-42de-a015-ccf7941577e1" returned: 0 in 0.772s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9c013a55-0c40-4d00-a9b9-aeab5f94ef92 tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2b9955d4-9ba0-42de-a015-ccf7941577e1 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:30 devstack sudo[105849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2b9955d4-9ba0-42de-a015-ccf7941577e1 Jul 08 18:59:30 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:30 devstack sudo[105846]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-fb541098-fc3f-4b0c-bd1e-f83e0a756797 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d7bf217d-b529-4dfe-bfd3-6ece3138dd80.info" returned: 0 in 0.685s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:30 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-fb541098-fc3f-4b0c-bd1e-f83e0a756797 tempest-ProjectMemberTests-704047872 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d7bf217d-b529-4dfe-bfd3-6ece3138dd80.info is being set with open permissions: ugo+rw Jul 08 18:59:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-fb541098-fc3f-4b0c-bd1e-f83e0a756797 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d7bf217d-b529-4dfe-bfd3-6ece3138dd80.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:30 devstack sudo[105853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d7bf217d-b529-4dfe-bfd3-6ece3138dd80.info Jul 08 18:59:30 devstack sudo[105853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:30 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9c013a55-0c40-4d00-a9b9-aeab5f94ef92 tempest-ProjectReaderTests-422434555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-2b9955d4-9ba0-42de-a015-ccf7941577e1" returned: 0 in 0.675s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:30 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9c013a55-0c40-4d00-a9b9-aeab5f94ef92 tempest-ProjectReaderTests-422434555 None] Lock "cinder-quobyte-2b9955d4-9ba0-42de-a015-ccf7941577e1" released by "delete_volume" :: held 1.515s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:59:30 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-9c013a55-0c40-4d00-a9b9-aeab5f94ef92 tempest-ProjectReaderTests-422434555 None] Created reservations ['5529b703-e165-4ba0-b997-ad91e9a6b108', 'a9ac3cdb-57d9-476f-ad66-6e6abbf4e116', 'bf3ac48f-392d-4a5a-8fd4-42ea12d3a5db', '534a84bf-9715-4abf-b954-36a045e7dbb4'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:59:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-9c013a55-0c40-4d00-a9b9-aeab5f94ef92 tempest-ProjectReaderTests-422434555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:59:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-9c013a55-0c40-4d00-a9b9-aeab5f94ef92 tempest-ProjectReaderTests-422434555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:59:31 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-9c013a55-0c40-4d00-a9b9-aeab5f94ef92 tempest-ProjectReaderTests-422434555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:59:31 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-9c013a55-0c40-4d00-a9b9-aeab5f94ef92 tempest-ProjectReaderTests-422434555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:59:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-9c013a55-0c40-4d00-a9b9-aeab5f94ef92 tempest-ProjectReaderTests-422434555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:59:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9c013a55-0c40-4d00-a9b9-aeab5f94ef92 tempest-ProjectReaderTests-422434555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:31 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:59:31 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:31 devstack sudo[105853]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-fb541098-fc3f-4b0c-bd1e-f83e0a756797 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d7bf217d-b529-4dfe-bfd3-6ece3138dd80.info" returned: 0 in 0.693s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-fb541098-fc3f-4b0c-bd1e-f83e0a756797 tempest-ProjectMemberTests-704047872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.473s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:59:31 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-fb541098-fc3f-4b0c-bd1e-f83e0a756797 tempest-ProjectMemberTests-704047872 None] Create snapshot completed successfully Jul 08 18:59:31 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:31 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-9c013a55-0c40-4d00-a9b9-aeab5f94ef92 tempest-ProjectReaderTests-422434555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.695s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:31 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-9c013a55-0c40-4d00-a9b9-aeab5f94ef92 tempest-ProjectReaderTests-422434555 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:59:31 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-9c013a55-0c40-4d00-a9b9-aeab5f94ef92 tempest-ProjectReaderTests-422434555 None] Deleted volume successfully. Jul 08 18:59:31 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-9c013a55-0c40-4d00-a9b9-aeab5f94ef92 tempest-ProjectReaderTests-422434555 None] Lock "cinder-2b9955d4-9ba0-42de-a015-ccf7941577e1-delete_volume" released by "delete_volume" :: held 2.438s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:59:32 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-afc89477-d3d5-4aca-b361-5f92f147b6be tempest-ProjectMemberTests-704047872 None] Acquiring lock "cinder-61467688-3615-4c1f-9324-48df566cfafe-delete_snapshot" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:59:32 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-afc89477-d3d5-4aca-b361-5f92f147b6be tempest-ProjectMemberTests-704047872 None] Lock "cinder-61467688-3615-4c1f-9324-48df566cfafe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:59:32 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-afc89477-d3d5-4aca-b361-5f92f147b6be tempest-ProjectMemberTests-704047872 None] Acquiring lock "cinder-quobyte-d7bf217d-b529-4dfe-bfd3-6ece3138dd80" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:59:32 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-afc89477-d3d5-4aca-b361-5f92f147b6be tempest-ProjectMemberTests-704047872 None] Lock "cinder-quobyte-d7bf217d-b529-4dfe-bfd3-6ece3138dd80" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:59:32 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-afc89477-d3d5-4aca-b361-5f92f147b6be tempest-ProjectMemberTests-704047872 None] Acquiring lock "cinder-quobyte-61467688-3615-4c1f-9324-48df566cfafe" by "_delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:59:32 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-afc89477-d3d5-4aca-b361-5f92f147b6be tempest-ProjectMemberTests-704047872 None] Lock "cinder-quobyte-61467688-3615-4c1f-9324-48df566cfafe" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:59:32 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-afc89477-d3d5-4aca-b361-5f92f147b6be tempest-ProjectMemberTests-704047872 None] Deleting offline snapshot 61467688-3615-4c1f-9324-48df566cfafe of volume d7bf217d-b529-4dfe-bfd3-6ece3138dd80 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:59:32 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-afc89477-d3d5-4aca-b361-5f92f147b6be tempest-ProjectMemberTests-704047872 None] snapshot_file for this snap is: volume-d7bf217d-b529-4dfe-bfd3-6ece3138dd80.61467688-3615-4c1f-9324-48df566cfafe {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:59:32 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2060e0-9a7e-4a95-af3d-376423506014]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:59:32 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-afc89477-d3d5-4aca-b361-5f92f147b6be tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d7bf217d-b529-4dfe-bfd3-6ece3138dd80.61467688-3615-4c1f-9324-48df566cfafe {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:32 devstack sudo[105859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d7bf217d-b529-4dfe-bfd3-6ece3138dd80.61467688-3615-4c1f-9324-48df566cfafe Jul 08 18:59:32 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:33 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-afc89477-d3d5-4aca-b361-5f92f147b6be tempest-ProjectMemberTests-704047872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d7bf217d-b529-4dfe-bfd3-6ece3138dd80.61467688-3615-4c1f-9324-48df566cfafe" returned: 0 in 0.838s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:33 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-afc89477-d3d5-4aca-b361-5f92f147b6be tempest-ProjectMemberTests-704047872 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7bf217d-b529-4dfe-bfd3-6ece3138dd80(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:59:33 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a164a5a-8951-4b89-a8c7-36816a7eeee0]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:59:33 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-afc89477-d3d5-4aca-b361-5f92f147b6be tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d7bf217d-b529-4dfe-bfd3-6ece3138dd80 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:33 devstack sudo[105866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d7bf217d-b529-4dfe-bfd3-6ece3138dd80 Jul 08 18:59:33 devstack sudo[105866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:34 devstack sudo[105866]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-afc89477-d3d5-4aca-b361-5f92f147b6be tempest-ProjectMemberTests-704047872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d7bf217d-b529-4dfe-bfd3-6ece3138dd80" returned: 0 in 0.816s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-afc89477-d3d5-4aca-b361-5f92f147b6be tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d7bf217d-b529-4dfe-bfd3-6ece3138dd80.61467688-3615-4c1f-9324-48df566cfafe {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:34 devstack sudo[105871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d7bf217d-b529-4dfe-bfd3-6ece3138dd80.61467688-3615-4c1f-9324-48df566cfafe Jul 08 18:59:34 devstack sudo[105871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:34 devstack sudo[105871]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-afc89477-d3d5-4aca-b361-5f92f147b6be tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d7bf217d-b529-4dfe-bfd3-6ece3138dd80.61467688-3615-4c1f-9324-48df566cfafe" returned: 0 in 0.748s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:34 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-afc89477-d3d5-4aca-b361-5f92f147b6be tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d7bf217d-b529-4dfe-bfd3-6ece3138dd80.61467688-3615-4c1f-9324-48df566cfafe {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:34 devstack sudo[105876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d7bf217d-b529-4dfe-bfd3-6ece3138dd80.61467688-3615-4c1f-9324-48df566cfafe Jul 08 18:59:34 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:35 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:35 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-afc89477-d3d5-4aca-b361-5f92f147b6be tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d7bf217d-b529-4dfe-bfd3-6ece3138dd80.61467688-3615-4c1f-9324-48df566cfafe" returned: 0 in 0.706s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:35 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-afc89477-d3d5-4aca-b361-5f92f147b6be tempest-ProjectMemberTests-704047872 None] Lock "cinder-quobyte-61467688-3615-4c1f-9324-48df566cfafe" released by "_delete_snapshot" :: held 3.205s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:59:35 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-afc89477-d3d5-4aca-b361-5f92f147b6be tempest-ProjectMemberTests-704047872 None] Lock "cinder-quobyte-d7bf217d-b529-4dfe-bfd3-6ece3138dd80" released by "delete_snapshot" :: held 3.228s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:59:35 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:UPDATE=161,cinder:SELECT=116,cinder:INSERT=38,cinder:DELETE=12 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:59:35 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:UPDATE=142,cinder:DELETE=13,cinder:SELECT=116,cinder:INSERT=46 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:59:35 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-afc89477-d3d5-4aca-b361-5f92f147b6be tempest-ProjectMemberTests-704047872 None] Created reservations ['daeb8372-03d6-4253-9988-4d299480ffe3', '8e8463b8-208a-4d2c-9525-0ff1acdb0cf9', '6a94c9ef-01fe-4c77-b85a-5fd0f58f1411', 'b1574c1e-f6df-4ab8-8982-aa4485d28a83'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:59:35 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-afc89477-d3d5-4aca-b361-5f92f147b6be tempest-ProjectMemberTests-704047872 None] Delete snapshot completed successfully. Jul 08 18:59:35 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-afc89477-d3d5-4aca-b361-5f92f147b6be tempest-ProjectMemberTests-704047872 None] Lock "cinder-61467688-3615-4c1f-9324-48df566cfafe-delete_snapshot" released by "delete_snapshot" :: held 3.360s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:59:36 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b839bc54-be66-4315-8645-9bc8b0f4c919 tempest-ProjectMemberTests-704047872 None] Acquiring lock "cinder-d7bf217d-b529-4dfe-bfd3-6ece3138dd80-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:59:36 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b839bc54-be66-4315-8645-9bc8b0f4c919 tempest-ProjectMemberTests-704047872 None] Lock "cinder-d7bf217d-b529-4dfe-bfd3-6ece3138dd80-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:59:36 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b839bc54-be66-4315-8645-9bc8b0f4c919 tempest-ProjectMemberTests-704047872 None] Acquiring lock "cinder-quobyte-d7bf217d-b529-4dfe-bfd3-6ece3138dd80" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:59:36 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b839bc54-be66-4315-8645-9bc8b0f4c919 tempest-ProjectMemberTests-704047872 None] Lock "cinder-quobyte-d7bf217d-b529-4dfe-bfd3-6ece3138dd80" acquired by "delete_volume" :: waited 0.019s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:59:36 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[eadcd46a-a7e3-4ca4-b761-24279150e725]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:59:36 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b839bc54-be66-4315-8645-9bc8b0f4c919 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d7bf217d-b529-4dfe-bfd3-6ece3138dd80 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:36 devstack sudo[105879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d7bf217d-b529-4dfe-bfd3-6ece3138dd80 Jul 08 18:59:36 devstack sudo[105879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:37 devstack sudo[105879]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b839bc54-be66-4315-8645-9bc8b0f4c919 tempest-ProjectMemberTests-704047872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d7bf217d-b529-4dfe-bfd3-6ece3138dd80" returned: 0 in 0.784s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:37 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b839bc54-be66-4315-8645-9bc8b0f4c919 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d7bf217d-b529-4dfe-bfd3-6ece3138dd80 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:37 devstack sudo[105884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d7bf217d-b529-4dfe-bfd3-6ece3138dd80 Jul 08 18:59:37 devstack sudo[105884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:38 devstack sudo[105884]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:38 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b839bc54-be66-4315-8645-9bc8b0f4c919 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-d7bf217d-b529-4dfe-bfd3-6ece3138dd80" returned: 0 in 0.635s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:38 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b839bc54-be66-4315-8645-9bc8b0f4c919 tempest-ProjectMemberTests-704047872 None] Lock "cinder-quobyte-d7bf217d-b529-4dfe-bfd3-6ece3138dd80" released by "delete_volume" :: held 1.480s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:59:38 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-b839bc54-be66-4315-8645-9bc8b0f4c919 tempest-ProjectMemberTests-704047872 None] Created reservations ['b336df89-e2ee-4e68-9de5-999ffcc40c0b', 'cc0b9694-041d-41d7-8d16-88a521ca31e0', '27f1987c-2d77-4196-ac44-c244d9a74d77', '6b34eb66-42d6-459d-8e59-b6be369ef631'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:59:38 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b839bc54-be66-4315-8645-9bc8b0f4c919 tempest-ProjectMemberTests-704047872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:59:38 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b839bc54-be66-4315-8645-9bc8b0f4c919 tempest-ProjectMemberTests-704047872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:59:38 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b839bc54-be66-4315-8645-9bc8b0f4c919 tempest-ProjectMemberTests-704047872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:59:38 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-b839bc54-be66-4315-8645-9bc8b0f4c919 tempest-ProjectMemberTests-704047872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:59:38 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-b839bc54-be66-4315-8645-9bc8b0f4c919 tempest-ProjectMemberTests-704047872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:59:38 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b839bc54-be66-4315-8645-9bc8b0f4c919 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:38 devstack sudo[105887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:59:38 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:38 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:38 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-b839bc54-be66-4315-8645-9bc8b0f4c919 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.712s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:38 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-b839bc54-be66-4315-8645-9bc8b0f4c919 tempest-ProjectMemberTests-704047872 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:59:38 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-b839bc54-be66-4315-8645-9bc8b0f4c919 tempest-ProjectMemberTests-704047872 None] Deleted volume successfully. Jul 08 18:59:38 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-b839bc54-be66-4315-8645-9bc8b0f4c919 tempest-ProjectMemberTests-704047872 None] Lock "cinder-d7bf217d-b529-4dfe-bfd3-6ece3138dd80-delete_volume" released by "delete_volume" :: held 2.396s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:59:39 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fad53f8-f90f-4bf0-b718-840d3d4eec87 tempest-ProjectMemberTests-704047872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:59:39 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-4fad53f8-f90f-4bf0-b718-840d3d4eec87 tempest-ProjectMemberTests-704047872 None] Flow 'volume_create_manager' (50532545-7534-4bf3-a05e-d62ee626f699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:59:39 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-4fad53f8-f90f-4bf0-b718-840d3d4eec87 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a383540-981f-493d-a814-fe4d8e70d4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:59:39 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-4fad53f8-f90f-4bf0-b718-840d3d4eec87 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a383540-981f-493d-a814-fe4d8e70d4aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:59:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1360472162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de0105fd-05e7-49e4-a42b-f63ce5095da3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23f6feda0dc341ae9dff1be67ef4c54c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:59:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:59:39Z,use_quota=True,user_id='ebff52e9980446ed8de939cd8116db5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:59:39 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-4fad53f8-f90f-4bf0-b718-840d3d4eec87 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdd30ebc-f81c-4aa3-802f-94f3aa0cf298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:59:39 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-4fad53f8-f90f-4bf0-b718-840d3d4eec87 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdd30ebc-f81c-4aa3-802f-94f3aa0cf298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:59:39 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-4fad53f8-f90f-4bf0-b718-840d3d4eec87 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de56e723-8d27-49de-a274-9a2d6630f4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:59:39 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-4fad53f8-f90f-4bf0-b718-840d3d4eec87 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de56e723-8d27-49de-a274-9a2d6630f4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de0105fd-05e7-49e4-a42b-f63ce5095da3', 'volume_name': 'volume-de0105fd-05e7-49e4-a42b-f63ce5095da3', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:59:39 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-4fad53f8-f90f-4bf0-b718-840d3d4eec87 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52c9be71-fa16-43cb-8e10-bc2bca0323e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:59:39 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-4fad53f8-f90f-4bf0-b718-840d3d4eec87 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52c9be71-fa16-43cb-8e10-bc2bca0323e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:59:39 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-4fad53f8-f90f-4bf0-b718-840d3d4eec87 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (338467e7-f577-4d65-bdda-9a78090d69fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:59:39 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-4fad53f8-f90f-4bf0-b718-840d3d4eec87 tempest-ProjectMemberTests-704047872 None] Volume de0105fd-05e7-49e4-a42b-f63ce5095da3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de0105fd-05e7-49e4-a42b-f63ce5095da3', 'volume_size': 1} Jul 08 18:59:39 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-4fad53f8-f90f-4bf0-b718-840d3d4eec87 tempest-ProjectMemberTests-704047872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:59:39 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-4fad53f8-f90f-4bf0-b718-840d3d4eec87 tempest-ProjectMemberTests-704047872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:59:39 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-4fad53f8-f90f-4bf0-b718-840d3d4eec87 tempest-ProjectMemberTests-704047872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:59:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1360472162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de0105fd-05e7-49e4-a42b-f63ce5095da3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23f6feda0dc341ae9dff1be67ef4c54c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:59:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:59:39Z,use_quota=True,user_id='ebff52e9980446ed8de939cd8116db5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:59:39 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-4fad53f8-f90f-4bf0-b718-840d3d4eec87 tempest-ProjectMemberTests-704047872 None] Creating volume de0105fd-05e7-49e4-a42b-f63ce5095da3 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:59:39 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-4fad53f8-f90f-4bf0-b718-840d3d4eec87 tempest-ProjectMemberTests-704047872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:59:39 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-4fad53f8-f90f-4bf0-b718-840d3d4eec87 tempest-ProjectMemberTests-704047872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:59:39 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-4fad53f8-f90f-4bf0-b718-840d3d4eec87 tempest-ProjectMemberTests-704047872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:59:39 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-4fad53f8-f90f-4bf0-b718-840d3d4eec87 tempest-ProjectMemberTests-704047872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:59:39 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-4fad53f8-f90f-4bf0-b718-840d3d4eec87 tempest-ProjectMemberTests-704047872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:59:39 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-4fad53f8-f90f-4bf0-b718-840d3d4eec87 tempest-ProjectMemberTests-704047872 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:59:39 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-4fad53f8-f90f-4bf0-b718-840d3d4eec87 tempest-ProjectMemberTests-704047872 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:59:39 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-4fad53f8-f90f-4bf0-b718-840d3d4eec87 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de0105fd-05e7-49e4-a42b-f63ce5095da3 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:39 devstack sudo[105890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de0105fd-05e7-49e4-a42b-f63ce5095da3 1073741824 Jul 08 18:59:39 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:40 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-4fad53f8-f90f-4bf0-b718-840d3d4eec87 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de0105fd-05e7-49e4-a42b-f63ce5095da3 1073741824" returned: 0 in 0.878s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-4fad53f8-f90f-4bf0-b718-840d3d4eec87 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de0105fd-05e7-49e4-a42b-f63ce5095da3 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:40 devstack sudo[105896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de0105fd-05e7-49e4-a42b-f63ce5095da3 Jul 08 18:59:40 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:40 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-4fad53f8-f90f-4bf0-b718-840d3d4eec87 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de0105fd-05e7-49e4-a42b-f63ce5095da3" returned: 0 in 0.689s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:40 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-4fad53f8-f90f-4bf0-b718-840d3d4eec87 tempest-ProjectMemberTests-704047872 None] <== create_volume: return (1609ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:59:40 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-4fad53f8-f90f-4bf0-b718-840d3d4eec87 tempest-ProjectMemberTests-704047872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.612s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:59:40 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-4fad53f8-f90f-4bf0-b718-840d3d4eec87 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (338467e7-f577-4d65-bdda-9a78090d69fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de0105fd-05e7-49e4-a42b-f63ce5095da3', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:59:40 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-4fad53f8-f90f-4bf0-b718-840d3d4eec87 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (474c47c5-5de1-42ed-997e-387eda668815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:59:40 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-4fad53f8-f90f-4bf0-b718-840d3d4eec87 tempest-ProjectMemberTests-704047872 None] Volume volume-de0105fd-05e7-49e4-a42b-f63ce5095da3 (de0105fd-05e7-49e4-a42b-f63ce5095da3): created successfully Jul 08 18:59:40 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-4fad53f8-f90f-4bf0-b718-840d3d4eec87 tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (474c47c5-5de1-42ed-997e-387eda668815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:59:40 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-4fad53f8-f90f-4bf0-b718-840d3d4eec87 tempest-ProjectMemberTests-704047872 None] Flow 'volume_create_manager' (50532545-7534-4bf3-a05e-d62ee626f699) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:59:40 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-4fad53f8-f90f-4bf0-b718-840d3d4eec87 tempest-ProjectMemberTests-704047872 None] Created volume successfully. Jul 08 18:59:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-8712575a-b9b1-48f3-a9df-62cc54588998 tempest-ProjectMemberTests-704047872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:59:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-8712575a-b9b1-48f3-a9df-62cc54588998 tempest-ProjectMemberTests-704047872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:59:41 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-8712575a-b9b1-48f3-a9df-62cc54588998 tempest-ProjectMemberTests-704047872 None] Creating offline snapshot adae375b-244e-41c3-ba51-5b72a24f40b9 of volume de0105fd-05e7-49e4-a42b-f63ce5095da3 {{(pid=86873) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:59:41 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a49081-9609-4acf-b40a-d254e6bcc8d9]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:59:41 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8712575a-b9b1-48f3-a9df-62cc54588998 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de0105fd-05e7-49e4-a42b-f63ce5095da3 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:41 devstack sudo[105899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de0105fd-05e7-49e4-a42b-f63ce5095da3 Jul 08 18:59:41 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:42 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8712575a-b9b1-48f3-a9df-62cc54588998 tempest-ProjectMemberTests-704047872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de0105fd-05e7-49e4-a42b-f63ce5095da3" returned: 0 in 0.843s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:42 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8712575a-b9b1-48f3-a9df-62cc54588998 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de0105fd-05e7-49e4-a42b-f63ce5095da3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de0105fd-05e7-49e4-a42b-f63ce5095da3.adae375b-244e-41c3-ba51-5b72a24f40b9 1G {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:42 devstack sudo[105905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de0105fd-05e7-49e4-a42b-f63ce5095da3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de0105fd-05e7-49e4-a42b-f63ce5095da3.adae375b-244e-41c3-ba51-5b72a24f40b9 1G Jul 08 18:59:42 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:43 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8712575a-b9b1-48f3-a9df-62cc54588998 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de0105fd-05e7-49e4-a42b-f63ce5095da3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de0105fd-05e7-49e4-a42b-f63ce5095da3.adae375b-244e-41c3-ba51-5b72a24f40b9 1G" returned: 0 in 0.843s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8712575a-b9b1-48f3-a9df-62cc54588998 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de0105fd-05e7-49e4-a42b-f63ce5095da3 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de0105fd-05e7-49e4-a42b-f63ce5095da3.adae375b-244e-41c3-ba51-5b72a24f40b9 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:43 devstack sudo[105912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de0105fd-05e7-49e4-a42b-f63ce5095da3 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de0105fd-05e7-49e4-a42b-f63ce5095da3.adae375b-244e-41c3-ba51-5b72a24f40b9 Jul 08 18:59:43 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:43 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8712575a-b9b1-48f3-a9df-62cc54588998 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de0105fd-05e7-49e4-a42b-f63ce5095da3 -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de0105fd-05e7-49e4-a42b-f63ce5095da3.adae375b-244e-41c3-ba51-5b72a24f40b9" returned: 0 in 0.711s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:43 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-8712575a-b9b1-48f3-a9df-62cc54588998 tempest-ProjectMemberTests-704047872 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de0105fd-05e7-49e4-a42b-f63ce5095da3.adae375b-244e-41c3-ba51-5b72a24f40b9 is being set with open permissions: ugo+rw Jul 08 18:59:43 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8712575a-b9b1-48f3-a9df-62cc54588998 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de0105fd-05e7-49e4-a42b-f63ce5095da3.adae375b-244e-41c3-ba51-5b72a24f40b9 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:43 devstack sudo[105917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de0105fd-05e7-49e4-a42b-f63ce5095da3.adae375b-244e-41c3-ba51-5b72a24f40b9 Jul 08 18:59:43 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:44 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8712575a-b9b1-48f3-a9df-62cc54588998 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de0105fd-05e7-49e4-a42b-f63ce5095da3.adae375b-244e-41c3-ba51-5b72a24f40b9" returned: 0 in 0.648s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:44 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8712575a-b9b1-48f3-a9df-62cc54588998 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de0105fd-05e7-49e4-a42b-f63ce5095da3.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:44 devstack sudo[105920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de0105fd-05e7-49e4-a42b-f63ce5095da3.info Jul 08 18:59:44 devstack sudo[105920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:45 devstack sudo[105920]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8712575a-b9b1-48f3-a9df-62cc54588998 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de0105fd-05e7-49e4-a42b-f63ce5095da3.info" returned: 0 in 0.665s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:45 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-8712575a-b9b1-48f3-a9df-62cc54588998 tempest-ProjectMemberTests-704047872 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de0105fd-05e7-49e4-a42b-f63ce5095da3.info is being set with open permissions: ugo+rw Jul 08 18:59:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8712575a-b9b1-48f3-a9df-62cc54588998 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de0105fd-05e7-49e4-a42b-f63ce5095da3.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:45 devstack sudo[105923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de0105fd-05e7-49e4-a42b-f63ce5095da3.info Jul 08 18:59:45 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:45 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8712575a-b9b1-48f3-a9df-62cc54588998 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de0105fd-05e7-49e4-a42b-f63ce5095da3.info" returned: 0 in 0.633s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:45 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-8712575a-b9b1-48f3-a9df-62cc54588998 tempest-ProjectMemberTests-704047872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.436s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:59:45 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-8712575a-b9b1-48f3-a9df-62cc54588998 tempest-ProjectMemberTests-704047872 None] Create snapshot completed successfully Jul 08 18:59:46 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ca8f4494-5a2c-4795-9dde-c60456361c0a tempest-ProjectMemberTests-704047872 None] Acquiring lock "cinder-adae375b-244e-41c3-ba51-5b72a24f40b9-delete_snapshot" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:59:46 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ca8f4494-5a2c-4795-9dde-c60456361c0a tempest-ProjectMemberTests-704047872 None] Lock "cinder-adae375b-244e-41c3-ba51-5b72a24f40b9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:59:46 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ca8f4494-5a2c-4795-9dde-c60456361c0a tempest-ProjectMemberTests-704047872 None] Acquiring lock "cinder-quobyte-de0105fd-05e7-49e4-a42b-f63ce5095da3" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:59:46 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ca8f4494-5a2c-4795-9dde-c60456361c0a tempest-ProjectMemberTests-704047872 None] Lock "cinder-quobyte-de0105fd-05e7-49e4-a42b-f63ce5095da3" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:59:46 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ca8f4494-5a2c-4795-9dde-c60456361c0a tempest-ProjectMemberTests-704047872 None] Acquiring lock "cinder-quobyte-adae375b-244e-41c3-ba51-5b72a24f40b9" by "_delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:59:46 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ca8f4494-5a2c-4795-9dde-c60456361c0a tempest-ProjectMemberTests-704047872 None] Lock "cinder-quobyte-adae375b-244e-41c3-ba51-5b72a24f40b9" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:59:46 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-ca8f4494-5a2c-4795-9dde-c60456361c0a tempest-ProjectMemberTests-704047872 None] Deleting offline snapshot adae375b-244e-41c3-ba51-5b72a24f40b9 of volume de0105fd-05e7-49e4-a42b-f63ce5095da3 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:59:46 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-ca8f4494-5a2c-4795-9dde-c60456361c0a tempest-ProjectMemberTests-704047872 None] snapshot_file for this snap is: volume-de0105fd-05e7-49e4-a42b-f63ce5095da3.adae375b-244e-41c3-ba51-5b72a24f40b9 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:59:46 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[9477f8ef-7f54-4d20-b83a-bfb438908107]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:59:46 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ca8f4494-5a2c-4795-9dde-c60456361c0a tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de0105fd-05e7-49e4-a42b-f63ce5095da3.adae375b-244e-41c3-ba51-5b72a24f40b9 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:46 devstack sudo[105926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de0105fd-05e7-49e4-a42b-f63ce5095da3.adae375b-244e-41c3-ba51-5b72a24f40b9 Jul 08 18:59:46 devstack sudo[105926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:47 devstack sudo[105926]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ca8f4494-5a2c-4795-9dde-c60456361c0a tempest-ProjectMemberTests-704047872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de0105fd-05e7-49e4-a42b-f63ce5095da3.adae375b-244e-41c3-ba51-5b72a24f40b9" returned: 0 in 0.793s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:47 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-ca8f4494-5a2c-4795-9dde-c60456361c0a tempest-ProjectMemberTests-704047872 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de0105fd-05e7-49e4-a42b-f63ce5095da3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:59:47 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18d932e-628d-4b2f-9043-91ccfe388c25]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:59:47 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ca8f4494-5a2c-4795-9dde-c60456361c0a tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de0105fd-05e7-49e4-a42b-f63ce5095da3 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:47 devstack sudo[105932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de0105fd-05e7-49e4-a42b-f63ce5095da3 Jul 08 18:59:47 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:48 devstack cinder-volume[86873]: DEBUG oslo_service.periodic_task [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86873) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:59:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:59:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:59:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:59:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:59:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:59:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:48 devstack sudo[105934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:59:48 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:48 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ca8f4494-5a2c-4795-9dde-c60456361c0a tempest-ProjectMemberTests-704047872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de0105fd-05e7-49e4-a42b-f63ce5095da3" returned: 0 in 0.810s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ca8f4494-5a2c-4795-9dde-c60456361c0a tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de0105fd-05e7-49e4-a42b-f63ce5095da3.adae375b-244e-41c3-ba51-5b72a24f40b9 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:48 devstack sudo[105939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de0105fd-05e7-49e4-a42b-f63ce5095da3.adae375b-244e-41c3-ba51-5b72a24f40b9 Jul 08 18:59:48 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:49 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.814s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:49 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:59:49 devstack cinder-volume[86873]: DEBUG oslo_service.periodic_task [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running periodic task VolumeManager._thread_info {{(pid=86873) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:59:49 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] thread count: 29 {{(pid=86873) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:59:49 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] thread info: [<_MainThread(MainThread, started 138577734545536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86873) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:59:49 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ca8f4494-5a2c-4795-9dde-c60456361c0a tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de0105fd-05e7-49e4-a42b-f63ce5095da3.adae375b-244e-41c3-ba51-5b72a24f40b9" returned: 0 in 0.804s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ca8f4494-5a2c-4795-9dde-c60456361c0a tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de0105fd-05e7-49e4-a42b-f63ce5095da3.adae375b-244e-41c3-ba51-5b72a24f40b9 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:49 devstack sudo[105946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de0105fd-05e7-49e4-a42b-f63ce5095da3.adae375b-244e-41c3-ba51-5b72a24f40b9 Jul 08 18:59:49 devstack sudo[105946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:49 devstack sudo[105946]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:49 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ca8f4494-5a2c-4795-9dde-c60456361c0a tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de0105fd-05e7-49e4-a42b-f63ce5095da3.adae375b-244e-41c3-ba51-5b72a24f40b9" returned: 0 in 0.687s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:49 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ca8f4494-5a2c-4795-9dde-c60456361c0a tempest-ProjectMemberTests-704047872 None] Lock "cinder-quobyte-adae375b-244e-41c3-ba51-5b72a24f40b9" released by "_delete_snapshot" :: held 3.192s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:59:49 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ca8f4494-5a2c-4795-9dde-c60456361c0a tempest-ProjectMemberTests-704047872 None] Lock "cinder-quobyte-de0105fd-05e7-49e4-a42b-f63ce5095da3" released by "delete_snapshot" :: held 3.215s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:59:50 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-ca8f4494-5a2c-4795-9dde-c60456361c0a tempest-ProjectMemberTests-704047872 None] Created reservations ['d5590677-12c9-4f47-bcfe-2ecc259c24a5', '97ace678-b616-4da9-b4ac-a1225acb98d6', '10109923-20d8-4131-8be6-03d38485bfaf', 'c3fd165d-13c4-4dd8-8dd6-1ee9c3fc363c'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:59:50 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-ca8f4494-5a2c-4795-9dde-c60456361c0a tempest-ProjectMemberTests-704047872 None] Delete snapshot completed successfully. Jul 08 18:59:50 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ca8f4494-5a2c-4795-9dde-c60456361c0a tempest-ProjectMemberTests-704047872 None] Lock "cinder-adae375b-244e-41c3-ba51-5b72a24f40b9-delete_snapshot" released by "delete_snapshot" :: held 3.355s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:59:50 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-1236c45f-feaf-40f0-b327-66df9e4d18fa tempest-ProjectMemberTests-704047872 None] Acquiring lock "cinder-de0105fd-05e7-49e4-a42b-f63ce5095da3-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:59:51 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-1236c45f-feaf-40f0-b327-66df9e4d18fa tempest-ProjectMemberTests-704047872 None] Lock "cinder-de0105fd-05e7-49e4-a42b-f63ce5095da3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:59:51 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-1236c45f-feaf-40f0-b327-66df9e4d18fa tempest-ProjectMemberTests-704047872 None] Acquiring lock "cinder-quobyte-de0105fd-05e7-49e4-a42b-f63ce5095da3" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:59:51 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-1236c45f-feaf-40f0-b327-66df9e4d18fa tempest-ProjectMemberTests-704047872 None] Lock "cinder-quobyte-de0105fd-05e7-49e4-a42b-f63ce5095da3" acquired by "delete_volume" :: waited 0.020s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:59:51 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b90a8ad-9626-4ad3-8ec9-68192997e04b]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:59:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1236c45f-feaf-40f0-b327-66df9e4d18fa tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de0105fd-05e7-49e4-a42b-f63ce5095da3 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:51 devstack sudo[105949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de0105fd-05e7-49e4-a42b-f63ce5095da3 Jul 08 18:59:51 devstack sudo[105949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:51 devstack sudo[105949]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1236c45f-feaf-40f0-b327-66df9e4d18fa tempest-ProjectMemberTests-704047872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de0105fd-05e7-49e4-a42b-f63ce5095da3" returned: 0 in 0.870s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:51 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1236c45f-feaf-40f0-b327-66df9e4d18fa tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de0105fd-05e7-49e4-a42b-f63ce5095da3 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:52 devstack sudo[105954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de0105fd-05e7-49e4-a42b-f63ce5095da3 Jul 08 18:59:52 devstack sudo[105954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:52 devstack sudo[105954]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1236c45f-feaf-40f0-b327-66df9e4d18fa tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-de0105fd-05e7-49e4-a42b-f63ce5095da3" returned: 0 in 0.658s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:52 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-1236c45f-feaf-40f0-b327-66df9e4d18fa tempest-ProjectMemberTests-704047872 None] Lock "cinder-quobyte-de0105fd-05e7-49e4-a42b-f63ce5095da3" released by "delete_volume" :: held 1.600s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:59:52 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-1236c45f-feaf-40f0-b327-66df9e4d18fa tempest-ProjectMemberTests-704047872 None] Created reservations ['48959cf3-6ebb-4ed9-9f37-970f73138335', '77d95244-e601-49a8-a8c1-3fed688b6510', '350ab04b-a716-4654-85a6-c89664a3261c', '0af188ad-3446-4a88-9332-8588e3cbd1b2'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:59:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1236c45f-feaf-40f0-b327-66df9e4d18fa tempest-ProjectMemberTests-704047872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:59:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1236c45f-feaf-40f0-b327-66df9e4d18fa tempest-ProjectMemberTests-704047872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:59:52 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-1236c45f-feaf-40f0-b327-66df9e4d18fa tempest-ProjectMemberTests-704047872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:59:52 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-1236c45f-feaf-40f0-b327-66df9e4d18fa tempest-ProjectMemberTests-704047872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:59:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-1236c45f-feaf-40f0-b327-66df9e4d18fa tempest-ProjectMemberTests-704047872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:59:52 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1236c45f-feaf-40f0-b327-66df9e4d18fa tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:52 devstack sudo[105958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 18:59:52 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:53 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:53 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-1236c45f-feaf-40f0-b327-66df9e4d18fa tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.705s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:53 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-1236c45f-feaf-40f0-b327-66df9e4d18fa tempest-ProjectMemberTests-704047872 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:59:53 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-1236c45f-feaf-40f0-b327-66df9e4d18fa tempest-ProjectMemberTests-704047872 None] Deleted volume successfully. Jul 08 18:59:53 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-1236c45f-feaf-40f0-b327-66df9e4d18fa tempest-ProjectMemberTests-704047872 None] Lock "cinder-de0105fd-05e7-49e4-a42b-f63ce5095da3-delete_volume" released by "delete_volume" :: held 2.532s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:59:53 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-736986c5-e03b-4907-ae0f-7bf852025eaa tempest-ProjectMemberTests-704047872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:59:53 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-736986c5-e03b-4907-ae0f-7bf852025eaa tempest-ProjectMemberTests-704047872 None] Flow 'volume_create_manager' (d9cc9d5d-1484-4f37-8f2c-62802cb4dff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:59:53 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-736986c5-e03b-4907-ae0f-7bf852025eaa tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfc6e95a-8fb3-4e6d-83c8-df74bc8ed87d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:59:53 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-736986c5-e03b-4907-ae0f-7bf852025eaa tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfc6e95a-8fb3-4e6d-83c8-df74bc8ed87d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:59:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1828453491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55fdea74-25c7-4d0c-b696-d447fc715f8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23f6feda0dc341ae9dff1be67ef4c54c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:59:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:59:54Z,use_quota=True,user_id='ebff52e9980446ed8de939cd8116db5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:59:53 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-736986c5-e03b-4907-ae0f-7bf852025eaa tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dafd3ff-49b3-43e2-85a8-976c6e36c8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:59:53 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-736986c5-e03b-4907-ae0f-7bf852025eaa tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dafd3ff-49b3-43e2-85a8-976c6e36c8ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:59:53 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-736986c5-e03b-4907-ae0f-7bf852025eaa tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fd74ad2-4781-4071-b484-5cc22222355b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:59:53 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-736986c5-e03b-4907-ae0f-7bf852025eaa tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fd74ad2-4781-4071-b484-5cc22222355b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55fdea74-25c7-4d0c-b696-d447fc715f8e', 'volume_name': 'volume-55fdea74-25c7-4d0c-b696-d447fc715f8e', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:59:53 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-736986c5-e03b-4907-ae0f-7bf852025eaa tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eeae3ca-5ec8-4941-8fc6-7511a8a22ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:59:53 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-736986c5-e03b-4907-ae0f-7bf852025eaa tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eeae3ca-5ec8-4941-8fc6-7511a8a22ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:59:53 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-736986c5-e03b-4907-ae0f-7bf852025eaa tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3af0f571-73f8-4985-8191-b12c687ebece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:59:53 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-736986c5-e03b-4907-ae0f-7bf852025eaa tempest-ProjectMemberTests-704047872 None] Volume 55fdea74-25c7-4d0c-b696-d447fc715f8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55fdea74-25c7-4d0c-b696-d447fc715f8e', 'volume_size': 1} Jul 08 18:59:53 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-736986c5-e03b-4907-ae0f-7bf852025eaa tempest-ProjectMemberTests-704047872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:59:53 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-736986c5-e03b-4907-ae0f-7bf852025eaa tempest-ProjectMemberTests-704047872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:59:53 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-736986c5-e03b-4907-ae0f-7bf852025eaa tempest-ProjectMemberTests-704047872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:59:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1828453491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55fdea74-25c7-4d0c-b696-d447fc715f8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23f6feda0dc341ae9dff1be67ef4c54c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:59:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:59:54Z,use_quota=True,user_id='ebff52e9980446ed8de939cd8116db5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:59:53 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-736986c5-e03b-4907-ae0f-7bf852025eaa tempest-ProjectMemberTests-704047872 None] Creating volume 55fdea74-25c7-4d0c-b696-d447fc715f8e {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:59:53 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-736986c5-e03b-4907-ae0f-7bf852025eaa tempest-ProjectMemberTests-704047872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:59:53 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-736986c5-e03b-4907-ae0f-7bf852025eaa tempest-ProjectMemberTests-704047872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:59:53 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-736986c5-e03b-4907-ae0f-7bf852025eaa tempest-ProjectMemberTests-704047872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:59:53 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-736986c5-e03b-4907-ae0f-7bf852025eaa tempest-ProjectMemberTests-704047872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:59:53 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-736986c5-e03b-4907-ae0f-7bf852025eaa tempest-ProjectMemberTests-704047872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:59:53 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-736986c5-e03b-4907-ae0f-7bf852025eaa tempest-ProjectMemberTests-704047872 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:59:53 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-736986c5-e03b-4907-ae0f-7bf852025eaa tempest-ProjectMemberTests-704047872 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 18:59:53 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-736986c5-e03b-4907-ae0f-7bf852025eaa tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-55fdea74-25c7-4d0c-b696-d447fc715f8e 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:53 devstack sudo[105961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-55fdea74-25c7-4d0c-b696-d447fc715f8e 1073741824 Jul 08 18:59:53 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:54 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-736986c5-e03b-4907-ae0f-7bf852025eaa tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-55fdea74-25c7-4d0c-b696-d447fc715f8e 1073741824" returned: 0 in 0.882s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:54 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-736986c5-e03b-4907-ae0f-7bf852025eaa tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-55fdea74-25c7-4d0c-b696-d447fc715f8e {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:54 devstack sudo[105967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-55fdea74-25c7-4d0c-b696-d447fc715f8e Jul 08 18:59:54 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:55 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-736986c5-e03b-4907-ae0f-7bf852025eaa tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-55fdea74-25c7-4d0c-b696-d447fc715f8e" returned: 0 in 0.662s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:55 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-736986c5-e03b-4907-ae0f-7bf852025eaa tempest-ProjectMemberTests-704047872 None] <== create_volume: return (1601ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:59:55 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-736986c5-e03b-4907-ae0f-7bf852025eaa tempest-ProjectMemberTests-704047872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.604s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:59:55 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-736986c5-e03b-4907-ae0f-7bf852025eaa tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3af0f571-73f8-4985-8191-b12c687ebece) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55fdea74-25c7-4d0c-b696-d447fc715f8e', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:59:55 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-736986c5-e03b-4907-ae0f-7bf852025eaa tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1514c120-0551-44d4-a83c-2ff8eed2eca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:59:55 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-736986c5-e03b-4907-ae0f-7bf852025eaa tempest-ProjectMemberTests-704047872 None] Volume volume-55fdea74-25c7-4d0c-b696-d447fc715f8e (55fdea74-25c7-4d0c-b696-d447fc715f8e): created successfully Jul 08 18:59:55 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-736986c5-e03b-4907-ae0f-7bf852025eaa tempest-ProjectMemberTests-704047872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1514c120-0551-44d4-a83c-2ff8eed2eca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:59:55 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-736986c5-e03b-4907-ae0f-7bf852025eaa tempest-ProjectMemberTests-704047872 None] Flow 'volume_create_manager' (d9cc9d5d-1484-4f37-8f2c-62802cb4dff7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:59:55 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-736986c5-e03b-4907-ae0f-7bf852025eaa tempest-ProjectMemberTests-704047872 None] Created volume successfully. Jul 08 18:59:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-45d858d4-b677-4a41-81f4-8f94e5c24f00 tempest-ProjectMemberTests-704047872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:59:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-45d858d4-b677-4a41-81f4-8f94e5c24f00 tempest-ProjectMemberTests-704047872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:59:56 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-45d858d4-b677-4a41-81f4-8f94e5c24f00 tempest-ProjectMemberTests-704047872 None] Creating offline snapshot 25085e5b-0a38-42f5-bc43-6ebb2614d4c3 of volume 55fdea74-25c7-4d0c-b696-d447fc715f8e {{(pid=86873) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:59:56 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a27a086-e39a-4b3a-aa34-a6393e69be60]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:59:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-45d858d4-b677-4a41-81f4-8f94e5c24f00 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-55fdea74-25c7-4d0c-b696-d447fc715f8e {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:56 devstack sudo[105971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-55fdea74-25c7-4d0c-b696-d447fc715f8e Jul 08 18:59:56 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:56 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-45d858d4-b677-4a41-81f4-8f94e5c24f00 tempest-ProjectMemberTests-704047872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-55fdea74-25c7-4d0c-b696-d447fc715f8e" returned: 0 in 0.862s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:56 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-45d858d4-b677-4a41-81f4-8f94e5c24f00 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-55fdea74-25c7-4d0c-b696-d447fc715f8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-55fdea74-25c7-4d0c-b696-d447fc715f8e.25085e5b-0a38-42f5-bc43-6ebb2614d4c3 1G {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:56 devstack sudo[105977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-55fdea74-25c7-4d0c-b696-d447fc715f8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-55fdea74-25c7-4d0c-b696-d447fc715f8e.25085e5b-0a38-42f5-bc43-6ebb2614d4c3 1G Jul 08 18:59:56 devstack sudo[105977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:57 devstack sudo[105977]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-45d858d4-b677-4a41-81f4-8f94e5c24f00 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-55fdea74-25c7-4d0c-b696-d447fc715f8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-55fdea74-25c7-4d0c-b696-d447fc715f8e.25085e5b-0a38-42f5-bc43-6ebb2614d4c3 1G" returned: 0 in 0.916s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:57 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-45d858d4-b677-4a41-81f4-8f94e5c24f00 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55fdea74-25c7-4d0c-b696-d447fc715f8e -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-55fdea74-25c7-4d0c-b696-d447fc715f8e.25085e5b-0a38-42f5-bc43-6ebb2614d4c3 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:57 devstack sudo[105983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55fdea74-25c7-4d0c-b696-d447fc715f8e -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-55fdea74-25c7-4d0c-b696-d447fc715f8e.25085e5b-0a38-42f5-bc43-6ebb2614d4c3 Jul 08 18:59:57 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:58 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-45d858d4-b677-4a41-81f4-8f94e5c24f00 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55fdea74-25c7-4d0c-b696-d447fc715f8e -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-55fdea74-25c7-4d0c-b696-d447fc715f8e.25085e5b-0a38-42f5-bc43-6ebb2614d4c3" returned: 0 in 0.813s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:58 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-45d858d4-b677-4a41-81f4-8f94e5c24f00 tempest-ProjectMemberTests-704047872 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-55fdea74-25c7-4d0c-b696-d447fc715f8e.25085e5b-0a38-42f5-bc43-6ebb2614d4c3 is being set with open permissions: ugo+rw Jul 08 18:59:58 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-45d858d4-b677-4a41-81f4-8f94e5c24f00 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-55fdea74-25c7-4d0c-b696-d447fc715f8e.25085e5b-0a38-42f5-bc43-6ebb2614d4c3 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:58 devstack sudo[105989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-55fdea74-25c7-4d0c-b696-d447fc715f8e.25085e5b-0a38-42f5-bc43-6ebb2614d4c3 Jul 08 18:59:58 devstack sudo[105989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:59 devstack sudo[105989]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-45d858d4-b677-4a41-81f4-8f94e5c24f00 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-55fdea74-25c7-4d0c-b696-d447fc715f8e.25085e5b-0a38-42f5-bc43-6ebb2614d4c3" returned: 0 in 0.751s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:59 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-45d858d4-b677-4a41-81f4-8f94e5c24f00 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-55fdea74-25c7-4d0c-b696-d447fc715f8e.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:59 devstack sudo[105992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-55fdea74-25c7-4d0c-b696-d447fc715f8e.info Jul 08 18:59:59 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:00:00 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root Jul 08 19:00:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-45d858d4-b677-4a41-81f4-8f94e5c24f00 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-55fdea74-25c7-4d0c-b696-d447fc715f8e.info" returned: 0 in 0.713s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:00:00 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-45d858d4-b677-4a41-81f4-8f94e5c24f00 tempest-ProjectMemberTests-704047872 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-55fdea74-25c7-4d0c-b696-d447fc715f8e.info is being set with open permissions: ugo+rw Jul 08 19:00:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-45d858d4-b677-4a41-81f4-8f94e5c24f00 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-55fdea74-25c7-4d0c-b696-d447fc715f8e.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:00:00 devstack sudo[105996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-55fdea74-25c7-4d0c-b696-d447fc715f8e.info Jul 08 19:00:00 devstack sudo[105996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:00:00 devstack sudo[105996]: pam_unix(sudo:session): session closed for user root Jul 08 19:00:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-45d858d4-b677-4a41-81f4-8f94e5c24f00 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-55fdea74-25c7-4d0c-b696-d447fc715f8e.info" returned: 0 in 0.719s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:00:00 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-45d858d4-b677-4a41-81f4-8f94e5c24f00 tempest-ProjectMemberTests-704047872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.867s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:00:00 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-45d858d4-b677-4a41-81f4-8f94e5c24f00 tempest-ProjectMemberTests-704047872 None] Create snapshot completed successfully Jul 08 19:00:01 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-8f800870-7c94-4349-9382-40f0b8957574 tempest-ProjectMemberTests-704047872 None] Acquiring lock "cinder-25085e5b-0a38-42f5-bc43-6ebb2614d4c3-delete_snapshot" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:00:01 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-8f800870-7c94-4349-9382-40f0b8957574 tempest-ProjectMemberTests-704047872 None] Lock "cinder-25085e5b-0a38-42f5-bc43-6ebb2614d4c3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:00:01 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-8f800870-7c94-4349-9382-40f0b8957574 tempest-ProjectMemberTests-704047872 None] Acquiring lock "cinder-quobyte-55fdea74-25c7-4d0c-b696-d447fc715f8e" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:00:01 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-8f800870-7c94-4349-9382-40f0b8957574 tempest-ProjectMemberTests-704047872 None] Lock "cinder-quobyte-55fdea74-25c7-4d0c-b696-d447fc715f8e" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:00:01 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-8f800870-7c94-4349-9382-40f0b8957574 tempest-ProjectMemberTests-704047872 None] Acquiring lock "cinder-quobyte-25085e5b-0a38-42f5-bc43-6ebb2614d4c3" by "_delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:00:01 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-8f800870-7c94-4349-9382-40f0b8957574 tempest-ProjectMemberTests-704047872 None] Lock "cinder-quobyte-25085e5b-0a38-42f5-bc43-6ebb2614d4c3" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:00:01 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-8f800870-7c94-4349-9382-40f0b8957574 tempest-ProjectMemberTests-704047872 None] Deleting offline snapshot 25085e5b-0a38-42f5-bc43-6ebb2614d4c3 of volume 55fdea74-25c7-4d0c-b696-d447fc715f8e {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:00:01 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-8f800870-7c94-4349-9382-40f0b8957574 tempest-ProjectMemberTests-704047872 None] snapshot_file for this snap is: volume-55fdea74-25c7-4d0c-b696-d447fc715f8e.25085e5b-0a38-42f5-bc43-6ebb2614d4c3 {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:00:01 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6e9705-da39-4e32-950c-1e9a611d855c]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:00:01 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8f800870-7c94-4349-9382-40f0b8957574 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-55fdea74-25c7-4d0c-b696-d447fc715f8e.25085e5b-0a38-42f5-bc43-6ebb2614d4c3 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:00:01 devstack sudo[105999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-55fdea74-25c7-4d0c-b696-d447fc715f8e.25085e5b-0a38-42f5-bc43-6ebb2614d4c3 Jul 08 19:00:01 devstack sudo[105999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:00:01 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-84ea6a87-fef8-499f-8858-2868f0264e66 tempest-SnapshotDependencyTests-859112781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:00:01 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-84ea6a87-fef8-499f-8858-2868f0264e66 tempest-SnapshotDependencyTests-859112781 None] Flow 'volume_create_manager' (218b3495-0b33-45a2-994e-a3a51db946ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:00:01 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-84ea6a87-fef8-499f-8858-2868f0264e66 tempest-SnapshotDependencyTests-859112781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e233c86-e32d-47c7-bc1c-c6745aecd670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:00:01 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-84ea6a87-fef8-499f-8858-2868f0264e66 tempest-SnapshotDependencyTests-859112781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e233c86-e32d-47c7-bc1c-c6745aecd670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1049158042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e65c4be3-db19-4779-b644-3cbedfcbe37d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e476bd3b79854338bcd64f63e12fc7de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:00:02Z,use_quota=True,user_id='29320e6288a4479fb1918c18e00b7c61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:00:01 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-84ea6a87-fef8-499f-8858-2868f0264e66 tempest-SnapshotDependencyTests-859112781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bd9df5d-eca0-403c-a06a-0735db0f3f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:00:01 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-84ea6a87-fef8-499f-8858-2868f0264e66 tempest-SnapshotDependencyTests-859112781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bd9df5d-eca0-403c-a06a-0735db0f3f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:00:01 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-84ea6a87-fef8-499f-8858-2868f0264e66 tempest-SnapshotDependencyTests-859112781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1bcaa24-f88c-4fb6-bbe8-207254c1fd1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:00:01 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-84ea6a87-fef8-499f-8858-2868f0264e66 tempest-SnapshotDependencyTests-859112781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1bcaa24-f88c-4fb6-bbe8-207254c1fd1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e65c4be3-db19-4779-b644-3cbedfcbe37d', 'volume_name': 'volume-e65c4be3-db19-4779-b644-3cbedfcbe37d', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:00:01 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-84ea6a87-fef8-499f-8858-2868f0264e66 tempest-SnapshotDependencyTests-859112781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d70a8b9-6522-4a82-bf0a-1065b16b96cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:00:01 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-84ea6a87-fef8-499f-8858-2868f0264e66 tempest-SnapshotDependencyTests-859112781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d70a8b9-6522-4a82-bf0a-1065b16b96cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:00:02 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-84ea6a87-fef8-499f-8858-2868f0264e66 tempest-SnapshotDependencyTests-859112781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e27d127-7d7a-43ab-b84b-51d1a4632044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:00:02 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-84ea6a87-fef8-499f-8858-2868f0264e66 tempest-SnapshotDependencyTests-859112781 None] Volume e65c4be3-db19-4779-b644-3cbedfcbe37d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e65c4be3-db19-4779-b644-3cbedfcbe37d', 'volume_size': 1} Jul 08 19:00:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-84ea6a87-fef8-499f-8858-2868f0264e66 tempest-SnapshotDependencyTests-859112781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:00:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-84ea6a87-fef8-499f-8858-2868f0264e66 tempest-SnapshotDependencyTests-859112781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:00:02 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-84ea6a87-fef8-499f-8858-2868f0264e66 tempest-SnapshotDependencyTests-859112781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1049158042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e65c4be3-db19-4779-b644-3cbedfcbe37d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e476bd3b79854338bcd64f63e12fc7de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:00:02Z,use_quota=True,user_id='29320e6288a4479fb1918c18e00b7c61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:00:02 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-84ea6a87-fef8-499f-8858-2868f0264e66 tempest-SnapshotDependencyTests-859112781 None] Creating volume e65c4be3-db19-4779-b644-3cbedfcbe37d {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:00:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-84ea6a87-fef8-499f-8858-2868f0264e66 tempest-SnapshotDependencyTests-859112781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:00:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-84ea6a87-fef8-499f-8858-2868f0264e66 tempest-SnapshotDependencyTests-859112781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:00:02 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-84ea6a87-fef8-499f-8858-2868f0264e66 tempest-SnapshotDependencyTests-859112781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:00:02 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-84ea6a87-fef8-499f-8858-2868f0264e66 tempest-SnapshotDependencyTests-859112781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:00:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-84ea6a87-fef8-499f-8858-2868f0264e66 tempest-SnapshotDependencyTests-859112781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:00:02 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-84ea6a87-fef8-499f-8858-2868f0264e66 tempest-SnapshotDependencyTests-859112781 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:00:02 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-84ea6a87-fef8-499f-8858-2868f0264e66 tempest-SnapshotDependencyTests-859112781 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 19:00:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-84ea6a87-fef8-499f-8858-2868f0264e66 tempest-SnapshotDependencyTests-859112781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e65c4be3-db19-4779-b644-3cbedfcbe37d 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:00:02 devstack sudo[106001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e65c4be3-db19-4779-b644-3cbedfcbe37d 1073741824 Jul 08 19:00:02 devstack sudo[106001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:00:02 devstack sudo[105999]: pam_unix(sudo:session): session closed for user root Jul 08 19:00:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8f800870-7c94-4349-9382-40f0b8957574 tempest-ProjectMemberTests-704047872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-55fdea74-25c7-4d0c-b696-d447fc715f8e.25085e5b-0a38-42f5-bc43-6ebb2614d4c3" returned: 0 in 0.836s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:00:02 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-8f800870-7c94-4349-9382-40f0b8957574 tempest-ProjectMemberTests-704047872 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55fdea74-25c7-4d0c-b696-d447fc715f8e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:00:02 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[2078f632-f6ac-4aff-9310-1ee6d321bd39]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:00:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8f800870-7c94-4349-9382-40f0b8957574 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-55fdea74-25c7-4d0c-b696-d447fc715f8e {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:00:02 devstack sudo[106008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-55fdea74-25c7-4d0c-b696-d447fc715f8e Jul 08 19:00:02 devstack sudo[106008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:00:02 devstack sudo[106001]: pam_unix(sudo:session): session closed for user root Jul 08 19:00:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-84ea6a87-fef8-499f-8858-2868f0264e66 tempest-SnapshotDependencyTests-859112781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e65c4be3-db19-4779-b644-3cbedfcbe37d 1073741824" returned: 0 in 0.852s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:00:02 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-84ea6a87-fef8-499f-8858-2868f0264e66 tempest-SnapshotDependencyTests-859112781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e65c4be3-db19-4779-b644-3cbedfcbe37d {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:00:02 devstack sudo[106014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e65c4be3-db19-4779-b644-3cbedfcbe37d Jul 08 19:00:02 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:00:03 devstack sudo[106008]: pam_unix(sudo:session): session closed for user root Jul 08 19:00:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8f800870-7c94-4349-9382-40f0b8957574 tempest-ProjectMemberTests-704047872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-55fdea74-25c7-4d0c-b696-d447fc715f8e" returned: 0 in 0.783s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:00:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8f800870-7c94-4349-9382-40f0b8957574 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-55fdea74-25c7-4d0c-b696-d447fc715f8e.25085e5b-0a38-42f5-bc43-6ebb2614d4c3 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:00:03 devstack sudo[106020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-55fdea74-25c7-4d0c-b696-d447fc715f8e.25085e5b-0a38-42f5-bc43-6ebb2614d4c3 Jul 08 19:00:03 devstack sudo[106020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:00:03 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root Jul 08 19:00:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-84ea6a87-fef8-499f-8858-2868f0264e66 tempest-SnapshotDependencyTests-859112781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e65c4be3-db19-4779-b644-3cbedfcbe37d" returned: 0 in 0.654s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:00:03 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-84ea6a87-fef8-499f-8858-2868f0264e66 tempest-SnapshotDependencyTests-859112781 None] <== create_volume: return (1549ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:00:03 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-84ea6a87-fef8-499f-8858-2868f0264e66 tempest-SnapshotDependencyTests-859112781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.552s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:00:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-84ea6a87-fef8-499f-8858-2868f0264e66 tempest-SnapshotDependencyTests-859112781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e27d127-7d7a-43ab-b84b-51d1a4632044) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e65c4be3-db19-4779-b644-3cbedfcbe37d', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:00:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-84ea6a87-fef8-499f-8858-2868f0264e66 tempest-SnapshotDependencyTests-859112781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0efded1-8a68-4057-8dae-8967f4d5e563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:00:03 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-84ea6a87-fef8-499f-8858-2868f0264e66 tempest-SnapshotDependencyTests-859112781 None] Volume volume-e65c4be3-db19-4779-b644-3cbedfcbe37d (e65c4be3-db19-4779-b644-3cbedfcbe37d): created successfully Jul 08 19:00:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-84ea6a87-fef8-499f-8858-2868f0264e66 tempest-SnapshotDependencyTests-859112781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0efded1-8a68-4057-8dae-8967f4d5e563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:00:03 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-84ea6a87-fef8-499f-8858-2868f0264e66 tempest-SnapshotDependencyTests-859112781 None] Flow 'volume_create_manager' (218b3495-0b33-45a2-994e-a3a51db946ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:00:03 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-84ea6a87-fef8-499f-8858-2868f0264e66 tempest-SnapshotDependencyTests-859112781 None] Created volume successfully. Jul 08 19:00:04 devstack sudo[106020]: pam_unix(sudo:session): session closed for user root Jul 08 19:00:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8f800870-7c94-4349-9382-40f0b8957574 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-55fdea74-25c7-4d0c-b696-d447fc715f8e.25085e5b-0a38-42f5-bc43-6ebb2614d4c3" returned: 0 in 0.787s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:00:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8f800870-7c94-4349-9382-40f0b8957574 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-55fdea74-25c7-4d0c-b696-d447fc715f8e.25085e5b-0a38-42f5-bc43-6ebb2614d4c3 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:00:04 devstack sudo[106029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-55fdea74-25c7-4d0c-b696-d447fc715f8e.25085e5b-0a38-42f5-bc43-6ebb2614d4c3 Jul 08 19:00:04 devstack sudo[106029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:00:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-680d364e-c92f-4564-8a69-9bc64cc6ebef tempest-SnapshotDependencyTests-859112781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:00:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-680d364e-c92f-4564-8a69-9bc64cc6ebef tempest-SnapshotDependencyTests-859112781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:00:04 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-680d364e-c92f-4564-8a69-9bc64cc6ebef tempest-SnapshotDependencyTests-859112781 None] Creating offline snapshot 4785329b-633c-4455-b1da-d720c10c91cd of volume e65c4be3-db19-4779-b644-3cbedfcbe37d {{(pid=86873) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:00:04 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[869fe847-99f5-44a3-aa6e-1ee26a87c25d]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:00:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-680d364e-c92f-4564-8a69-9bc64cc6ebef tempest-SnapshotDependencyTests-859112781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e65c4be3-db19-4779-b644-3cbedfcbe37d {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:00:04 devstack sudo[106031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e65c4be3-db19-4779-b644-3cbedfcbe37d Jul 08 19:00:04 devstack sudo[106031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:00:04 devstack sudo[106029]: pam_unix(sudo:session): session closed for user root Jul 08 19:00:04 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8f800870-7c94-4349-9382-40f0b8957574 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-55fdea74-25c7-4d0c-b696-d447fc715f8e.25085e5b-0a38-42f5-bc43-6ebb2614d4c3" returned: 0 in 0.679s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:00:04 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-8f800870-7c94-4349-9382-40f0b8957574 tempest-ProjectMemberTests-704047872 None] Lock "cinder-quobyte-25085e5b-0a38-42f5-bc43-6ebb2614d4c3" released by "_delete_snapshot" :: held 3.199s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:00:04 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-8f800870-7c94-4349-9382-40f0b8957574 tempest-ProjectMemberTests-704047872 None] Lock "cinder-quobyte-55fdea74-25c7-4d0c-b696-d447fc715f8e" released by "delete_snapshot" :: held 3.235s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:00:04 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-8f800870-7c94-4349-9382-40f0b8957574 tempest-ProjectMemberTests-704047872 None] Created reservations ['519b1639-57dd-4101-b19f-ac106fdc6ffa', 'db8e5e6d-c014-4d18-a41c-88de945f3413', '8305ff8d-f2b5-476f-a200-b59561cd0a13', '07e4c983-3f1c-49a2-845d-c2b1bfcdd074'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:00:04 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-8f800870-7c94-4349-9382-40f0b8957574 tempest-ProjectMemberTests-704047872 None] Delete snapshot completed successfully. Jul 08 19:00:04 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-8f800870-7c94-4349-9382-40f0b8957574 tempest-ProjectMemberTests-704047872 None] Lock "cinder-25085e5b-0a38-42f5-bc43-6ebb2614d4c3-delete_snapshot" released by "delete_snapshot" :: held 3.397s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:00:05 devstack sudo[106031]: pam_unix(sudo:session): session closed for user root Jul 08 19:00:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-680d364e-c92f-4564-8a69-9bc64cc6ebef tempest-SnapshotDependencyTests-859112781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e65c4be3-db19-4779-b644-3cbedfcbe37d" returned: 0 in 0.788s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:00:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-680d364e-c92f-4564-8a69-9bc64cc6ebef tempest-SnapshotDependencyTests-859112781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e65c4be3-db19-4779-b644-3cbedfcbe37d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e65c4be3-db19-4779-b644-3cbedfcbe37d.4785329b-633c-4455-b1da-d720c10c91cd 1G {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:00:05 devstack sudo[106037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e65c4be3-db19-4779-b644-3cbedfcbe37d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e65c4be3-db19-4779-b644-3cbedfcbe37d.4785329b-633c-4455-b1da-d720c10c91cd 1G Jul 08 19:00:05 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:00:05 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-f4b4c98f-148b-437b-b5c4-d39dfc1d5712 tempest-ProjectMemberTests-704047872 None] Acquiring lock "cinder-55fdea74-25c7-4d0c-b696-d447fc715f8e-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:00:05 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-f4b4c98f-148b-437b-b5c4-d39dfc1d5712 tempest-ProjectMemberTests-704047872 None] Lock "cinder-55fdea74-25c7-4d0c-b696-d447fc715f8e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:00:05 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-f4b4c98f-148b-437b-b5c4-d39dfc1d5712 tempest-ProjectMemberTests-704047872 None] Acquiring lock "cinder-quobyte-55fdea74-25c7-4d0c-b696-d447fc715f8e" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:00:05 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-f4b4c98f-148b-437b-b5c4-d39dfc1d5712 tempest-ProjectMemberTests-704047872 None] Lock "cinder-quobyte-55fdea74-25c7-4d0c-b696-d447fc715f8e" acquired by "delete_volume" :: waited 0.018s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:00:05 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[80451256-a05c-409b-99d7-c66d01efc9c7]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:00:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f4b4c98f-148b-437b-b5c4-d39dfc1d5712 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-55fdea74-25c7-4d0c-b696-d447fc715f8e {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:00:05 devstack sudo[106043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-55fdea74-25c7-4d0c-b696-d447fc715f8e Jul 08 19:00:05 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:00:05 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root Jul 08 19:00:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-680d364e-c92f-4564-8a69-9bc64cc6ebef tempest-SnapshotDependencyTests-859112781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e65c4be3-db19-4779-b644-3cbedfcbe37d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e65c4be3-db19-4779-b644-3cbedfcbe37d.4785329b-633c-4455-b1da-d720c10c91cd 1G" returned: 0 in 0.854s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:00:05 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-680d364e-c92f-4564-8a69-9bc64cc6ebef tempest-SnapshotDependencyTests-859112781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e65c4be3-db19-4779-b644-3cbedfcbe37d -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e65c4be3-db19-4779-b644-3cbedfcbe37d.4785329b-633c-4455-b1da-d720c10c91cd {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:00:05 devstack sudo[106045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e65c4be3-db19-4779-b644-3cbedfcbe37d -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e65c4be3-db19-4779-b644-3cbedfcbe37d.4785329b-633c-4455-b1da-d720c10c91cd Jul 08 19:00:05 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:00:06 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root Jul 08 19:00:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f4b4c98f-148b-437b-b5c4-d39dfc1d5712 tempest-ProjectMemberTests-704047872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-55fdea74-25c7-4d0c-b696-d447fc715f8e" returned: 0 in 0.839s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:00:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f4b4c98f-148b-437b-b5c4-d39dfc1d5712 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-55fdea74-25c7-4d0c-b696-d447fc715f8e {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:00:06 devstack sudo[106053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-55fdea74-25c7-4d0c-b696-d447fc715f8e Jul 08 19:00:06 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:00:06 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root Jul 08 19:00:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-680d364e-c92f-4564-8a69-9bc64cc6ebef tempest-SnapshotDependencyTests-859112781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e65c4be3-db19-4779-b644-3cbedfcbe37d -F qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e65c4be3-db19-4779-b644-3cbedfcbe37d.4785329b-633c-4455-b1da-d720c10c91cd" returned: 0 in 0.770s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:00:06 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-680d364e-c92f-4564-8a69-9bc64cc6ebef tempest-SnapshotDependencyTests-859112781 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e65c4be3-db19-4779-b644-3cbedfcbe37d.4785329b-633c-4455-b1da-d720c10c91cd is being set with open permissions: ugo+rw Jul 08 19:00:06 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-680d364e-c92f-4564-8a69-9bc64cc6ebef tempest-SnapshotDependencyTests-859112781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e65c4be3-db19-4779-b644-3cbedfcbe37d.4785329b-633c-4455-b1da-d720c10c91cd {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:00:06 devstack sudo[106055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e65c4be3-db19-4779-b644-3cbedfcbe37d.4785329b-633c-4455-b1da-d720c10c91cd Jul 08 19:00:06 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:00:07 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root Jul 08 19:00:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f4b4c98f-148b-437b-b5c4-d39dfc1d5712 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-55fdea74-25c7-4d0c-b696-d447fc715f8e" returned: 0 in 0.703s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:00:07 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-f4b4c98f-148b-437b-b5c4-d39dfc1d5712 tempest-ProjectMemberTests-704047872 None] Lock "cinder-quobyte-55fdea74-25c7-4d0c-b696-d447fc715f8e" released by "delete_volume" :: held 1.602s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:00:07 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root Jul 08 19:00:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-680d364e-c92f-4564-8a69-9bc64cc6ebef tempest-SnapshotDependencyTests-859112781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e65c4be3-db19-4779-b644-3cbedfcbe37d.4785329b-633c-4455-b1da-d720c10c91cd" returned: 0 in 0.703s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:00:07 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-f4b4c98f-148b-437b-b5c4-d39dfc1d5712 tempest-ProjectMemberTests-704047872 None] Created reservations ['d6e132d7-6ce2-45f5-a385-bfc4b7c11a97', '3a5606d7-e5a8-4edb-8b96-54d25d2554b1', 'e23c750e-74ac-4d89-8212-b10e3b5c0202', 'd699a45b-55cc-43ff-a321-e25671649b5f'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:00:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-680d364e-c92f-4564-8a69-9bc64cc6ebef tempest-SnapshotDependencyTests-859112781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e65c4be3-db19-4779-b644-3cbedfcbe37d.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:00:07 devstack sudo[106060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e65c4be3-db19-4779-b644-3cbedfcbe37d.info Jul 08 19:00:07 devstack sudo[106060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:00:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f4b4c98f-148b-437b-b5c4-d39dfc1d5712 tempest-ProjectMemberTests-704047872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:00:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f4b4c98f-148b-437b-b5c4-d39dfc1d5712 tempest-ProjectMemberTests-704047872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:00:07 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-f4b4c98f-148b-437b-b5c4-d39dfc1d5712 tempest-ProjectMemberTests-704047872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:00:07 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-f4b4c98f-148b-437b-b5c4-d39dfc1d5712 tempest-ProjectMemberTests-704047872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:00:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-f4b4c98f-148b-437b-b5c4-d39dfc1d5712 tempest-ProjectMemberTests-704047872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:00:07 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f4b4c98f-148b-437b-b5c4-d39dfc1d5712 tempest-ProjectMemberTests-704047872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:00:07 devstack sudo[106062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 19:00:07 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:00:08 devstack sudo[106060]: pam_unix(sudo:session): session closed for user root Jul 08 19:00:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-680d364e-c92f-4564-8a69-9bc64cc6ebef tempest-SnapshotDependencyTests-859112781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e65c4be3-db19-4779-b644-3cbedfcbe37d.info" returned: 0 in 0.755s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:00:08 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-680d364e-c92f-4564-8a69-9bc64cc6ebef tempest-SnapshotDependencyTests-859112781 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e65c4be3-db19-4779-b644-3cbedfcbe37d.info is being set with open permissions: ugo+rw Jul 08 19:00:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-680d364e-c92f-4564-8a69-9bc64cc6ebef tempest-SnapshotDependencyTests-859112781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e65c4be3-db19-4779-b644-3cbedfcbe37d.info {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:00:08 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e65c4be3-db19-4779-b644-3cbedfcbe37d.info Jul 08 19:00:08 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:00:08 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root Jul 08 19:00:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-f4b4c98f-148b-437b-b5c4-d39dfc1d5712 tempest-ProjectMemberTests-704047872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.802s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:00:08 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-f4b4c98f-148b-437b-b5c4-d39dfc1d5712 tempest-ProjectMemberTests-704047872 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:00:08 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-f4b4c98f-148b-437b-b5c4-d39dfc1d5712 tempest-ProjectMemberTests-704047872 None] Deleted volume successfully. Jul 08 19:00:08 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-f4b4c98f-148b-437b-b5c4-d39dfc1d5712 tempest-ProjectMemberTests-704047872 None] Lock "cinder-55fdea74-25c7-4d0c-b696-d447fc715f8e-delete_volume" released by "delete_volume" :: held 2.639s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:00:08 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Jul 08 19:00:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-680d364e-c92f-4564-8a69-9bc64cc6ebef tempest-SnapshotDependencyTests-859112781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e65c4be3-db19-4779-b644-3cbedfcbe37d.info" returned: 0 in 0.722s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:00:08 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-680d364e-c92f-4564-8a69-9bc64cc6ebef tempest-SnapshotDependencyTests-859112781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.703s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:00:09 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-680d364e-c92f-4564-8a69-9bc64cc6ebef tempest-SnapshotDependencyTests-859112781 None] Create snapshot completed successfully Jul 08 19:00:10 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-2777ca32-b19e-4d6e-8cc4-6ba6af9449bf tempest-SnapshotDependencyTests-859112781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:00:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2777ca32-b19e-4d6e-8cc4-6ba6af9449bf tempest-SnapshotDependencyTests-859112781 None] Flow 'volume_create_manager' (023a2724-b640-452b-a73d-ad861a6be310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:00:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2777ca32-b19e-4d6e-8cc4-6ba6af9449bf tempest-SnapshotDependencyTests-859112781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e12ad34-cc96-4c42-b098-e05155f5b2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:00:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2777ca32-b19e-4d6e-8cc4-6ba6af9449bf tempest-SnapshotDependencyTests-859112781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e12ad34-cc96-4c42-b098-e05155f5b2b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:00:10Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae69b567-2217-481d-a3ba-9f319744486c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e476bd3b79854338bcd64f63e12fc7de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:00:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4785329b-633c-4455-b1da-d720c10c91cd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:00:10Z,use_quota=True,user_id='29320e6288a4479fb1918c18e00b7c61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:00:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2777ca32-b19e-4d6e-8cc4-6ba6af9449bf tempest-SnapshotDependencyTests-859112781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8856d838-456c-495f-af9e-f2d5a734ed51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:00:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2777ca32-b19e-4d6e-8cc4-6ba6af9449bf tempest-SnapshotDependencyTests-859112781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8856d838-456c-495f-af9e-f2d5a734ed51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:00:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2777ca32-b19e-4d6e-8cc4-6ba6af9449bf tempest-SnapshotDependencyTests-859112781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c39ea81-2d67-491d-af88-136c4411160b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:00:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2777ca32-b19e-4d6e-8cc4-6ba6af9449bf tempest-SnapshotDependencyTests-859112781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c39ea81-2d67-491d-af88-136c4411160b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ae69b567-2217-481d-a3ba-9f319744486c', 'volume_name': 'volume-ae69b567-2217-481d-a3ba-9f319744486c', 'volume_size': 1, 'snapshot_id': '4785329b-633c-4455-b1da-d720c10c91cd'}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:00:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2777ca32-b19e-4d6e-8cc4-6ba6af9449bf tempest-SnapshotDependencyTests-859112781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8f9df4d-f47a-4bd4-9aec-b0b39e396639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:00:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2777ca32-b19e-4d6e-8cc4-6ba6af9449bf tempest-SnapshotDependencyTests-859112781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8f9df4d-f47a-4bd4-9aec-b0b39e396639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:00:10 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2777ca32-b19e-4d6e-8cc4-6ba6af9449bf tempest-SnapshotDependencyTests-859112781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78bbecfa-14c5-4241-9ef0-59a6e6259d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:00:10 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-2777ca32-b19e-4d6e-8cc4-6ba6af9449bf tempest-SnapshotDependencyTests-859112781 None] Volume ae69b567-2217-481d-a3ba-9f319744486c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ae69b567-2217-481d-a3ba-9f319744486c', 'volume_size': 1, 'snapshot_id': '4785329b-633c-4455-b1da-d720c10c91cd'} Jul 08 19:00:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-2777ca32-b19e-4d6e-8cc4-6ba6af9449bf tempest-SnapshotDependencyTests-859112781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:00:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-2777ca32-b19e-4d6e-8cc4-6ba6af9449bf tempest-SnapshotDependencyTests-859112781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:00:10 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-2777ca32-b19e-4d6e-8cc4-6ba6af9449bf tempest-SnapshotDependencyTests-859112781 None] Acquiring lock "cinder-quobyte-4785329b-633c-4455-b1da-d720c10c91cd-ae69b567-2217-481d-a3ba-9f319744486c" by "_create_volume_from_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:00:10 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-2777ca32-b19e-4d6e-8cc4-6ba6af9449bf tempest-SnapshotDependencyTests-859112781 None] Lock "cinder-quobyte-4785329b-633c-4455-b1da-d720c10c91cd-ae69b567-2217-481d-a3ba-9f319744486c" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:00:10 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-2777ca32-b19e-4d6e-8cc4-6ba6af9449bf tempest-SnapshotDependencyTests-859112781 None] Creating volume ae69b567-2217-481d-a3ba-9f319744486c from snapshot 4785329b-633c-4455-b1da-d720c10c91cd {{(pid=86873) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 19:00:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-2777ca32-b19e-4d6e-8cc4-6ba6af9449bf tempest-SnapshotDependencyTests-859112781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:00:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-2777ca32-b19e-4d6e-8cc4-6ba6af9449bf tempest-SnapshotDependencyTests-859112781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:00:10 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-2777ca32-b19e-4d6e-8cc4-6ba6af9449bf tempest-SnapshotDependencyTests-859112781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:00:10 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-2777ca32-b19e-4d6e-8cc4-6ba6af9449bf tempest-SnapshotDependencyTests-859112781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:00:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-2777ca32-b19e-4d6e-8cc4-6ba6af9449bf tempest-SnapshotDependencyTests-859112781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:00:10 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-2777ca32-b19e-4d6e-8cc4-6ba6af9449bf tempest-SnapshotDependencyTests-859112781 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:00:10 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-2777ca32-b19e-4d6e-8cc4-6ba6af9449bf tempest-SnapshotDependencyTests-859112781 None] Acquiring lock "cinder-quobyte-ae69b567-2217-481d-a3ba-9f319744486c" by "_copy_volume_from_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:00:10 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-2777ca32-b19e-4d6e-8cc4-6ba6af9449bf tempest-SnapshotDependencyTests-859112781 None] Lock "cinder-quobyte-ae69b567-2217-481d-a3ba-9f319744486c" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:00:10 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-2777ca32-b19e-4d6e-8cc4-6ba6af9449bf tempest-SnapshotDependencyTests-859112781 None] snapshot: 4785329b-633c-4455-b1da-d720c10c91cd, volume: ae69b567-2217-481d-a3ba-9f319744486c, {{(pid=86873) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 19:00:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-2777ca32-b19e-4d6e-8cc4-6ba6af9449bf tempest-SnapshotDependencyTests-859112781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:00:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-2777ca32-b19e-4d6e-8cc4-6ba6af9449bf tempest-SnapshotDependencyTests-859112781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:00:10 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-2777ca32-b19e-4d6e-8cc4-6ba6af9449bf tempest-SnapshotDependencyTests-859112781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:00:10 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-2777ca32-b19e-4d6e-8cc4-6ba6af9449bf tempest-SnapshotDependencyTests-859112781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:00:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-2777ca32-b19e-4d6e-8cc4-6ba6af9449bf tempest-SnapshotDependencyTests-859112781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:00:10 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aee0194-7b3a-4217-a67b-67117cb8fc4a]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:00:10 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2777ca32-b19e-4d6e-8cc4-6ba6af9449bf tempest-SnapshotDependencyTests-859112781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e65c4be3-db19-4779-b644-3cbedfcbe37d.4785329b-633c-4455-b1da-d720c10c91cd {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:00:10 devstack sudo[106105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e65c4be3-db19-4779-b644-3cbedfcbe37d.4785329b-633c-4455-b1da-d720c10c91cd Jul 08 19:00:10 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:00:11 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root Jul 08 19:00:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2777ca32-b19e-4d6e-8cc4-6ba6af9449bf tempest-SnapshotDependencyTests-859112781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e65c4be3-db19-4779-b644-3cbedfcbe37d.4785329b-633c-4455-b1da-d720c10c91cd" returned: 0 in 0.820s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:00:11 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-2777ca32-b19e-4d6e-8cc4-6ba6af9449bf tempest-SnapshotDependencyTests-859112781 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e65c4be3-db19-4779-b644-3cbedfcbe37d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:00:11 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-2777ca32-b19e-4d6e-8cc4-6ba6af9449bf tempest-SnapshotDependencyTests-859112781 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e65c4be3-db19-4779-b644-3cbedfcbe37d {{(pid=86873) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 19:00:11 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-2777ca32-b19e-4d6e-8cc4-6ba6af9449bf tempest-SnapshotDependencyTests-859112781 None] Creating direct copy from snapshot {{(pid=86873) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 19:00:11 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[427059b7-7394-46c4-b321-f29925e3b0a4]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:00:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2777ca32-b19e-4d6e-8cc4-6ba6af9449bf tempest-SnapshotDependencyTests-859112781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e65c4be3-db19-4779-b644-3cbedfcbe37d {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:00:11 devstack sudo[106111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e65c4be3-db19-4779-b644-3cbedfcbe37d Jul 08 19:00:11 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:00:11 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root Jul 08 19:00:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2777ca32-b19e-4d6e-8cc4-6ba6af9449bf tempest-SnapshotDependencyTests-859112781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e65c4be3-db19-4779-b644-3cbedfcbe37d" returned: 0 in 0.793s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:00:11 devstack cinder-volume[86873]: DEBUG cinder.utils [None req-2777ca32-b19e-4d6e-8cc4-6ba6af9449bf tempest-SnapshotDependencyTests-859112781 None] Path /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ae69b567-2217-481d-a3ba-9f319744486c not found in is_blk_device check {{(pid=86873) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 19:00:11 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2777ca32-b19e-4d6e-8cc4-6ba6af9449bf tempest-SnapshotDependencyTests-859112781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e65c4be3-db19-4779-b644-3cbedfcbe37d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ae69b567-2217-481d-a3ba-9f319744486c {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:00:11 devstack sudo[106116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e65c4be3-db19-4779-b644-3cbedfcbe37d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ae69b567-2217-481d-a3ba-9f319744486c Jul 08 19:00:11 devstack sudo[106116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:00:17 devstack sudo[106116]: pam_unix(sudo:session): session closed for user root Jul 08 19:00:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2777ca32-b19e-4d6e-8cc4-6ba6af9449bf tempest-SnapshotDependencyTests-859112781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e65c4be3-db19-4779-b644-3cbedfcbe37d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ae69b567-2217-481d-a3ba-9f319744486c" returned: 0 in 5.161s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:00:17 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5d1a83-c2ab-4390-aea4-e0b8184ea144]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:00:17 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2777ca32-b19e-4d6e-8cc4-6ba6af9449bf tempest-SnapshotDependencyTests-859112781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e65c4be3-db19-4779-b644-3cbedfcbe37d {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:00:17 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e65c4be3-db19-4779-b644-3cbedfcbe37d Jul 08 19:00:17 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:00:18 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Jul 08 19:00:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2777ca32-b19e-4d6e-8cc4-6ba6af9449bf tempest-SnapshotDependencyTests-859112781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e65c4be3-db19-4779-b644-3cbedfcbe37d" returned: 0 in 0.962s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:00:18 devstack cinder-volume[86873]: DEBUG cinder.image.image_utils [None req-2777ca32-b19e-4d6e-8cc4-6ba6af9449bf tempest-SnapshotDependencyTests-859112781 None] Image conversion details: src /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e65c4be3-db19-4779-b644-3cbedfcbe37d, size 1024.00 MB, duration 5.16 sec, destination /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ae69b567-2217-481d-a3ba-9f319744486c {{(pid=86873) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 19:00:18 devstack cinder-volume[86873]: INFO cinder.image.image_utils [None req-2777ca32-b19e-4d6e-8cc4-6ba6af9449bf tempest-SnapshotDependencyTests-859112781 None] Converted 1024.00 MB image at 198.37 MB/s Jul 08 19:00:18 devstack cinder-volume[86873]: WARNING cinder.volume.drivers.remotefs [None req-2777ca32-b19e-4d6e-8cc4-6ba6af9449bf tempest-SnapshotDependencyTests-859112781 None] /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ae69b567-2217-481d-a3ba-9f319744486c is being set with open permissions: ugo+rw Jul 08 19:00:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2777ca32-b19e-4d6e-8cc4-6ba6af9449bf tempest-SnapshotDependencyTests-859112781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ae69b567-2217-481d-a3ba-9f319744486c {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:00:18 devstack sudo[106141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ae69b567-2217-481d-a3ba-9f319744486c Jul 08 19:00:18 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:00:18 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root Jul 08 19:00:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-2777ca32-b19e-4d6e-8cc4-6ba6af9449bf tempest-SnapshotDependencyTests-859112781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ae69b567-2217-481d-a3ba-9f319744486c" returned: 0 in 0.742s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:00:18 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-2777ca32-b19e-4d6e-8cc4-6ba6af9449bf tempest-SnapshotDependencyTests-859112781 None] Lock "cinder-quobyte-ae69b567-2217-481d-a3ba-9f319744486c" released by "_copy_volume_from_snapshot" :: held 8.591s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:00:18 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-2777ca32-b19e-4d6e-8cc4-6ba6af9449bf tempest-SnapshotDependencyTests-859112781 None] Lock "cinder-quobyte-4785329b-633c-4455-b1da-d720c10c91cd-ae69b567-2217-481d-a3ba-9f319744486c" released by "_create_volume_from_snapshot" :: held 8.625s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:00:18 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-2777ca32-b19e-4d6e-8cc4-6ba6af9449bf tempest-SnapshotDependencyTests-859112781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.644s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:00:18 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2777ca32-b19e-4d6e-8cc4-6ba6af9449bf tempest-SnapshotDependencyTests-859112781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78bbecfa-14c5-4241-9ef0-59a6e6259d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae69b567-2217-481d-a3ba-9f319744486c', 'volume_size': 1, 'snapshot_id': '4785329b-633c-4455-b1da-d720c10c91cd'}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:00:18 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2777ca32-b19e-4d6e-8cc4-6ba6af9449bf tempest-SnapshotDependencyTests-859112781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (389f2827-5ea0-443f-a769-408abeae1552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:00:18 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-2777ca32-b19e-4d6e-8cc4-6ba6af9449bf tempest-SnapshotDependencyTests-859112781 None] Volume volume-ae69b567-2217-481d-a3ba-9f319744486c (ae69b567-2217-481d-a3ba-9f319744486c): created successfully Jul 08 19:00:18 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2777ca32-b19e-4d6e-8cc4-6ba6af9449bf tempest-SnapshotDependencyTests-859112781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (389f2827-5ea0-443f-a769-408abeae1552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:00:18 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-2777ca32-b19e-4d6e-8cc4-6ba6af9449bf tempest-SnapshotDependencyTests-859112781 None] Flow 'volume_create_manager' (023a2724-b640-452b-a73d-ad861a6be310) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:00:18 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-2777ca32-b19e-4d6e-8cc4-6ba6af9449bf tempest-SnapshotDependencyTests-859112781 None] Created volume successfully. Jul 08 19:00:19 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-874210a3-d32e-41ee-994e-0e20b3ea982e tempest-SnapshotDependencyTests-859112781 None] Acquiring lock "cinder-4785329b-633c-4455-b1da-d720c10c91cd-delete_snapshot" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:00:19 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-874210a3-d32e-41ee-994e-0e20b3ea982e tempest-SnapshotDependencyTests-859112781 None] Lock "cinder-4785329b-633c-4455-b1da-d720c10c91cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:00:19 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-874210a3-d32e-41ee-994e-0e20b3ea982e tempest-SnapshotDependencyTests-859112781 None] Acquiring lock "cinder-quobyte-e65c4be3-db19-4779-b644-3cbedfcbe37d" by "delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:00:19 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-874210a3-d32e-41ee-994e-0e20b3ea982e tempest-SnapshotDependencyTests-859112781 None] Lock "cinder-quobyte-e65c4be3-db19-4779-b644-3cbedfcbe37d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:00:19 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-874210a3-d32e-41ee-994e-0e20b3ea982e tempest-SnapshotDependencyTests-859112781 None] Acquiring lock "cinder-quobyte-4785329b-633c-4455-b1da-d720c10c91cd" by "_delete_snapshot" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:00:20 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-874210a3-d32e-41ee-994e-0e20b3ea982e tempest-SnapshotDependencyTests-859112781 None] Lock "cinder-quobyte-4785329b-633c-4455-b1da-d720c10c91cd" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:00:20 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-874210a3-d32e-41ee-994e-0e20b3ea982e tempest-SnapshotDependencyTests-859112781 None] Deleting offline snapshot 4785329b-633c-4455-b1da-d720c10c91cd of volume e65c4be3-db19-4779-b644-3cbedfcbe37d {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:00:20 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-874210a3-d32e-41ee-994e-0e20b3ea982e tempest-SnapshotDependencyTests-859112781 None] snapshot_file for this snap is: volume-e65c4be3-db19-4779-b644-3cbedfcbe37d.4785329b-633c-4455-b1da-d720c10c91cd {{(pid=86873) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:00:20 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e82601d-6f72-4a02-a1a6-ab18542c13ef]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:00:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-874210a3-d32e-41ee-994e-0e20b3ea982e tempest-SnapshotDependencyTests-859112781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e65c4be3-db19-4779-b644-3cbedfcbe37d.4785329b-633c-4455-b1da-d720c10c91cd {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:00:20 devstack sudo[106144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e65c4be3-db19-4779-b644-3cbedfcbe37d.4785329b-633c-4455-b1da-d720c10c91cd Jul 08 19:00:20 devstack sudo[106144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:00:20 devstack sudo[106144]: pam_unix(sudo:session): session closed for user root Jul 08 19:00:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-874210a3-d32e-41ee-994e-0e20b3ea982e tempest-SnapshotDependencyTests-859112781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e65c4be3-db19-4779-b644-3cbedfcbe37d.4785329b-633c-4455-b1da-d720c10c91cd" returned: 0 in 0.792s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:00:20 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-874210a3-d32e-41ee-994e-0e20b3ea982e tempest-SnapshotDependencyTests-859112781 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e65c4be3-db19-4779-b644-3cbedfcbe37d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86873) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:00:20 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5087e37-6fab-4a30-b691-603b033deb4d]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:00:20 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-874210a3-d32e-41ee-994e-0e20b3ea982e tempest-SnapshotDependencyTests-859112781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e65c4be3-db19-4779-b644-3cbedfcbe37d {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:00:20 devstack sudo[106149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e65c4be3-db19-4779-b644-3cbedfcbe37d Jul 08 19:00:20 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:00:21 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-70de8a22-657d-4c89-8527-e99666dbfc16 tempest-ProjectReaderTests-1196699577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:00:21 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-70de8a22-657d-4c89-8527-e99666dbfc16 tempest-ProjectReaderTests-1196699577 None] Flow 'volume_create_manager' (84924eec-8cd8-4978-9688-0c7d405fa311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:00:21 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-70de8a22-657d-4c89-8527-e99666dbfc16 tempest-ProjectReaderTests-1196699577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (817f64af-7b1c-4d0d-8c97-ff64b4c84a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:00:21 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-70de8a22-657d-4c89-8527-e99666dbfc16 tempest-ProjectReaderTests-1196699577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (817f64af-7b1c-4d0d-8c97-ff64b4c84a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:00:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-864191664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c5088a2-faaa-4218-96b4-02d3d15209a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9daea9a94d2b4d4692e56046bfecdcda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:00:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:00:21Z,use_quota=True,user_id='1f281bee853b40828dddb4b9a26fa094',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:00:21 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-70de8a22-657d-4c89-8527-e99666dbfc16 tempest-ProjectReaderTests-1196699577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a210ccb-2bae-4599-b2bf-999c86c96344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:00:21 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-70de8a22-657d-4c89-8527-e99666dbfc16 tempest-ProjectReaderTests-1196699577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a210ccb-2bae-4599-b2bf-999c86c96344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:00:21 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-70de8a22-657d-4c89-8527-e99666dbfc16 tempest-ProjectReaderTests-1196699577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf29228b-a3a9-43c2-8454-81bb7aff9644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:00:21 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-70de8a22-657d-4c89-8527-e99666dbfc16 tempest-ProjectReaderTests-1196699577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf29228b-a3a9-43c2-8454-81bb7aff9644) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c5088a2-faaa-4218-96b4-02d3d15209a9', 'volume_name': 'volume-8c5088a2-faaa-4218-96b4-02d3d15209a9', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:00:21 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-70de8a22-657d-4c89-8527-e99666dbfc16 tempest-ProjectReaderTests-1196699577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6a7a96b-28af-4e19-b819-65dc6f552239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:00:21 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-70de8a22-657d-4c89-8527-e99666dbfc16 tempest-ProjectReaderTests-1196699577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6a7a96b-28af-4e19-b819-65dc6f552239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:00:21 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-70de8a22-657d-4c89-8527-e99666dbfc16 tempest-ProjectReaderTests-1196699577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36726d3b-98fe-4bc8-87c7-c7ec046bff79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:00:21 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-70de8a22-657d-4c89-8527-e99666dbfc16 tempest-ProjectReaderTests-1196699577 None] Volume 8c5088a2-faaa-4218-96b4-02d3d15209a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c5088a2-faaa-4218-96b4-02d3d15209a9', 'volume_size': 1} Jul 08 19:00:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-70de8a22-657d-4c89-8527-e99666dbfc16 tempest-ProjectReaderTests-1196699577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:00:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-70de8a22-657d-4c89-8527-e99666dbfc16 tempest-ProjectReaderTests-1196699577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:00:21 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-70de8a22-657d-4c89-8527-e99666dbfc16 tempest-ProjectReaderTests-1196699577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:00:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-864191664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c5088a2-faaa-4218-96b4-02d3d15209a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9daea9a94d2b4d4692e56046bfecdcda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:00:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:00:21Z,use_quota=True,user_id='1f281bee853b40828dddb4b9a26fa094',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:00:21 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-70de8a22-657d-4c89-8527-e99666dbfc16 tempest-ProjectReaderTests-1196699577 None] Creating volume 8c5088a2-faaa-4218-96b4-02d3d15209a9 {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:00:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-70de8a22-657d-4c89-8527-e99666dbfc16 tempest-ProjectReaderTests-1196699577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:00:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-70de8a22-657d-4c89-8527-e99666dbfc16 tempest-ProjectReaderTests-1196699577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:00:21 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-70de8a22-657d-4c89-8527-e99666dbfc16 tempest-ProjectReaderTests-1196699577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:00:21 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-70de8a22-657d-4c89-8527-e99666dbfc16 tempest-ProjectReaderTests-1196699577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:00:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-70de8a22-657d-4c89-8527-e99666dbfc16 tempest-ProjectReaderTests-1196699577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:00:21 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-70de8a22-657d-4c89-8527-e99666dbfc16 tempest-ProjectReaderTests-1196699577 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:00:21 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-70de8a22-657d-4c89-8527-e99666dbfc16 tempest-ProjectReaderTests-1196699577 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 19:00:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-70de8a22-657d-4c89-8527-e99666dbfc16 tempest-ProjectReaderTests-1196699577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8c5088a2-faaa-4218-96b4-02d3d15209a9 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:00:21 devstack sudo[106151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8c5088a2-faaa-4218-96b4-02d3d15209a9 1073741824 Jul 08 19:00:21 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:00:21 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root Jul 08 19:00:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-874210a3-d32e-41ee-994e-0e20b3ea982e tempest-SnapshotDependencyTests-859112781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e65c4be3-db19-4779-b644-3cbedfcbe37d" returned: 0 in 0.775s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:00:21 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-874210a3-d32e-41ee-994e-0e20b3ea982e tempest-SnapshotDependencyTests-859112781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e65c4be3-db19-4779-b644-3cbedfcbe37d.4785329b-633c-4455-b1da-d720c10c91cd {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:00:21 devstack sudo[106156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e65c4be3-db19-4779-b644-3cbedfcbe37d.4785329b-633c-4455-b1da-d720c10c91cd Jul 08 19:00:21 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:00:22 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root Jul 08 19:00:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-70de8a22-657d-4c89-8527-e99666dbfc16 tempest-ProjectReaderTests-1196699577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8c5088a2-faaa-4218-96b4-02d3d15209a9 1073741824" returned: 0 in 0.837s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:00:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-70de8a22-657d-4c89-8527-e99666dbfc16 tempest-ProjectReaderTests-1196699577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8c5088a2-faaa-4218-96b4-02d3d15209a9 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:00:22 devstack sudo[106164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8c5088a2-faaa-4218-96b4-02d3d15209a9 Jul 08 19:00:22 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:00:22 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root Jul 08 19:00:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-874210a3-d32e-41ee-994e-0e20b3ea982e tempest-SnapshotDependencyTests-859112781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e65c4be3-db19-4779-b644-3cbedfcbe37d.4785329b-633c-4455-b1da-d720c10c91cd" returned: 0 in 0.765s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:00:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-874210a3-d32e-41ee-994e-0e20b3ea982e tempest-SnapshotDependencyTests-859112781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e65c4be3-db19-4779-b644-3cbedfcbe37d.4785329b-633c-4455-b1da-d720c10c91cd {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:00:22 devstack sudo[106166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e65c4be3-db19-4779-b644-3cbedfcbe37d.4785329b-633c-4455-b1da-d720c10c91cd Jul 08 19:00:22 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:00:22 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root Jul 08 19:00:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-70de8a22-657d-4c89-8527-e99666dbfc16 tempest-ProjectReaderTests-1196699577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8c5088a2-faaa-4218-96b4-02d3d15209a9" returned: 0 in 0.647s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:00:22 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-70de8a22-657d-4c89-8527-e99666dbfc16 tempest-ProjectReaderTests-1196699577 None] <== create_volume: return (1532ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:00:22 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-70de8a22-657d-4c89-8527-e99666dbfc16 tempest-ProjectReaderTests-1196699577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.534s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:00:22 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-70de8a22-657d-4c89-8527-e99666dbfc16 tempest-ProjectReaderTests-1196699577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36726d3b-98fe-4bc8-87c7-c7ec046bff79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c5088a2-faaa-4218-96b4-02d3d15209a9', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:00:22 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-70de8a22-657d-4c89-8527-e99666dbfc16 tempest-ProjectReaderTests-1196699577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c53dfb6-23e3-4aee-88e1-d1178b586e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:00:22 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-70de8a22-657d-4c89-8527-e99666dbfc16 tempest-ProjectReaderTests-1196699577 None] Volume volume-8c5088a2-faaa-4218-96b4-02d3d15209a9 (8c5088a2-faaa-4218-96b4-02d3d15209a9): created successfully Jul 08 19:00:22 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-70de8a22-657d-4c89-8527-e99666dbfc16 tempest-ProjectReaderTests-1196699577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c53dfb6-23e3-4aee-88e1-d1178b586e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:00:22 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-70de8a22-657d-4c89-8527-e99666dbfc16 tempest-ProjectReaderTests-1196699577 None] Flow 'volume_create_manager' (84924eec-8cd8-4978-9688-0c7d405fa311) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:00:22 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-70de8a22-657d-4c89-8527-e99666dbfc16 tempest-ProjectReaderTests-1196699577 None] Created volume successfully. Jul 08 19:00:23 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root Jul 08 19:00:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-874210a3-d32e-41ee-994e-0e20b3ea982e tempest-SnapshotDependencyTests-859112781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e65c4be3-db19-4779-b644-3cbedfcbe37d.4785329b-633c-4455-b1da-d720c10c91cd" returned: 0 in 0.664s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:00:23 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-874210a3-d32e-41ee-994e-0e20b3ea982e tempest-SnapshotDependencyTests-859112781 None] Lock "cinder-quobyte-4785329b-633c-4455-b1da-d720c10c91cd" released by "_delete_snapshot" :: held 3.104s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:00:23 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-874210a3-d32e-41ee-994e-0e20b3ea982e tempest-SnapshotDependencyTests-859112781 None] Lock "cinder-quobyte-e65c4be3-db19-4779-b644-3cbedfcbe37d" released by "delete_snapshot" :: held 3.128s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:00:23 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-874210a3-d32e-41ee-994e-0e20b3ea982e tempest-SnapshotDependencyTests-859112781 None] Created reservations ['ec9d9146-5576-4df5-acb7-e62db980388f', 'f99bc442-e6b7-4531-b510-271a9deb4441', 'bdb2a873-f770-4fe5-8f08-3439ae84d1a5', '76d4a8ee-c5ac-4423-ba94-3d4ac23ff5b2'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:00:23 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-874210a3-d32e-41ee-994e-0e20b3ea982e tempest-SnapshotDependencyTests-859112781 None] Delete snapshot completed successfully. Jul 08 19:00:23 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-874210a3-d32e-41ee-994e-0e20b3ea982e tempest-SnapshotDependencyTests-859112781 None] Lock "cinder-4785329b-633c-4455-b1da-d720c10c91cd-delete_snapshot" released by "delete_snapshot" :: held 3.258s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:00:23 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-473f612b-d2fb-4175-b419-623de338a04f tempest-ProjectReaderTests-1196699577 None] Acquiring lock "cinder-8c5088a2-faaa-4218-96b4-02d3d15209a9-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:00:23 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-473f612b-d2fb-4175-b419-623de338a04f tempest-ProjectReaderTests-1196699577 None] Lock "cinder-8c5088a2-faaa-4218-96b4-02d3d15209a9-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:00:23 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-473f612b-d2fb-4175-b419-623de338a04f tempest-ProjectReaderTests-1196699577 None] Acquiring lock "cinder-quobyte-8c5088a2-faaa-4218-96b4-02d3d15209a9" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:00:23 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-473f612b-d2fb-4175-b419-623de338a04f tempest-ProjectReaderTests-1196699577 None] Lock "cinder-quobyte-8c5088a2-faaa-4218-96b4-02d3d15209a9" acquired by "delete_volume" :: waited 0.016s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:00:23 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29b6987-7b7f-4fbe-8be6-b339b790d2b9]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:00:23 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-473f612b-d2fb-4175-b419-623de338a04f tempest-ProjectReaderTests-1196699577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8c5088a2-faaa-4218-96b4-02d3d15209a9 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:00:23 devstack sudo[106171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8c5088a2-faaa-4218-96b4-02d3d15209a9 Jul 08 19:00:23 devstack sudo[106171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:00:24 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ee1f422f-b72b-473c-8e9f-48b5a4d33890 tempest-SnapshotDependencyTests-859112781 None] Acquiring lock "cinder-e65c4be3-db19-4779-b644-3cbedfcbe37d-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:00:24 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ee1f422f-b72b-473c-8e9f-48b5a4d33890 tempest-SnapshotDependencyTests-859112781 None] Lock "cinder-e65c4be3-db19-4779-b644-3cbedfcbe37d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:00:24 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ee1f422f-b72b-473c-8e9f-48b5a4d33890 tempest-SnapshotDependencyTests-859112781 None] Acquiring lock "cinder-quobyte-e65c4be3-db19-4779-b644-3cbedfcbe37d" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:00:24 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ee1f422f-b72b-473c-8e9f-48b5a4d33890 tempest-SnapshotDependencyTests-859112781 None] Lock "cinder-quobyte-e65c4be3-db19-4779-b644-3cbedfcbe37d" acquired by "delete_volume" :: waited 0.014s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:00:24 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8acda4-a6e3-4886-a484-aaa9d38d6865]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:00:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ee1f422f-b72b-473c-8e9f-48b5a4d33890 tempest-SnapshotDependencyTests-859112781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e65c4be3-db19-4779-b644-3cbedfcbe37d {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:00:24 devstack sudo[106171]: pam_unix(sudo:session): session closed for user root Jul 08 19:00:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-473f612b-d2fb-4175-b419-623de338a04f tempest-ProjectReaderTests-1196699577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8c5088a2-faaa-4218-96b4-02d3d15209a9" returned: 0 in 0.801s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:00:24 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-473f612b-d2fb-4175-b419-623de338a04f tempest-ProjectReaderTests-1196699577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8c5088a2-faaa-4218-96b4-02d3d15209a9 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:00:24 devstack sudo[106176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e65c4be3-db19-4779-b644-3cbedfcbe37d Jul 08 19:00:24 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:00:24 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8c5088a2-faaa-4218-96b4-02d3d15209a9 Jul 08 19:00:24 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:00:25 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Jul 08 19:00:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-473f612b-d2fb-4175-b419-623de338a04f tempest-ProjectReaderTests-1196699577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-8c5088a2-faaa-4218-96b4-02d3d15209a9" returned: 0 in 0.648s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:00:25 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-473f612b-d2fb-4175-b419-623de338a04f tempest-ProjectReaderTests-1196699577 None] Lock "cinder-quobyte-8c5088a2-faaa-4218-96b4-02d3d15209a9" released by "delete_volume" :: held 1.492s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:00:25 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root Jul 08 19:00:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ee1f422f-b72b-473c-8e9f-48b5a4d33890 tempest-SnapshotDependencyTests-859112781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e65c4be3-db19-4779-b644-3cbedfcbe37d" returned: 0 in 0.792s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:00:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ee1f422f-b72b-473c-8e9f-48b5a4d33890 tempest-SnapshotDependencyTests-859112781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e65c4be3-db19-4779-b644-3cbedfcbe37d {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:00:25 devstack sudo[106184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e65c4be3-db19-4779-b644-3cbedfcbe37d Jul 08 19:00:25 devstack sudo[106184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:00:25 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-473f612b-d2fb-4175-b419-623de338a04f tempest-ProjectReaderTests-1196699577 None] Created reservations ['34282b66-e82b-40f3-9e93-1dd55880de31', 'c4c917de-6cb8-4ecf-a615-35fdc9675faa', 'b18a9e6a-6060-4948-80b3-2838aa7f487b', '17c499b6-3067-452b-bfe2-ad4f9ee1f2e8'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:00:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-473f612b-d2fb-4175-b419-623de338a04f tempest-ProjectReaderTests-1196699577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:00:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-473f612b-d2fb-4175-b419-623de338a04f tempest-ProjectReaderTests-1196699577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:00:25 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-473f612b-d2fb-4175-b419-623de338a04f tempest-ProjectReaderTests-1196699577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:00:25 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-473f612b-d2fb-4175-b419-623de338a04f tempest-ProjectReaderTests-1196699577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:00:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-473f612b-d2fb-4175-b419-623de338a04f tempest-ProjectReaderTests-1196699577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:00:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-473f612b-d2fb-4175-b419-623de338a04f tempest-ProjectReaderTests-1196699577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:00:25 devstack sudo[106186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 19:00:25 devstack sudo[106186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:00:25 devstack sudo[106184]: pam_unix(sudo:session): session closed for user root Jul 08 19:00:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ee1f422f-b72b-473c-8e9f-48b5a4d33890 tempest-SnapshotDependencyTests-859112781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-e65c4be3-db19-4779-b644-3cbedfcbe37d" returned: 0 in 0.687s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:00:25 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ee1f422f-b72b-473c-8e9f-48b5a4d33890 tempest-SnapshotDependencyTests-859112781 None] Lock "cinder-quobyte-e65c4be3-db19-4779-b644-3cbedfcbe37d" released by "delete_volume" :: held 1.547s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:00:25 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-ee1f422f-b72b-473c-8e9f-48b5a4d33890 tempest-SnapshotDependencyTests-859112781 None] Created reservations ['bbe5b648-0423-4245-abf1-d3ed2ca0cac4', '0ff2406e-41a6-4350-9f0a-e95730480fd4', 'a091ab69-9b14-4ae7-9293-b02578b7900b', '0856d38c-d279-42ce-bb89-cc84c88c2c1b'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:00:25 devstack sudo[106186]: pam_unix(sudo:session): session closed for user root Jul 08 19:00:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-473f612b-d2fb-4175-b419-623de338a04f tempest-ProjectReaderTests-1196699577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.685s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:00:25 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-473f612b-d2fb-4175-b419-623de338a04f tempest-ProjectReaderTests-1196699577 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:00:25 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-473f612b-d2fb-4175-b419-623de338a04f tempest-ProjectReaderTests-1196699577 None] Deleted volume successfully. Jul 08 19:00:25 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-473f612b-d2fb-4175-b419-623de338a04f tempest-ProjectReaderTests-1196699577 None] Lock "cinder-8c5088a2-faaa-4218-96b4-02d3d15209a9-delete_volume" released by "delete_volume" :: held 2.411s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:00:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-ee1f422f-b72b-473c-8e9f-48b5a4d33890 tempest-SnapshotDependencyTests-859112781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:00:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-ee1f422f-b72b-473c-8e9f-48b5a4d33890 tempest-SnapshotDependencyTests-859112781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:00:25 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-ee1f422f-b72b-473c-8e9f-48b5a4d33890 tempest-SnapshotDependencyTests-859112781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:00:25 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-ee1f422f-b72b-473c-8e9f-48b5a4d33890 tempest-SnapshotDependencyTests-859112781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:00:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-ee1f422f-b72b-473c-8e9f-48b5a4d33890 tempest-SnapshotDependencyTests-859112781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:00:25 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ee1f422f-b72b-473c-8e9f-48b5a4d33890 tempest-SnapshotDependencyTests-859112781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:00:25 devstack sudo[106190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 19:00:25 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:00:26 devstack cinder-volume[86873]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ebd7037-4a8b-4f1e-89d8-da63f52bc08c tempest-ProjectReaderTests-1196699577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:00:26 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-8ebd7037-4a8b-4f1e-89d8-da63f52bc08c tempest-ProjectReaderTests-1196699577 None] Flow 'volume_create_manager' (d1bbe7d0-6e1c-453a-a033-56a0a4027346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:00:26 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-8ebd7037-4a8b-4f1e-89d8-da63f52bc08c tempest-ProjectReaderTests-1196699577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6db4996-731c-4e84-8acb-dc8d6409c8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:00:26 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-8ebd7037-4a8b-4f1e-89d8-da63f52bc08c tempest-ProjectReaderTests-1196699577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6db4996-731c-4e84-8acb-dc8d6409c8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:00:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1817410047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6eed3564-c14c-4e75-9dd1-32008d309d4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9daea9a94d2b4d4692e56046bfecdcda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:00:26Z,use_quota=True,user_id='1f281bee853b40828dddb4b9a26fa094',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:00:26 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-8ebd7037-4a8b-4f1e-89d8-da63f52bc08c tempest-ProjectReaderTests-1196699577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7fdacb0-0090-44b2-8ef9-f1776c3eace7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:00:26 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-8ebd7037-4a8b-4f1e-89d8-da63f52bc08c tempest-ProjectReaderTests-1196699577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7fdacb0-0090-44b2-8ef9-f1776c3eace7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:00:26 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-8ebd7037-4a8b-4f1e-89d8-da63f52bc08c tempest-ProjectReaderTests-1196699577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f32affd-b8a0-42d3-b7df-ad1c071d4123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:00:26 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-8ebd7037-4a8b-4f1e-89d8-da63f52bc08c tempest-ProjectReaderTests-1196699577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f32affd-b8a0-42d3-b7df-ad1c071d4123) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6eed3564-c14c-4e75-9dd1-32008d309d4e', 'volume_name': 'volume-6eed3564-c14c-4e75-9dd1-32008d309d4e', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:00:26 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-8ebd7037-4a8b-4f1e-89d8-da63f52bc08c tempest-ProjectReaderTests-1196699577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a28b7e62-6ac8-41de-a38e-0306a0a13f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:00:26 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-8ebd7037-4a8b-4f1e-89d8-da63f52bc08c tempest-ProjectReaderTests-1196699577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a28b7e62-6ac8-41de-a38e-0306a0a13f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:00:26 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-8ebd7037-4a8b-4f1e-89d8-da63f52bc08c tempest-ProjectReaderTests-1196699577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbc7be14-02e7-4ee4-99b7-518c6254985e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:00:26 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-8ebd7037-4a8b-4f1e-89d8-da63f52bc08c tempest-ProjectReaderTests-1196699577 None] Volume 6eed3564-c14c-4e75-9dd1-32008d309d4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6eed3564-c14c-4e75-9dd1-32008d309d4e', 'volume_size': 1} Jul 08 19:00:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-8ebd7037-4a8b-4f1e-89d8-da63f52bc08c tempest-ProjectReaderTests-1196699577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:00:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-8ebd7037-4a8b-4f1e-89d8-da63f52bc08c tempest-ProjectReaderTests-1196699577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:00:26 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-8ebd7037-4a8b-4f1e-89d8-da63f52bc08c tempest-ProjectReaderTests-1196699577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:00:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1817410047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6eed3564-c14c-4e75-9dd1-32008d309d4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9daea9a94d2b4d4692e56046bfecdcda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:00:26Z,use_quota=True,user_id='1f281bee853b40828dddb4b9a26fa094',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(562e1da4-2fe7-46d4-9ae4-11991a0bcda6),volume_type_id=562e1da4-2fe7-46d4-9ae4-11991a0bcda6)}" {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:00:26 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.remotefs [None req-8ebd7037-4a8b-4f1e-89d8-da63f52bc08c tempest-ProjectReaderTests-1196699577 None] Creating volume 6eed3564-c14c-4e75-9dd1-32008d309d4e {{(pid=86873) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:00:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-8ebd7037-4a8b-4f1e-89d8-da63f52bc08c tempest-ProjectReaderTests-1196699577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:00:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-8ebd7037-4a8b-4f1e-89d8-da63f52bc08c tempest-ProjectReaderTests-1196699577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:00:26 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-8ebd7037-4a8b-4f1e-89d8-da63f52bc08c tempest-ProjectReaderTests-1196699577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:00:26 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-8ebd7037-4a8b-4f1e-89d8-da63f52bc08c tempest-ProjectReaderTests-1196699577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:00:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-8ebd7037-4a8b-4f1e-89d8-da63f52bc08c tempest-ProjectReaderTests-1196699577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:00:26 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-8ebd7037-4a8b-4f1e-89d8-da63f52bc08c tempest-ProjectReaderTests-1196699577 None] Selected osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 as target Quobyte volume. {{(pid=86873) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:00:26 devstack cinder-volume[86873]: INFO cinder.volume.drivers.remotefs [None req-8ebd7037-4a8b-4f1e-89d8-da63f52bc08c tempest-ProjectReaderTests-1196699577 None] casted to osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2 Jul 08 19:00:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8ebd7037-4a8b-4f1e-89d8-da63f52bc08c tempest-ProjectReaderTests-1196699577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6eed3564-c14c-4e75-9dd1-32008d309d4e 1073741824 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:00:26 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6eed3564-c14c-4e75-9dd1-32008d309d4e 1073741824 Jul 08 19:00:26 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:00:26 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-881541e5-6503-446f-b8e7-994b9979b6d9 tempest-SnapshotDependencyTests-859112781 None] Acquiring lock "cinder-ae69b567-2217-481d-a3ba-9f319744486c-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:00:26 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-881541e5-6503-446f-b8e7-994b9979b6d9 tempest-SnapshotDependencyTests-859112781 None] Lock "cinder-ae69b567-2217-481d-a3ba-9f319744486c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:00:26 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-881541e5-6503-446f-b8e7-994b9979b6d9 tempest-SnapshotDependencyTests-859112781 None] Acquiring lock "cinder-quobyte-ae69b567-2217-481d-a3ba-9f319744486c" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:00:26 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-881541e5-6503-446f-b8e7-994b9979b6d9 tempest-SnapshotDependencyTests-859112781 None] Lock "cinder-quobyte-ae69b567-2217-481d-a3ba-9f319744486c" acquired by "delete_volume" :: waited 0.019s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:00:26 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[449adc37-6b79-446b-a4cd-750c1be7e882]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:00:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-881541e5-6503-446f-b8e7-994b9979b6d9 tempest-SnapshotDependencyTests-859112781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ae69b567-2217-481d-a3ba-9f319744486c {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:00:26 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root Jul 08 19:00:26 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ee1f422f-b72b-473c-8e9f-48b5a4d33890 tempest-SnapshotDependencyTests-859112781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.699s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:00:26 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-ee1f422f-b72b-473c-8e9f-48b5a4d33890 tempest-SnapshotDependencyTests-859112781 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:00:26 devstack sudo[106195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ae69b567-2217-481d-a3ba-9f319744486c Jul 08 19:00:26 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:00:26 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-ee1f422f-b72b-473c-8e9f-48b5a4d33890 tempest-SnapshotDependencyTests-859112781 None] Deleted volume successfully. Jul 08 19:00:26 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ee1f422f-b72b-473c-8e9f-48b5a4d33890 tempest-SnapshotDependencyTests-859112781 None] Lock "cinder-e65c4be3-db19-4779-b644-3cbedfcbe37d-delete_volume" released by "delete_volume" :: held 2.492s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:00:27 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Jul 08 19:00:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8ebd7037-4a8b-4f1e-89d8-da63f52bc08c tempest-ProjectReaderTests-1196699577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6eed3564-c14c-4e75-9dd1-32008d309d4e 1073741824" returned: 0 in 0.881s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:00:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8ebd7037-4a8b-4f1e-89d8-da63f52bc08c tempest-ProjectReaderTests-1196699577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6eed3564-c14c-4e75-9dd1-32008d309d4e {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:00:27 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6eed3564-c14c-4e75-9dd1-32008d309d4e Jul 08 19:00:27 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:00:27 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root Jul 08 19:00:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-881541e5-6503-446f-b8e7-994b9979b6d9 tempest-SnapshotDependencyTests-859112781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ae69b567-2217-481d-a3ba-9f319744486c" returned: 0 in 0.798s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:00:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-881541e5-6503-446f-b8e7-994b9979b6d9 tempest-SnapshotDependencyTests-859112781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ae69b567-2217-481d-a3ba-9f319744486c {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:00:27 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ae69b567-2217-481d-a3ba-9f319744486c Jul 08 19:00:27 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:00:27 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Jul 08 19:00:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-8ebd7037-4a8b-4f1e-89d8-da63f52bc08c tempest-ProjectReaderTests-1196699577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6eed3564-c14c-4e75-9dd1-32008d309d4e" returned: 0 in 0.666s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:00:27 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-8ebd7037-4a8b-4f1e-89d8-da63f52bc08c tempest-ProjectReaderTests-1196699577 None] <== create_volume: return (1587ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'} {{(pid=86873) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:00:27 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-8ebd7037-4a8b-4f1e-89d8-da63f52bc08c tempest-ProjectReaderTests-1196699577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.589s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:00:27 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-8ebd7037-4a8b-4f1e-89d8-da63f52bc08c tempest-ProjectReaderTests-1196699577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbc7be14-02e7-4ee4-99b7-518c6254985e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6eed3564-c14c-4e75-9dd1-32008d309d4e', 'volume_size': 1}' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:00:27 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-8ebd7037-4a8b-4f1e-89d8-da63f52bc08c tempest-ProjectReaderTests-1196699577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9a832c6-96e8-499f-8d13-241cdcd0fd6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:00:27 devstack cinder-volume[86873]: INFO cinder.volume.flows.manager.create_volume [None req-8ebd7037-4a8b-4f1e-89d8-da63f52bc08c tempest-ProjectReaderTests-1196699577 None] Volume volume-6eed3564-c14c-4e75-9dd1-32008d309d4e (6eed3564-c14c-4e75-9dd1-32008d309d4e): created successfully Jul 08 19:00:27 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-8ebd7037-4a8b-4f1e-89d8-da63f52bc08c tempest-ProjectReaderTests-1196699577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9a832c6-96e8-499f-8d13-241cdcd0fd6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86873) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:00:27 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-8ebd7037-4a8b-4f1e-89d8-da63f52bc08c tempest-ProjectReaderTests-1196699577 None] Flow 'volume_create_manager' (d1bbe7d0-6e1c-453a-a033-56a0a4027346) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86873) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:00:27 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-8ebd7037-4a8b-4f1e-89d8-da63f52bc08c tempest-ProjectReaderTests-1196699577 None] Created volume successfully. Jul 08 19:00:28 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Jul 08 19:00:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-881541e5-6503-446f-b8e7-994b9979b6d9 tempest-SnapshotDependencyTests-859112781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-ae69b567-2217-481d-a3ba-9f319744486c" returned: 0 in 0.669s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:00:28 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-881541e5-6503-446f-b8e7-994b9979b6d9 tempest-SnapshotDependencyTests-859112781 None] Lock "cinder-quobyte-ae69b567-2217-481d-a3ba-9f319744486c" released by "delete_volume" :: held 1.522s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:00:28 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-881541e5-6503-446f-b8e7-994b9979b6d9 tempest-SnapshotDependencyTests-859112781 None] Created reservations ['27b32557-b3dc-4045-96f2-9053f7ad6eb6', 'edcec9e0-21b7-4046-981c-37e89ef1498b', 'e6f58c72-ac09-4ffc-a5a5-773ad90a2aec', '5b7abb0e-fb43-4d2d-8048-fc3eeec73d98'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:00:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-881541e5-6503-446f-b8e7-994b9979b6d9 tempest-SnapshotDependencyTests-859112781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:00:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-881541e5-6503-446f-b8e7-994b9979b6d9 tempest-SnapshotDependencyTests-859112781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:00:28 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-881541e5-6503-446f-b8e7-994b9979b6d9 tempest-SnapshotDependencyTests-859112781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:00:28 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-881541e5-6503-446f-b8e7-994b9979b6d9 tempest-SnapshotDependencyTests-859112781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:00:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-881541e5-6503-446f-b8e7-994b9979b6d9 tempest-SnapshotDependencyTests-859112781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:00:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-881541e5-6503-446f-b8e7-994b9979b6d9 tempest-SnapshotDependencyTests-859112781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:00:28 devstack sudo[106209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 19:00:28 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:00:28 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ebc9a551-6fc1-418e-99e4-4137b8988805 tempest-ProjectReaderTests-1196699577 None] Acquiring lock "cinder-6eed3564-c14c-4e75-9dd1-32008d309d4e-delete_volume" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:00:28 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ebc9a551-6fc1-418e-99e4-4137b8988805 tempest-ProjectReaderTests-1196699577 None] Lock "cinder-6eed3564-c14c-4e75-9dd1-32008d309d4e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:00:28 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ebc9a551-6fc1-418e-99e4-4137b8988805 tempest-ProjectReaderTests-1196699577 None] Acquiring lock "cinder-quobyte-6eed3564-c14c-4e75-9dd1-32008d309d4e" by "delete_volume" {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:00:28 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ebc9a551-6fc1-418e-99e4-4137b8988805 tempest-ProjectReaderTests-1196699577 None] Lock "cinder-quobyte-6eed3564-c14c-4e75-9dd1-32008d309d4e" acquired by "delete_volume" :: waited 0.015s {{(pid=86873) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:00:28 devstack cinder-volume[86873]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32591c2-3316-42c6-8319-f38f44e5b517]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:00:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ebc9a551-6fc1-418e-99e4-4137b8988805 tempest-ProjectReaderTests-1196699577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6eed3564-c14c-4e75-9dd1-32008d309d4e {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:00:28 devstack sudo[106211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6eed3564-c14c-4e75-9dd1-32008d309d4e Jul 08 19:00:28 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:00:28 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root Jul 08 19:00:28 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-881541e5-6503-446f-b8e7-994b9979b6d9 tempest-SnapshotDependencyTests-859112781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.731s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:00:28 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-881541e5-6503-446f-b8e7-994b9979b6d9 tempest-SnapshotDependencyTests-859112781 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:00:28 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-881541e5-6503-446f-b8e7-994b9979b6d9 tempest-SnapshotDependencyTests-859112781 None] Deleted volume successfully. Jul 08 19:00:28 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-881541e5-6503-446f-b8e7-994b9979b6d9 tempest-SnapshotDependencyTests-859112781 None] Lock "cinder-ae69b567-2217-481d-a3ba-9f319744486c-delete_volume" released by "delete_volume" :: held 2.460s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:00:29 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root Jul 08 19:00:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ebc9a551-6fc1-418e-99e4-4137b8988805 tempest-ProjectReaderTests-1196699577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6eed3564-c14c-4e75-9dd1-32008d309d4e" returned: 0 in 0.825s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:00:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ebc9a551-6fc1-418e-99e4-4137b8988805 tempest-ProjectReaderTests-1196699577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6eed3564-c14c-4e75-9dd1-32008d309d4e {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:00:29 devstack sudo[106217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6eed3564-c14c-4e75-9dd1-32008d309d4e Jul 08 19:00:29 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:00:29 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root Jul 08 19:00:29 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ebc9a551-6fc1-418e-99e4-4137b8988805 tempest-ProjectReaderTests-1196699577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19/volume-6eed3564-c14c-4e75-9dd1-32008d309d4e" returned: 0 in 0.699s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:00:30 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ebc9a551-6fc1-418e-99e4-4137b8988805 tempest-ProjectReaderTests-1196699577 None] Lock "cinder-quobyte-6eed3564-c14c-4e75-9dd1-32008d309d4e" released by "delete_volume" :: held 1.564s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:00:30 devstack cinder-volume[86873]: DEBUG cinder.quota [None req-ebc9a551-6fc1-418e-99e4-4137b8988805 tempest-ProjectReaderTests-1196699577 None] Created reservations ['c33c78b3-8177-4f9f-aff2-5c6aff4aa2d5', '9d7bdd06-430b-47d2-b042-df8a799f2a1b', 'e7021d23-1d62-4a8c-bf57-d30dec87ef8b', '4373d556-23b2-4839-827d-0f22b9e98551'] {{(pid=86873) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:00:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-ebc9a551-6fc1-418e-99e4-4137b8988805 tempest-ProjectReaderTests-1196699577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:00:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-ebc9a551-6fc1-418e-99e4-4137b8988805 tempest-ProjectReaderTests-1196699577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:00:30 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-ebc9a551-6fc1-418e-99e4-4137b8988805 tempest-ProjectReaderTests-1196699577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:00:30 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-ebc9a551-6fc1-418e-99e4-4137b8988805 tempest-ProjectReaderTests-1196699577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:00:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-ebc9a551-6fc1-418e-99e4-4137b8988805 tempest-ProjectReaderTests-1196699577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:00:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ebc9a551-6fc1-418e-99e4-4137b8988805 tempest-ProjectReaderTests-1196699577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:00:30 devstack sudo[106221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 19:00:30 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:00:30 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root Jul 08 19:00:30 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-ebc9a551-6fc1-418e-99e4-4137b8988805 tempest-ProjectReaderTests-1196699577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.744s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:00:30 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-ebc9a551-6fc1-418e-99e4-4137b8988805 tempest-ProjectReaderTests-1196699577 None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:00:30 devstack cinder-volume[86873]: INFO cinder.volume.manager [None req-ebc9a551-6fc1-418e-99e4-4137b8988805 tempest-ProjectReaderTests-1196699577 None] Deleted volume successfully. Jul 08 19:00:30 devstack cinder-volume[86873]: DEBUG cinder.coordination [None req-ebc9a551-6fc1-418e-99e4-4137b8988805 tempest-ProjectReaderTests-1196699577 None] Lock "cinder-6eed3564-c14c-4e75-9dd1-32008d309d4e-delete_volume" released by "delete_volume" :: held 2.517s {{(pid=86873) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:00:40 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:INSERT=27,cinder:UPDATE=101,cinder:SELECT=78,cinder:DELETE=7 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:00:40 devstack cinder-volume[86873]: DEBUG dbcounter [-] [86873] Writing DB stats cinder:SELECT=70,cinder:INSERT=25,cinder:UPDATE=98,cinder:DELETE=9 {{(pid=86873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:00:48 devstack cinder-volume[86873]: DEBUG oslo_service.periodic_task [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86873) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:00:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:00:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:00:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2': None} {{(pid=86873) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:00:48 devstack cinder-volume[86873]: DEBUG cinder.volume.drivers.quobyte [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc4cc94d-63ad-4d5c-aace-9e4ab45ce9f2'] {{(pid=86873) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:00:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.lockutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86873) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:00:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:00:48 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19 Jul 08 19:00:48 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:00:48 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Jul 08 19:00:48 devstack cinder-volume[86873]: DEBUG oslo_concurrency.processutils [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b7837bbc252a2b132eec11decdb5d19" returned: 0 in 0.674s {{(pid=86873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:00:48 devstack cinder-volume[86873]: DEBUG cinder.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Notifying Schedulers of capabilities ... {{(pid=86873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:00:48 devstack cinder-volume[86873]: DEBUG oslo_service.periodic_task [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] Running periodic task VolumeManager._thread_info {{(pid=86873) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:00:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] thread count: 29 {{(pid=86873) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 19:00:48 devstack cinder-volume[86873]: DEBUG cinder.volume.manager [None req-c3e89103-dc9c-4d0d-97e4-3152d67aa986 None None] thread info: [<_MainThread(MainThread, started 138577734545536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86873) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}